2024-09-15T21:40:29.092 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T21:40:29.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T21:40:29.195 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906202 branch: squid description: fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906202' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi001.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMp1Bx/OJuXa6xAFNw8Qg0IG+/etQTvovNJd/mqXmUcSUjWoLAssRfrTtWdMExilc6zfYmsdxkyWkAvF9sYy9TQ= smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCGa67M8Aujp2ssmovEpjT19XW7V4TKlj1TE4cym0BLIiOEmBxQgtNMTdONXqWawq7Iha1eg1+uLmseCZ0xbsP8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_cephfs_shell teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T21:40:29.195 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T21:40:29.195 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T21:40:29.196 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T21:40:29.197 INFO:teuthology.task.internal:Checking packages... 2024-09-15T21:40:29.219 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T21:40:29.219 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T21:40:29.219 INFO:teuthology.packaging:ref: None 2024-09-15T21:40:29.219 INFO:teuthology.packaging:tag: None 2024-09-15T21:40:29.219 INFO:teuthology.packaging:branch: squid 2024-09-15T21:40:29.219 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T21:40:29.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-15T21:40:29.421 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-326-g8921c8ef-1jammy 2024-09-15T21:40:29.423 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T21:40:29.430 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T21:40:29.430 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T21:40:29.436 INFO:teuthology.task.internal:Saving configuration 2024-09-15T21:40:29.471 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T21:40:29.478 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T21:40:29.504 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906202', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 21:34:54.624755', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOzXSxqab84o+sg8McS8tdYPgBv2/5EoA5DBIQmQ2Seu'} 2024-09-15T21:40:29.525 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906202', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 21:34:54.626692', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILhx/DgU8U67GLYfiQrZzZI/3IKmD7bcFrlMI9rFDVpX'} 2024-09-15T21:40:29.525 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T21:40:29.531 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-15T21:40:29.531 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-15T21:40:29.531 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T21:40:29.591 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3d407cb2e0>, signals=[15]) 2024-09-15T21:40:29.591 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T21:40:29.597 INFO:teuthology.task.internal:Opening connections... 2024-09-15T21:40:29.597 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T21:40:29.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:40:29.682 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-09-15T21:40:29.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:40:29.793 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T21:40:29.799 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-09-15T21:40:29.804 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-09-15T21:40:29.804 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-09-15T21:40:29.851 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-15T21:40:29.851 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Ubuntu" 2024-09-15T21:40:29.851 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="22.04" 2024-09-15T21:40:29.851 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-15T21:40:29.851 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_CODENAME=jammy 2024-09-15T21:40:29.851 INFO:teuthology.orchestra.run.smithi001.stdout:ID=ubuntu 2024-09-15T21:40:29.851 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE=debian 2024-09-15T21:40:29.851 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-15T21:40:29.852 INFO:teuthology.orchestra.run.smithi001.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-15T21:40:29.852 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-15T21:40:29.852 INFO:teuthology.orchestra.run.smithi001.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-15T21:40:29.852 INFO:teuthology.orchestra.run.smithi001.stdout:UBUNTU_CODENAME=jammy 2024-09-15T21:40:29.852 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-09-15T21:40:29.875 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-09-15T21:40:29.880 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-09-15T21:40:29.881 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-09-15T21:40:29.928 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-15T21:40:29.928 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Ubuntu" 2024-09-15T21:40:29.929 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="22.04" 2024-09-15T21:40:29.929 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-15T21:40:29.929 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_CODENAME=jammy 2024-09-15T21:40:29.929 INFO:teuthology.orchestra.run.smithi070.stdout:ID=ubuntu 2024-09-15T21:40:29.929 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE=debian 2024-09-15T21:40:29.929 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-15T21:40:29.929 INFO:teuthology.orchestra.run.smithi070.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-15T21:40:29.929 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-15T21:40:29.929 INFO:teuthology.orchestra.run.smithi070.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-15T21:40:29.929 INFO:teuthology.orchestra.run.smithi070.stdout:UBUNTU_CODENAME=jammy 2024-09-15T21:40:29.929 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-09-15T21:40:29.950 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T21:40:29.959 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T21:40:29.965 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T21:40:29.965 DEBUG:teuthology.orchestra.run.smithi001:> test '!' -e /home/ubuntu/cephtest 2024-09-15T21:40:29.968 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-09-15T21:40:29.975 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T21:40:29.981 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T21:40:29.981 DEBUG:teuthology.orchestra.run.smithi001:> test -z $(ls -A /var/lib/ceph) 2024-09-15T21:40:30.014 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-09-15T21:40:30.114 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T21:40:30.170 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T21:40:30.185 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-15T21:40:30.185 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-15T21:40:30.186 DEBUG:teuthology.orchestra.run.smithi001:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T21:40:30.186 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T21:40:30.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:40:30.191 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-15T21:40:30.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:40:30.192 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-15T21:40:30.240 INFO:teuthology.orchestra.run.smithi001.stdout:5.15.0-56-generic 2024-09-15T21:40:30.241 INFO:teuthology.task.kernel:Running kernel on smithi001: 5.15.0-56-generic 2024-09-15T21:40:30.241 DEBUG:teuthology.orchestra.run.smithi001:> sudo apt-get clean 2024-09-15T21:40:30.242 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-56-generic 2024-09-15T21:40:30.242 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.15.0-56-generic 2024-09-15T21:40:30.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-09-15T21:40:30.341 DEBUG:teuthology.orchestra.run.smithi001:> sudo apt-get update 2024-09-15T21:40:30.363 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-15T21:40:30.507 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T21:40:30.509 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-15T21:40:30.509 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-15T21:40:30.510 INFO:teuthology.orchestra.run.smithi001.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-15T21:40:30.583 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-15T21:40:30.600 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T21:40:30.682 INFO:teuthology.orchestra.run.smithi001.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-15T21:40:30.729 INFO:teuthology.orchestra.run.smithi001.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-15T21:40:30.732 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-15T21:40:30.804 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-15T21:40:30.804 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-15T21:40:30.832 INFO:teuthology.orchestra.run.smithi001.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-15T21:40:30.836 INFO:teuthology.orchestra.run.smithi001.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-15T21:40:30.839 INFO:teuthology.orchestra.run.smithi001.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-15T21:40:30.839 INFO:teuthology.orchestra.run.smithi001.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-15T21:40:30.839 INFO:teuthology.orchestra.run.smithi001.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-15T21:40:30.842 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-15T21:40:30.845 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-15T21:40:30.858 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-15T21:40:30.859 INFO:teuthology.orchestra.run.smithi001.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-15T21:40:30.863 INFO:teuthology.orchestra.run.smithi001.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-15T21:40:30.863 INFO:teuthology.orchestra.run.smithi001.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-15T21:40:30.868 INFO:teuthology.orchestra.run.smithi001.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-15T21:40:30.874 INFO:teuthology.orchestra.run.smithi001.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-15T21:40:30.875 INFO:teuthology.orchestra.run.smithi001.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-15T21:40:30.880 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-15T21:40:30.881 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-15T21:40:30.884 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-15T21:40:30.884 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-15T21:40:30.887 INFO:teuthology.orchestra.run.smithi001.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-15T21:40:30.887 INFO:teuthology.orchestra.run.smithi001.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-15T21:40:30.887 INFO:teuthology.orchestra.run.smithi001.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-15T21:40:30.891 INFO:teuthology.orchestra.run.smithi001.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-15T21:40:30.891 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-15T21:40:30.891 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-15T21:40:30.897 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-15T21:40:30.898 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-15T21:40:30.899 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-15T21:40:30.900 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-15T21:40:30.900 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-15T21:40:30.902 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-15T21:40:30.903 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-15T21:40:30.903 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-15T21:40:30.919 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-15T21:40:30.922 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-15T21:40:30.922 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-15T21:40:30.927 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-15T21:40:30.935 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-15T21:40:30.937 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-15T21:40:30.937 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-15T21:40:30.938 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-15T21:40:30.938 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-15T21:40:30.953 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-15T21:40:30.953 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-15T21:40:30.953 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-15T21:40:30.954 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-15T21:40:30.962 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-15T21:40:30.963 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-15T21:40:30.970 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-15T21:40:30.970 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-15T21:40:30.970 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-15T21:40:30.970 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-15T21:40:30.971 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-15T21:40:31.038 INFO:teuthology.orchestra.run.smithi001.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-15T21:40:31.176 INFO:teuthology.orchestra.run.smithi001.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-15T21:40:31.494 INFO:teuthology.orchestra.run.smithi001.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-15T21:40:31.530 INFO:teuthology.orchestra.run.smithi001.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-15T21:40:31.544 INFO:teuthology.orchestra.run.smithi001.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-15T21:40:31.545 INFO:teuthology.orchestra.run.smithi001.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-15T21:40:31.546 INFO:teuthology.orchestra.run.smithi001.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-15T21:40:31.615 INFO:teuthology.orchestra.run.smithi001.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-15T21:40:31.631 INFO:teuthology.orchestra.run.smithi001.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-15T21:40:31.632 INFO:teuthology.orchestra.run.smithi001.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-15T21:40:31.664 INFO:teuthology.orchestra.run.smithi001.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-15T21:40:31.682 INFO:teuthology.orchestra.run.smithi001.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-15T21:40:31.688 INFO:teuthology.orchestra.run.smithi001.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-15T21:40:31.689 INFO:teuthology.orchestra.run.smithi001.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-15T21:40:31.690 INFO:teuthology.orchestra.run.smithi001.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-15T21:40:31.691 INFO:teuthology.orchestra.run.smithi001.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-15T21:40:31.742 INFO:teuthology.orchestra.run.smithi001.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-15T21:40:31.742 INFO:teuthology.orchestra.run.smithi001.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-15T21:40:31.743 INFO:teuthology.orchestra.run.smithi001.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-15T21:40:31.773 INFO:teuthology.orchestra.run.smithi001.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-15T21:40:31.774 INFO:teuthology.orchestra.run.smithi001.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-15T21:40:31.774 INFO:teuthology.orchestra.run.smithi001.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-15T21:40:31.775 INFO:teuthology.orchestra.run.smithi001.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-15T21:40:31.775 INFO:teuthology.orchestra.run.smithi001.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-15T21:40:31.823 INFO:teuthology.orchestra.run.smithi001.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-15T21:40:37.315 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 16.0 MB in 2s (7,640 kB/s) 2024-09-15T21:40:37.607 INFO:teuthology.orchestra.run.smithi001.stdout:Fetched 16.0 MB in 2s (7,082 kB/s) 2024-09-15T21:40:38.692 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-15T21:40:38.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T21:40:38.774 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-15T21:40:38.993 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-15T21:40:38.993 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-15T21:40:39.140 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-15T21:40:39.159 DEBUG:teuthology.orchestra.run.smithi001:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T21:40:39.169 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T21:40:39.169 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T21:40:39.169 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T21:40:39.170 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T21:40:39.170 INFO:teuthology.orchestra.run.smithi070.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-15T21:40:39.170 INFO:teuthology.orchestra.run.smithi070.stdout: python2.7-minimal 2024-09-15T21:40:39.170 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T21:40:39.171 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-15T21:40:39.172 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T21:40:39.172 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-15T21:40:39.172 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-15T21:40:39.173 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-15T21:40:39.174 INFO:teuthology.orchestra.run.smithi070.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-15T21:40:39.174 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-09-15T21:40:39.174 INFO:teuthology.orchestra.run.smithi070.stdout: thermald 2024-09-15T21:40:39.226 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-15T21:40:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T21:40:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-15T21:40:39.227 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-15T21:40:39.227 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-15T21:40:39.228 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages will be upgraded: 2024-09-15T21:40:39.229 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-15T21:40:39.281 INFO:teuthology.orchestra.run.smithi070.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T21:40:39.281 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 113 MB of archives. 2024-09-15T21:40:39.281 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-15T21:40:39.281 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-15T21:40:39.441 INFO:teuthology.orchestra.run.smithi001.stdout:Building dependency tree... 2024-09-15T21:40:39.441 INFO:teuthology.orchestra.run.smithi001.stdout:Reading state information... 2024-09-15T21:40:39.635 INFO:teuthology.orchestra.run.smithi001.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T21:40:39.635 INFO:teuthology.orchestra.run.smithi001.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T21:40:39.635 INFO:teuthology.orchestra.run.smithi001.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T21:40:39.636 INFO:teuthology.orchestra.run.smithi001.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T21:40:39.636 INFO:teuthology.orchestra.run.smithi001.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-15T21:40:39.636 INFO:teuthology.orchestra.run.smithi001.stdout: python2.7-minimal 2024-09-15T21:40:39.636 INFO:teuthology.orchestra.run.smithi001.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T21:40:39.637 INFO:teuthology.orchestra.run.smithi001.stdout:The following additional packages will be installed: 2024-09-15T21:40:39.637 INFO:teuthology.orchestra.run.smithi001.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T21:40:39.637 INFO:teuthology.orchestra.run.smithi001.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-15T21:40:39.638 INFO:teuthology.orchestra.run.smithi001.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-15T21:40:39.639 INFO:teuthology.orchestra.run.smithi001.stdout:Suggested packages: 2024-09-15T21:40:39.639 INFO:teuthology.orchestra.run.smithi001.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-15T21:40:39.639 INFO:teuthology.orchestra.run.smithi001.stdout:Recommended packages: 2024-09-15T21:40:39.639 INFO:teuthology.orchestra.run.smithi001.stdout: thermald 2024-09-15T21:40:39.692 INFO:teuthology.orchestra.run.smithi001.stdout:The following NEW packages will be installed: 2024-09-15T21:40:39.692 INFO:teuthology.orchestra.run.smithi001.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T21:40:39.692 INFO:teuthology.orchestra.run.smithi001.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-15T21:40:39.692 INFO:teuthology.orchestra.run.smithi001.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-15T21:40:39.694 INFO:teuthology.orchestra.run.smithi001.stdout:The following packages will be upgraded: 2024-09-15T21:40:39.694 INFO:teuthology.orchestra.run.smithi001.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-15T21:40:39.730 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-15T21:40:39.836 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-15T21:40:39.876 INFO:teuthology.orchestra.run.smithi001.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T21:40:39.876 INFO:teuthology.orchestra.run.smithi001.stdout:Need to get 113 MB of archives. 2024-09-15T21:40:39.876 INFO:teuthology.orchestra.run.smithi001.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-15T21:40:39.876 INFO:teuthology.orchestra.run.smithi001.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-15T21:40:40.651 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-15T21:40:40.651 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-15T21:40:40.651 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-15T21:40:40.774 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-15T21:40:40.796 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-15T21:40:41.172 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 113 MB in 2s (72.6 MB/s) 2024-09-15T21:40:41.336 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-15T21:40:43.281 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-15T21:40:43.285 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T21:40:43.351 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:40:43.367 INFO:teuthology.orchestra.run.smithi001.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-15T21:40:43.724 INFO:teuthology.orchestra.run.smithi001.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-15T21:40:45.720 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-15T21:40:45.736 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T21:40:45.831 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:40:45.926 INFO:teuthology.orchestra.run.smithi001.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-15T21:40:45.926 INFO:teuthology.orchestra.run.smithi001.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-15T21:40:45.927 INFO:teuthology.orchestra.run.smithi001.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-15T21:40:46.240 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-15T21:40:46.261 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T21:40:46.306 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:40:46.354 INFO:teuthology.orchestra.run.smithi001.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-15T21:40:46.409 INFO:teuthology.orchestra.run.smithi001.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-15T21:40:46.851 INFO:teuthology.orchestra.run.smithi001.stdout:Fetched 113 MB in 7s (16.9 MB/s) 2024-09-15T21:40:47.030 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-15T21:40:48.959 INFO:teuthology.orchestra.run.smithi001.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-15T21:40:48.963 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T21:40:49.060 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:40:51.420 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-15T21:40:51.442 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T21:40:51.539 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:40:51.981 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-15T21:40:52.002 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T21:40:52.031 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:40:52.287 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T21:40:52.411 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T21:40:52.677 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T21:40:52.823 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T21:40:53.110 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-15T21:40:53.125 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-15T21:40:53.168 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T21:40:58.806 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-15T21:40:58.842 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T21:40:58.881 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:40:59.231 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T21:40:59.332 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T21:40:59.674 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T21:40:59.778 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T21:41:00.114 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-15T21:41:00.137 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-15T21:41:00.180 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T21:41:01.613 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T21:41:01.735 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T21:41:02.052 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T21:41:02.157 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:41:02.283 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-15T21:41:02.411 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:41:03.738 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-15T21:41:03.739 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-15T21:41:03.739 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-15T21:41:03.739 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-15T21:41:03.914 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:41:05.282 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:41:07.238 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-15T21:41:07.275 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T21:41:07.284 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-15T21:41:07.312 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:41:07.410 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-15T21:41:07.536 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:41:07.602 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-15T21:41:07.602 INFO:teuthology.orchestra.run.smithi070.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-15T21:41:10.109 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T21:41:10.231 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T21:41:10.615 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T21:41:10.736 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:41:10.879 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-15T21:41:11.007 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:41:12.438 INFO:teuthology.orchestra.run.smithi001.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-15T21:41:12.439 INFO:teuthology.orchestra.run.smithi001.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-15T21:41:12.439 INFO:teuthology.orchestra.run.smithi001.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-15T21:41:12.439 INFO:teuthology.orchestra.run.smithi001.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-15T21:41:13.260 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:41:14.694 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:41:16.121 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-15T21:41:16.246 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-15T21:41:16.373 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T21:41:16.447 INFO:teuthology.orchestra.run.smithi001.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-15T21:41:16.447 INFO:teuthology.orchestra.run.smithi001.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-15T21:41:22.139 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-15T21:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub' 2024-09-15T21:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T21:41:22.187 INFO:teuthology.orchestra.run.smithi070.stdout:Generating grub configuration file ... 2024-09-15T21:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T21:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T21:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T21:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T21:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T21:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T21:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T21:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T21:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T21:41:23.068 INFO:teuthology.orchestra.run.smithi070.stdout:done 2024-09-15T21:41:23.582 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-09-15T21:41:23.598 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-09-15T21:41:23.598 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-09-15T21:41:23.598 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-09-15T21:41:23.598 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-09-15T21:41:23.598 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-09-15T21:41:23.598 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T21:41:23.599 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-09-15T21:41:23.599 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-09-15T21:41:23.599 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.121.121 2024-09-15T21:41:23.599 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T21:41:23.599 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T21:41:23.599 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-09-15T21:41:23.599 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-09-15T21:41:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-09-15T21:41:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-09-15T21:41:23.599 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-15T21:41:23.599 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T21:41:23.600 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T21:41:23.600 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-15T21:41:23.600 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T21:41:23.600 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-09-15T21:41:23.745 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-15T21:41:23.872 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T21:41:23.873 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T21:41:23.881 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T21:41:23.897 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T21:41:25.345 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-15T21:41:25.362 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T21:41:25.415 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-15T21:41:25.600 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-15T21:41:25.601 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-15T21:41:25.768 INFO:teuthology.orchestra.run.smithi070.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-15T21:41:25.768 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T21:41:25.768 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T21:41:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T21:41:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T21:41:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T21:41:25.769 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T21:41:25.769 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T21:41:25.807 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T21:41:25.809 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-09-15T21:41:25.863 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-09-15T21:41:25.863 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-09-15T21:41:25.863 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-09-15T21:41:25.863 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-09-15T21:41:25.863 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-09-15T21:41:25.863 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T21:41:25.863 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-09-15T21:41:25.863 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-09-15T21:41:25.863 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.121.121 2024-09-15T21:41:25.863 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T21:41:25.864 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T21:41:25.864 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-09-15T21:41:25.864 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-09-15T21:41:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-09-15T21:41:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-09-15T21:41:25.864 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-15T21:41:25.911 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.u38cur6L4x 2024-09-15T21:41:25.912 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub/grub.cfg /tmp/tmp.u38cur6L4x 2024-09-15T21:41:25.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.u38cur6L4x 2024-09-15T21:41:26.087 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.u38cur6L4x is 10KB 2024-09-15T21:41:26.145 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.u38cur6L4x 2024-09-15T21:41:26.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-15T21:41:26.203 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:41:26.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-15T21:41:26.203 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-15T21:41:26.273 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-15T21:41:26.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo update-grub 2024-09-15T21:41:27.399 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub' 2024-09-15T21:41:27.400 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T21:41:27.403 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-09-15T21:41:27.616 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T21:41:27.622 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T21:41:27.841 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T21:41:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T21:41:27.886 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T21:41:27.891 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T21:41:28.014 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T21:41:28.014 INFO:teuthology.orchestra.run.smithi070.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T21:41:28.014 INFO:teuthology.orchestra.run.smithi070.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T21:41:28.037 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-09-15T21:41:28.046 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-09-15T21:41:31.427 INFO:teuthology.orchestra.run.smithi001.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-15T21:41:31.427 INFO:teuthology.orchestra.run.smithi001.stdout:Sourcing file `/etc/default/grub' 2024-09-15T21:41:31.447 INFO:teuthology.orchestra.run.smithi001.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T21:41:31.465 INFO:teuthology.orchestra.run.smithi001.stdout:Generating grub configuration file ... 2024-09-15T21:41:31.840 INFO:teuthology.orchestra.run.smithi001.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T21:41:31.862 INFO:teuthology.orchestra.run.smithi001.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T21:41:32.190 INFO:teuthology.orchestra.run.smithi001.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T21:41:32.195 INFO:teuthology.orchestra.run.smithi001.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T21:41:32.262 INFO:teuthology.orchestra.run.smithi001.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T21:41:32.268 INFO:teuthology.orchestra.run.smithi001.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T21:41:32.421 INFO:teuthology.orchestra.run.smithi001.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T21:41:32.421 INFO:teuthology.orchestra.run.smithi001.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T21:41:32.422 INFO:teuthology.orchestra.run.smithi001.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T21:41:32.462 INFO:teuthology.orchestra.run.smithi001.stdout:done 2024-09-15T21:41:32.977 DEBUG:teuthology.orchestra.run.smithi001:> dpkg -s linux-image-generic 2024-09-15T21:41:32.996 INFO:teuthology.orchestra.run.smithi001.stdout:Package: linux-image-generic 2024-09-15T21:41:32.996 INFO:teuthology.orchestra.run.smithi001.stdout:Status: install ok installed 2024-09-15T21:41:32.996 INFO:teuthology.orchestra.run.smithi001.stdout:Priority: optional 2024-09-15T21:41:32.996 INFO:teuthology.orchestra.run.smithi001.stdout:Section: kernel 2024-09-15T21:41:32.996 INFO:teuthology.orchestra.run.smithi001.stdout:Installed-Size: 21 2024-09-15T21:41:32.996 INFO:teuthology.orchestra.run.smithi001.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T21:41:32.997 INFO:teuthology.orchestra.run.smithi001.stdout:Architecture: amd64 2024-09-15T21:41:32.997 INFO:teuthology.orchestra.run.smithi001.stdout:Source: linux-meta 2024-09-15T21:41:32.997 INFO:teuthology.orchestra.run.smithi001.stdout:Version: 5.15.0.121.121 2024-09-15T21:41:32.997 INFO:teuthology.orchestra.run.smithi001.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T21:41:32.997 INFO:teuthology.orchestra.run.smithi001.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T21:41:32.997 INFO:teuthology.orchestra.run.smithi001.stdout:Recommends: thermald 2024-09-15T21:41:32.997 INFO:teuthology.orchestra.run.smithi001.stdout:Description: Generic Linux kernel image 2024-09-15T21:41:32.997 INFO:teuthology.orchestra.run.smithi001.stdout: This package will always depend on the latest generic kernel image 2024-09-15T21:41:32.997 INFO:teuthology.orchestra.run.smithi001.stdout: available. 2024-09-15T21:41:32.998 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-15T21:41:32.998 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T21:41:32.998 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T21:41:32.998 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-15T21:41:32.998 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi001.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T21:41:32.998 DEBUG:teuthology.orchestra.run.smithi001:> sudo apt-get clean 2024-09-15T21:41:33.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo apt-get update 2024-09-15T21:41:33.338 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T21:41:33.348 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T21:41:33.351 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T21:41:33.364 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T21:41:34.798 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-15T21:41:34.818 DEBUG:teuthology.orchestra.run.smithi001:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T21:41:34.874 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-15T21:41:35.064 INFO:teuthology.orchestra.run.smithi001.stdout:Building dependency tree... 2024-09-15T21:41:35.065 INFO:teuthology.orchestra.run.smithi001.stdout:Reading state information... 2024-09-15T21:41:35.239 INFO:teuthology.orchestra.run.smithi001.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-15T21:41:35.239 INFO:teuthology.orchestra.run.smithi001.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T21:41:35.239 INFO:teuthology.orchestra.run.smithi001.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T21:41:35.239 INFO:teuthology.orchestra.run.smithi001.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T21:41:35.240 INFO:teuthology.orchestra.run.smithi001.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T21:41:35.240 INFO:teuthology.orchestra.run.smithi001.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T21:41:35.240 INFO:teuthology.orchestra.run.smithi001.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T21:41:35.240 INFO:teuthology.orchestra.run.smithi001.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T21:41:35.281 INFO:teuthology.orchestra.run.smithi001.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T21:41:35.283 DEBUG:teuthology.orchestra.run.smithi001:> dpkg -s linux-image-generic 2024-09-15T21:41:35.299 INFO:teuthology.orchestra.run.smithi001.stdout:Package: linux-image-generic 2024-09-15T21:41:35.299 INFO:teuthology.orchestra.run.smithi001.stdout:Status: install ok installed 2024-09-15T21:41:35.299 INFO:teuthology.orchestra.run.smithi001.stdout:Priority: optional 2024-09-15T21:41:35.299 INFO:teuthology.orchestra.run.smithi001.stdout:Section: kernel 2024-09-15T21:41:35.299 INFO:teuthology.orchestra.run.smithi001.stdout:Installed-Size: 21 2024-09-15T21:41:35.299 INFO:teuthology.orchestra.run.smithi001.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T21:41:35.299 INFO:teuthology.orchestra.run.smithi001.stdout:Architecture: amd64 2024-09-15T21:41:35.299 INFO:teuthology.orchestra.run.smithi001.stdout:Source: linux-meta 2024-09-15T21:41:35.299 INFO:teuthology.orchestra.run.smithi001.stdout:Version: 5.15.0.121.121 2024-09-15T21:41:35.299 INFO:teuthology.orchestra.run.smithi001.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T21:41:35.299 INFO:teuthology.orchestra.run.smithi001.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T21:41:35.300 INFO:teuthology.orchestra.run.smithi001.stdout:Recommends: thermald 2024-09-15T21:41:35.300 INFO:teuthology.orchestra.run.smithi001.stdout:Description: Generic Linux kernel image 2024-09-15T21:41:35.300 INFO:teuthology.orchestra.run.smithi001.stdout: This package will always depend on the latest generic kernel image 2024-09-15T21:41:35.300 INFO:teuthology.orchestra.run.smithi001.stdout: available. 2024-09-15T21:41:35.300 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-09-15T21:41:35.347 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.MpSeWaxFOJ 2024-09-15T21:41:35.347 DEBUG:teuthology.orchestra.run.smithi001:> sudo cp /boot/grub/grub.cfg /tmp/tmp.MpSeWaxFOJ 2024-09-15T21:41:35.403 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.MpSeWaxFOJ 2024-09-15T21:41:35.520 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.MpSeWaxFOJ is 10KB 2024-09-15T21:41:35.533 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.MpSeWaxFOJ 2024-09-15T21:41:35.538 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-15T21:41:35.591 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:41:35.591 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-15T21:41:35.591 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-15T21:41:35.661 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-15T21:41:35.661 DEBUG:teuthology.orchestra.run.smithi001:> sudo update-grub 2024-09-15T21:41:36.970 INFO:teuthology.orchestra.run.smithi001.stderr:Sourcing file `/etc/default/grub' 2024-09-15T21:41:36.971 INFO:teuthology.orchestra.run.smithi001.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T21:41:36.973 INFO:teuthology.orchestra.run.smithi001.stderr:Generating grub configuration file ... 2024-09-15T21:41:37.153 INFO:teuthology.orchestra.run.smithi001.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T21:41:37.160 INFO:teuthology.orchestra.run.smithi001.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T21:41:37.423 INFO:teuthology.orchestra.run.smithi001.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T21:41:37.428 INFO:teuthology.orchestra.run.smithi001.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T21:41:37.470 INFO:teuthology.orchestra.run.smithi001.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T21:41:37.475 INFO:teuthology.orchestra.run.smithi001.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T21:41:37.602 INFO:teuthology.orchestra.run.smithi001.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T21:41:37.602 INFO:teuthology.orchestra.run.smithi001.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T21:41:37.602 INFO:teuthology.orchestra.run.smithi001.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T21:41:37.617 INFO:teuthology.orchestra.run.smithi001.stderr:done 2024-09-15T21:41:37.619 DEBUG:teuthology.orchestra.run.smithi001:> sudo shutdown -r now 2024-09-15T21:41:58.067 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-15T21:41:58.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-15T21:41:58.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:42:07.632 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-15T21:42:07.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-15T21:42:07.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:42:16.637 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-15T21:42:25.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-15T21:42:25.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:42:26.113 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-09-15T21:42:28.701 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-15T21:42:35.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-15T21:42:35.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:42:40.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-15T21:42:40.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:42:43.777 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-15T21:42:58.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-15T21:42:58.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:43:01.853 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-15T21:43:19.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-15T21:43:19.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:43:20.183 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-15T21:43:20.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-15T21:43:20.688 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-15T21:43:20.688 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-15T21:43:20.737 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-121-generic 2024-09-15T21:43:20.737 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-15T21:43:20.737 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T21:43:20.738 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-15T21:43:21.739 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-15T21:43:21.740 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T21:43:21.810 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-09-15T21:43:21.838 DEBUG:teuthology.parallel:result is None 2024-09-15T21:43:35.120 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T21:43:47.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-15T21:43:47.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:43:47.352 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-15T21:43:47.969 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-15T21:43:47.969 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-15T21:43:47.969 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-15T21:43:48.016 INFO:teuthology.orchestra.run.smithi001.stdout:5.15.0-121-generic 2024-09-15T21:43:48.017 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-15T21:43:48.017 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T21:43:48.017 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-15T21:43:49.017 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-15T21:43:49.018 DEBUG:teuthology.orchestra.run.smithi001:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T21:43:49.077 INFO:teuthology.orchestra.run.smithi001.stdout:ttyS1 2024-09-15T21:43:49.103 DEBUG:teuthology.parallel:result is None 2024-09-15T21:43:49.103 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T21:43:49.111 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T21:43:49.111 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T21:43:49.114 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T21:43:49.119 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T21:43:49.128 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T21:43:49.138 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T21:43:49.138 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T21:43:49.161 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T21:43:49.188 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T21:43:49.195 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T21:43:49.195 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T21:43:49.217 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T21:43:49.238 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:43:49.247 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:43:49.292 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:43:49.302 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:43:49.303 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T21:43:49.310 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T21:43:49.310 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T21:43:49.313 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T21:43:49.325 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T21:43:49.334 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T21:43:49.334 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T21:43:49.369 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T21:43:49.375 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:43:49.421 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:43:49.469 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:43:49.469 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T21:43:49.529 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:43:49.535 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:43:49.584 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:43:49.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T21:43:49.646 DEBUG:teuthology.orchestra.run.smithi001:> sudo service rsyslog restart 2024-09-15T21:43:49.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-09-15T21:43:49.714 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T21:43:49.721 INFO:teuthology.task.internal:Starting timer... 2024-09-15T21:43:49.721 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T21:43:49.731 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T21:43:49.739 DEBUG:teuthology.task.selinux:Excluding smithi001: OS 'ubuntu' does not support SELinux 2024-09-15T21:43:49.739 DEBUG:teuthology.task.selinux:Excluding smithi070: OS 'ubuntu' does not support SELinux 2024-09-15T21:43:49.739 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T21:43:49.739 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-15T21:43:49.739 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T21:43:49.739 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T21:43:49.747 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-15T21:43:49.750 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-15T21:43:49.866 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T21:43:49.877 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T21:43:49.878 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi001.front.sepia.ceph.com,smithi070.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T21:51:30.160 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi001.front.sepia.ceph.com'), Remote(name='ubuntu@smithi070.front.sepia.ceph.com')] 2024-09-15T21:51:30.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-15T21:51:30.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:51:30.249 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-15T21:51:30.329 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-15T21:51:30.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-15T21:51:30.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:51:30.410 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-15T21:51:30.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-15T21:51:30.489 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T21:51:30.504 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T21:51:30.504 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T21:51:30.505 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T21:51:30.507 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T21:51:30.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T21:51:30.538 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-15T21:51:30.538 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: Command line: ntpd -gq 2024-09-15T21:51:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: ---------------------------------------------------- 2024-09-15T21:51:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: ntp-4 is maintained by Network Time Foundation, 2024-09-15T21:51:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-15T21:51:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: corporation. Support and training for ntp-4 are 2024-09-15T21:51:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: available at https://www.nwtime.org/support 2024-09-15T21:51:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: ---------------------------------------------------- 2024-09-15T21:51:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: proto: precision = 0.067 usec (-24) 2024-09-15T21:51:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: basedate set to 2022-02-04 2024-09-15T21:51:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: gps base set to 2022-02-06 (week 2196) 2024-09-15T21:51:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T21:51:30.540 INFO:teuthology.orchestra.run.smithi001.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T21:51:30.540 INFO:teuthology.orchestra.run.smithi001.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-15T21:51:30.541 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: restrict ::: KOD does nothing without LIMITED. 2024-09-15T21:51:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: Listen and drop on 0 v6wildcard [::]:123 2024-09-15T21:51:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-15T21:51:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: Listen normally on 2 lo 127.0.0.1:123 2024-09-15T21:51:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: Listen normally on 3 ens1f0 172.21.15.1:123 2024-09-15T21:51:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: Listen normally on 4 lo [::1]:123 2024-09-15T21:51:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15e8%4]:123 2024-09-15T21:51:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:30 ntpd[18368]: Listening on routing socket on fd #22 for interface updates 2024-09-15T21:51:30.567 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-15T21:51:30.567 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: Command line: ntpd -gq 2024-09-15T21:51:30.567 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: ---------------------------------------------------- 2024-09-15T21:51:30.567 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: ntp-4 is maintained by Network Time Foundation, 2024-09-15T21:51:30.567 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-15T21:51:30.567 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: corporation. Support and training for ntp-4 are 2024-09-15T21:51:30.567 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: available at https://www.nwtime.org/support 2024-09-15T21:51:30.567 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: ---------------------------------------------------- 2024-09-15T21:51:30.568 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: proto: precision = 0.061 usec (-24) 2024-09-15T21:51:30.568 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: basedate set to 2022-02-04 2024-09-15T21:51:30.568 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: gps base set to 2022-02-06 (week 2196) 2024-09-15T21:51:30.568 INFO:teuthology.orchestra.run.smithi070.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T21:51:30.569 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T21:51:30.569 INFO:teuthology.orchestra.run.smithi070.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-15T21:51:30.570 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: restrict ::: KOD does nothing without LIMITED. 2024-09-15T21:51:30.570 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: Listen and drop on 0 v6wildcard [::]:123 2024-09-15T21:51:30.570 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-15T21:51:30.570 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: Listen normally on 2 lo 127.0.0.1:123 2024-09-15T21:51:30.570 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: Listen normally on 3 enp3s0f1 172.21.15.70:123 2024-09-15T21:51:30.570 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: Listen normally on 4 lo [::1]:123 2024-09-15T21:51:30.571 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3e7%5]:123 2024-09-15T21:51:30.571 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:30 ntpd[18465]: Listening on routing socket on fd #22 for interface updates 2024-09-15T21:51:31.539 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:31 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:31.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:31 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:31.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:31 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:31.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:31 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:31.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:31 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:31.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:31 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:31.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:31 ntpd[18368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:31.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:31 ntpd[18368]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:31 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:31 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:31 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:31 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:31 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:31 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:31 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:31 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:31 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:31 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:31 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:31.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:31 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:32.539 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:32 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:32 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:32 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:32 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:32 ntpd[18368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:32.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:32 ntpd[18368]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:32.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:32 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:32.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:32 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:32.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:32 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:32.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:32 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:32.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:32 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:32.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:32 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:33.539 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:33 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:33.539 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:33 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:33.539 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:33 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:33.539 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:33 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:33.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:33 ntpd[18368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:33.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:33 ntpd[18368]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:33.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:33.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:33.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:33.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:33.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:33.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:33 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:34.539 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:34 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:34.539 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:34 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:34.539 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:34 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:34.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:34 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:34.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:34 ntpd[18368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:34.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:34 ntpd[18368]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:34.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:34 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:34.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:34 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:34.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:34 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:34.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:34 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:34.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:34 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:34.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:34 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:35.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:35 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:35.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:35 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:35.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:35 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:35.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:35 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:35.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:35 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:35.541 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:35 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:35.541 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:35 ntpd[18368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:35.541 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:35 ntpd[18368]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:35.541 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:35 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:35.541 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:35 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:35.541 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:35 ntpd[18368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:35.541 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:35 ntpd[18368]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:35.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:35 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:35.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:35 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:35.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:35 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:35.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:35 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:35.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:35 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:35.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:35 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:35.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:35 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:35.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:35 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:35.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:35 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:35.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:35 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:35.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:35 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:35.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:35 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:36.539 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:36 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:36.539 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:36 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:36.539 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:36 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:36.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:36 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:36.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:36 ntpd[18368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:36.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:36 ntpd[18368]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:36.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:36 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:36.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:36 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:36.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:36 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:36.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:36 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:36.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:36 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:36.567 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:36 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:37.539 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:37 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:37.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:37 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:37.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:37 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:37.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:37 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:37.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:37 ntpd[18368]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:37.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:37 ntpd[18368]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:37.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:37 ntpd[18368]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:37.540 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:37 ntpd[18368]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:37.541 INFO:teuthology.orchestra.run.smithi001.stdout:15 Sep 21:51:37 ntpd[18368]: ntpd: time slew +0.001505 s 2024-09-15T21:51:37.541 INFO:teuthology.orchestra.run.smithi001.stdout:ntpd: time slew +0.001505s 2024-09-15T21:51:37.541 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:37 ntpd[18368]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-15T21:51:37.541 INFO:teuthology.orchestra.run.smithi001.stderr:15 Sep 21:51:37 ntpd[18368]: can't open /var/log/ntpstats/loopstats.20240915: Permission denied 2024-09-15T21:51:37.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:37 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:37.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:37 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:37.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:37 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:37.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:37 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:37.568 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:37 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T21:51:37.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:37 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T21:51:37.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:37 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T21:51:37.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:37 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T21:51:37.569 INFO:teuthology.orchestra.run.smithi070.stdout:15 Sep 21:51:37 ntpd[18465]: ntpd: time slew +0.000478 s 2024-09-15T21:51:37.569 INFO:teuthology.orchestra.run.smithi070.stdout:ntpd: time slew +0.000478s 2024-09-15T21:51:37.569 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:37 ntpd[18465]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-15T21:51:37.570 INFO:teuthology.orchestra.run.smithi070.stderr:15 Sep 21:51:37 ntpd[18465]: can't open /var/log/ntpstats/loopstats.20240915: Permission denied 2024-09-15T21:51:37.590 INFO:teuthology.orchestra.run.smithi001.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T21:51:37.590 INFO:teuthology.orchestra.run.smithi001.stdout:============================================================================== 2024-09-15T21:51:37.590 INFO:teuthology.orchestra.run.smithi001.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T21:51:37.590 INFO:teuthology.orchestra.run.smithi001.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T21:51:37.590 INFO:teuthology.orchestra.run.smithi001.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T21:51:37.590 INFO:teuthology.orchestra.run.smithi001.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T21:51:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T21:51:37.708 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-09-15T21:51:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T21:51:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T21:51:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T21:51:37.708 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T21:51:37.709 INFO:teuthology.run_tasks:Running task install... 2024-09-15T21:51:37.718 DEBUG:teuthology.task.install:project ceph 2024-09-15T21:51:37.718 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T21:51:37.718 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T21:51:37.718 INFO:teuthology.task.install:Using flavor: default 2024-09-15T21:51:37.725 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T21:51:37.725 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T21:51:37.726 DEBUG:teuthology.orchestra.run.smithi001:> sudo apt-key list | grep Ceph 2024-09-15T21:51:37.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-key list | grep Ceph 2024-09-15T21:51:37.789 INFO:teuthology.orchestra.run.smithi001.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-15T21:51:37.815 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-15T21:51:37.819 INFO:teuthology.orchestra.run.smithi001.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-15T21:51:37.819 INFO:teuthology.orchestra.run.smithi001.stdout:uid [ unknown] Ceph.com (release key) 2024-09-15T21:51:37.820 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-15T21:51:37.820 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-15T21:51:37.820 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T21:51:37.860 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-15T21:51:37.860 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph.com (release key) 2024-09-15T21:51:37.860 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-15T21:51:37.860 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-15T21:51:37.860 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T21:51:37.972 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-15T21:51:37.973 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T21:51:38.005 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-15T21:51:38.005 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T21:51:38.085 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:51:38.085 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-15T21:51:38.099 DEBUG:teuthology.orchestra.run.smithi001:> sudo apt-get update 2024-09-15T21:51:38.115 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:51:38.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-15T21:51:38.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-09-15T21:51:38.300 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T21:51:38.324 INFO:teuthology.orchestra.run.smithi001.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-15T21:51:38.346 INFO:teuthology.orchestra.run.smithi001.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-15T21:51:38.354 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-15T21:51:38.369 INFO:teuthology.orchestra.run.smithi001.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-15T21:51:38.374 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-15T21:51:38.395 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-15T21:51:38.401 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T21:51:38.401 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T21:51:38.401 INFO:teuthology.orchestra.run.smithi001.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-15T21:51:38.416 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-15T21:51:38.422 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T21:51:38.431 INFO:teuthology.orchestra.run.smithi001.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-15T21:51:38.443 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-15T21:51:38.472 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T21:51:38.501 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T21:51:38.553 INFO:teuthology.orchestra.run.smithi001.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T21:51:38.582 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T21:51:38.716 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 29.0 kB in 0s (71.4 kB/s) 2024-09-15T21:51:38.785 INFO:teuthology.orchestra.run.smithi001.stdout:Fetched 29.0 kB in 1s (57.6 kB/s) 2024-09-15T21:51:39.702 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-15T21:51:39.718 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy cephfs-shell=19.1.1-326-g8921c8ef-1jammy cephfs-top=19.1.1-326-g8921c8ef-1jammy cephfs-mirror=19.1.1-326-g8921c8ef-1jammy 2024-09-15T21:51:39.772 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-15T21:51:39.826 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-15T21:51:39.843 DEBUG:teuthology.orchestra.run.smithi001:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy cephfs-shell=19.1.1-326-g8921c8ef-1jammy cephfs-top=19.1.1-326-g8921c8ef-1jammy cephfs-mirror=19.1.1-326-g8921c8ef-1jammy 2024-09-15T21:51:39.908 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-15T21:51:39.957 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-15T21:51:39.958 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-15T21:51:40.121 INFO:teuthology.orchestra.run.smithi001.stdout:Building dependency tree... 2024-09-15T21:51:40.124 INFO:teuthology.orchestra.run.smithi001.stdout:Reading state information... 2024-09-15T21:51:40.141 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T21:51:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T21:51:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T21:51:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T21:51:40.141 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T21:51:40.142 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T21:51:40.142 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T21:51:40.142 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-15T21:51:40.142 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-15T21:51:40.142 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-15T21:51:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T21:51:40.143 INFO:teuthology.orchestra.run.smithi070.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-15T21:51:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-15T21:51:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-15T21:51:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-15T21:51:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-15T21:51:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-15T21:51:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-15T21:51:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-15T21:51:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-15T21:51:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-15T21:51:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-15T21:51:40.144 INFO:teuthology.orchestra.run.smithi070.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-15T21:51:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-15T21:51:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-15T21:51:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-15T21:51:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-15T21:51:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-15T21:51:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-15T21:51:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-15T21:51:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-15T21:51:40.145 INFO:teuthology.orchestra.run.smithi070.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-15T21:51:40.146 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-15T21:51:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-15T21:51:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-15T21:51:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-15T21:51:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-15T21:51:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-15T21:51:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-15T21:51:40.146 INFO:teuthology.orchestra.run.smithi070.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-15T21:51:40.146 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-09-15T21:51:40.147 INFO:teuthology.orchestra.run.smithi070.stdout: btrfs-tools 2024-09-15T21:51:40.253 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-15T21:51:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-15T21:51:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-15T21:51:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-15T21:51:40.253 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-15T21:51:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T21:51:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-15T21:51:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-15T21:51:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-15T21:51:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-15T21:51:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-15T21:51:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-15T21:51:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-15T21:51:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-15T21:51:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-15T21:51:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-15T21:51:40.255 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-15T21:51:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-15T21:51:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-15T21:51:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-15T21:51:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-15T21:51:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-15T21:51:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-15T21:51:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-15T21:51:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-15T21:51:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-15T21:51:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-15T21:51:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-15T21:51:40.256 INFO:teuthology.orchestra.run.smithi070.stdout: socat unzip xmlstarlet zip 2024-09-15T21:51:40.336 INFO:teuthology.orchestra.run.smithi001.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T21:51:40.336 INFO:teuthology.orchestra.run.smithi001.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T21:51:40.336 INFO:teuthology.orchestra.run.smithi001.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T21:51:40.336 INFO:teuthology.orchestra.run.smithi001.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T21:51:40.337 INFO:teuthology.orchestra.run.smithi001.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T21:51:40.337 INFO:teuthology.orchestra.run.smithi001.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T21:51:40.337 INFO:teuthology.orchestra.run.smithi001.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T21:51:40.338 INFO:teuthology.orchestra.run.smithi001.stdout:The following additional packages will be installed: 2024-09-15T21:51:40.338 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-15T21:51:40.338 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-15T21:51:40.338 INFO:teuthology.orchestra.run.smithi001.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T21:51:40.338 INFO:teuthology.orchestra.run.smithi001.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-15T21:51:40.340 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-15T21:51:40.340 INFO:teuthology.orchestra.run.smithi001.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-15T21:51:40.340 INFO:teuthology.orchestra.run.smithi001.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-15T21:51:40.340 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-15T21:51:40.340 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-15T21:51:40.340 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-15T21:51:40.340 INFO:teuthology.orchestra.run.smithi001.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-15T21:51:40.340 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-15T21:51:40.340 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-15T21:51:40.340 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-15T21:51:40.340 INFO:teuthology.orchestra.run.smithi001.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-15T21:51:40.341 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-15T21:51:40.341 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-15T21:51:40.341 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-15T21:51:40.341 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-15T21:51:40.341 INFO:teuthology.orchestra.run.smithi001.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-15T21:51:40.341 INFO:teuthology.orchestra.run.smithi001.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-15T21:51:40.341 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-15T21:51:40.341 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-15T21:51:40.341 INFO:teuthology.orchestra.run.smithi001.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-15T21:51:40.342 INFO:teuthology.orchestra.run.smithi001.stdout:Suggested packages: 2024-09-15T21:51:40.342 INFO:teuthology.orchestra.run.smithi001.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-15T21:51:40.342 INFO:teuthology.orchestra.run.smithi001.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-15T21:51:40.342 INFO:teuthology.orchestra.run.smithi001.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-15T21:51:40.342 INFO:teuthology.orchestra.run.smithi001.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-15T21:51:40.342 INFO:teuthology.orchestra.run.smithi001.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-15T21:51:40.342 INFO:teuthology.orchestra.run.smithi001.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-15T21:51:40.342 INFO:teuthology.orchestra.run.smithi001.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-15T21:51:40.342 INFO:teuthology.orchestra.run.smithi001.stdout:Recommended packages: 2024-09-15T21:51:40.342 INFO:teuthology.orchestra.run.smithi001.stdout: btrfs-tools 2024-09-15T21:51:40.399 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-15T21:51:40.399 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 181 MB of archives. 2024-09-15T21:51:40.399 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-15T21:51:40.399 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-15T21:51:40.445 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-15T21:51:40.457 INFO:teuthology.orchestra.run.smithi001.stdout:The following NEW packages will be installed: 2024-09-15T21:51:40.457 INFO:teuthology.orchestra.run.smithi001.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-15T21:51:40.457 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-15T21:51:40.457 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-15T21:51:40.457 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-15T21:51:40.459 INFO:teuthology.orchestra.run.smithi001.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T21:51:40.459 INFO:teuthology.orchestra.run.smithi001.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-15T21:51:40.459 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-15T21:51:40.459 INFO:teuthology.orchestra.run.smithi001.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-15T21:51:40.459 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-15T21:51:40.459 INFO:teuthology.orchestra.run.smithi001.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-15T21:51:40.459 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-15T21:51:40.459 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-15T21:51:40.459 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-15T21:51:40.459 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-15T21:51:40.459 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-15T21:51:40.459 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-15T21:51:40.460 INFO:teuthology.orchestra.run.smithi001.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-15T21:51:40.460 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-15T21:51:40.460 INFO:teuthology.orchestra.run.smithi001.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-15T21:51:40.460 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-15T21:51:40.460 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-15T21:51:40.460 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-15T21:51:40.460 INFO:teuthology.orchestra.run.smithi001.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-15T21:51:40.460 INFO:teuthology.orchestra.run.smithi001.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-15T21:51:40.460 INFO:teuthology.orchestra.run.smithi001.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-15T21:51:40.460 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-15T21:51:40.460 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-15T21:51:40.460 INFO:teuthology.orchestra.run.smithi001.stdout: socat unzip xmlstarlet zip 2024-09-15T21:51:40.519 INFO:teuthology.orchestra.run.smithi001.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-15T21:51:40.519 INFO:teuthology.orchestra.run.smithi001.stdout:Need to get 181 MB of archives. 2024-09-15T21:51:40.519 INFO:teuthology.orchestra.run.smithi001.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-15T21:51:40.519 INFO:teuthology.orchestra.run.smithi001.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-15T21:51:40.527 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-15T21:51:40.537 INFO:teuthology.orchestra.run.smithi001.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-15T21:51:40.546 INFO:teuthology.orchestra.run.smithi001.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-15T21:51:40.573 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-15T21:51:40.587 INFO:teuthology.orchestra.run.smithi001.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-15T21:51:40.602 INFO:teuthology.orchestra.run.smithi001.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-15T21:51:40.608 INFO:teuthology.orchestra.run.smithi001.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-15T21:51:40.611 INFO:teuthology.orchestra.run.smithi001.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-15T21:51:40.622 INFO:teuthology.orchestra.run.smithi001.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-15T21:51:40.670 INFO:teuthology.orchestra.run.smithi001.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-15T21:51:40.674 INFO:teuthology.orchestra.run.smithi001.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-15T21:51:40.686 INFO:teuthology.orchestra.run.smithi001.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-15T21:51:40.689 INFO:teuthology.orchestra.run.smithi001.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-15T21:51:40.690 INFO:teuthology.orchestra.run.smithi001.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-15T21:51:40.698 INFO:teuthology.orchestra.run.smithi001.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-15T21:51:40.701 INFO:teuthology.orchestra.run.smithi001.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-15T21:51:40.703 INFO:teuthology.orchestra.run.smithi001.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-15T21:51:40.704 INFO:teuthology.orchestra.run.smithi001.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-15T21:51:40.704 INFO:teuthology.orchestra.run.smithi001.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-15T21:51:40.708 INFO:teuthology.orchestra.run.smithi001.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-15T21:51:40.710 INFO:teuthology.orchestra.run.smithi001.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-15T21:51:40.711 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-15T21:51:40.724 INFO:teuthology.orchestra.run.smithi001.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-15T21:51:40.725 INFO:teuthology.orchestra.run.smithi001.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-15T21:51:40.725 INFO:teuthology.orchestra.run.smithi001.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-15T21:51:40.726 INFO:teuthology.orchestra.run.smithi001.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-15T21:51:40.726 INFO:teuthology.orchestra.run.smithi001.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-15T21:51:40.727 INFO:teuthology.orchestra.run.smithi001.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-15T21:51:40.727 INFO:teuthology.orchestra.run.smithi001.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-15T21:51:40.727 INFO:teuthology.orchestra.run.smithi001.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-15T21:51:40.742 INFO:teuthology.orchestra.run.smithi001.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-15T21:51:40.742 INFO:teuthology.orchestra.run.smithi001.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-15T21:51:40.759 INFO:teuthology.orchestra.run.smithi001.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-15T21:51:40.759 INFO:teuthology.orchestra.run.smithi001.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-15T21:51:40.759 INFO:teuthology.orchestra.run.smithi001.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-15T21:51:40.760 INFO:teuthology.orchestra.run.smithi001.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-15T21:51:40.761 INFO:teuthology.orchestra.run.smithi001.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-15T21:51:40.761 INFO:teuthology.orchestra.run.smithi001.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-15T21:51:40.761 INFO:teuthology.orchestra.run.smithi001.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-15T21:51:40.763 INFO:teuthology.orchestra.run.smithi001.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-15T21:51:40.769 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-15T21:51:40.776 INFO:teuthology.orchestra.run.smithi001.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-15T21:51:40.776 INFO:teuthology.orchestra.run.smithi001.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-15T21:51:40.793 INFO:teuthology.orchestra.run.smithi001.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-15T21:51:40.793 INFO:teuthology.orchestra.run.smithi001.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-15T21:51:40.793 INFO:teuthology.orchestra.run.smithi001.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-15T21:51:40.794 INFO:teuthology.orchestra.run.smithi001.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-15T21:51:40.795 INFO:teuthology.orchestra.run.smithi001.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-15T21:51:40.797 INFO:teuthology.orchestra.run.smithi001.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-15T21:51:40.798 INFO:teuthology.orchestra.run.smithi001.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-15T21:51:40.799 INFO:teuthology.orchestra.run.smithi001.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-15T21:51:40.809 INFO:teuthology.orchestra.run.smithi001.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-15T21:51:40.812 INFO:teuthology.orchestra.run.smithi001.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-15T21:51:40.827 INFO:teuthology.orchestra.run.smithi001.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-15T21:51:40.827 INFO:teuthology.orchestra.run.smithi001.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-15T21:51:40.829 INFO:teuthology.orchestra.run.smithi001.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-15T21:51:40.844 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-15T21:51:40.861 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-15T21:51:40.866 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-15T21:51:40.873 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-15T21:51:40.881 INFO:teuthology.orchestra.run.smithi001.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-15T21:51:40.882 INFO:teuthology.orchestra.run.smithi001.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-15T21:51:40.882 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-15T21:51:40.883 INFO:teuthology.orchestra.run.smithi001.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-15T21:51:40.883 INFO:teuthology.orchestra.run.smithi001.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-15T21:51:40.884 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-15T21:51:40.885 INFO:teuthology.orchestra.run.smithi001.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-15T21:51:40.887 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-15T21:51:40.889 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-15T21:51:40.900 INFO:teuthology.orchestra.run.smithi001.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-15T21:51:40.902 INFO:teuthology.orchestra.run.smithi001.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-15T21:51:40.903 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-15T21:51:40.904 INFO:teuthology.orchestra.run.smithi001.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-15T21:51:40.904 INFO:teuthology.orchestra.run.smithi001.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-15T21:51:40.919 INFO:teuthology.orchestra.run.smithi001.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-15T21:51:40.919 INFO:teuthology.orchestra.run.smithi001.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-15T21:51:40.920 INFO:teuthology.orchestra.run.smithi001.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-15T21:51:40.920 INFO:teuthology.orchestra.run.smithi001.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-15T21:51:40.920 INFO:teuthology.orchestra.run.smithi001.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-15T21:51:40.921 INFO:teuthology.orchestra.run.smithi001.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-15T21:51:40.923 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-15T21:51:40.935 INFO:teuthology.orchestra.run.smithi001.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-15T21:51:40.935 INFO:teuthology.orchestra.run.smithi001.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-15T21:51:40.938 INFO:teuthology.orchestra.run.smithi001.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-15T21:51:40.954 INFO:teuthology.orchestra.run.smithi001.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-15T21:51:40.954 INFO:teuthology.orchestra.run.smithi001.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-15T21:51:40.954 INFO:teuthology.orchestra.run.smithi001.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-15T21:51:40.957 INFO:teuthology.orchestra.run.smithi001.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-15T21:51:40.959 INFO:teuthology.orchestra.run.smithi001.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-15T21:51:40.959 INFO:teuthology.orchestra.run.smithi001.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-15T21:51:40.960 INFO:teuthology.orchestra.run.smithi001.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-15T21:51:40.969 INFO:teuthology.orchestra.run.smithi001.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-15T21:51:40.973 INFO:teuthology.orchestra.run.smithi001.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-15T21:51:40.973 INFO:teuthology.orchestra.run.smithi001.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-15T21:51:40.987 INFO:teuthology.orchestra.run.smithi001.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-15T21:51:40.987 INFO:teuthology.orchestra.run.smithi001.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-15T21:51:40.988 INFO:teuthology.orchestra.run.smithi001.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-15T21:51:40.988 INFO:teuthology.orchestra.run.smithi001.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-15T21:51:40.989 INFO:teuthology.orchestra.run.smithi001.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-15T21:51:40.989 INFO:teuthology.orchestra.run.smithi001.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-15T21:51:40.995 INFO:teuthology.orchestra.run.smithi001.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-15T21:51:41.003 INFO:teuthology.orchestra.run.smithi001.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-15T21:51:41.004 INFO:teuthology.orchestra.run.smithi001.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-15T21:51:41.005 INFO:teuthology.orchestra.run.smithi001.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-15T21:51:41.021 INFO:teuthology.orchestra.run.smithi001.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-15T21:51:41.034 INFO:teuthology.orchestra.run.smithi001.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-15T21:51:41.061 INFO:teuthology.orchestra.run.smithi001.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-15T21:51:41.078 INFO:teuthology.orchestra.run.smithi001.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-15T21:51:41.079 INFO:teuthology.orchestra.run.smithi001.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-15T21:51:41.084 INFO:teuthology.orchestra.run.smithi001.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-15T21:51:41.087 INFO:teuthology.orchestra.run.smithi001.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-15T21:51:41.092 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-15T21:51:41.095 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-15T21:51:41.097 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-15T21:51:41.104 INFO:teuthology.orchestra.run.smithi001.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-15T21:51:41.104 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-15T21:51:41.140 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-15T21:51:41.161 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-15T21:51:41.165 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-15T21:51:41.166 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-15T21:51:41.180 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-15T21:51:41.184 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-15T21:51:41.187 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-15T21:51:41.189 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-15T21:51:41.190 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-15T21:51:41.262 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-15T21:51:41.265 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-15T21:51:41.268 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-15T21:51:41.269 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-15T21:51:41.343 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-15T21:51:41.345 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-15T21:51:41.346 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-15T21:51:41.346 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-15T21:51:41.347 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-15T21:51:41.348 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-15T21:51:41.391 INFO:teuthology.orchestra.run.smithi001.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-15T21:51:41.396 INFO:teuthology.orchestra.run.smithi001.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-15T21:51:41.416 INFO:teuthology.orchestra.run.smithi001.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-15T21:51:41.425 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-15T21:51:41.425 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-15T21:51:41.431 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-15T21:51:41.432 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-15T21:51:41.506 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-15T21:51:41.507 INFO:teuthology.orchestra.run.smithi070.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-15T21:51:41.509 INFO:teuthology.orchestra.run.smithi070.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-15T21:51:41.509 INFO:teuthology.orchestra.run.smithi070.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-15T21:51:41.511 INFO:teuthology.orchestra.run.smithi070.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-15T21:51:41.513 INFO:teuthology.orchestra.run.smithi070.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-15T21:51:41.588 INFO:teuthology.orchestra.run.smithi070.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-15T21:51:41.588 INFO:teuthology.orchestra.run.smithi070.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-15T21:51:41.599 INFO:teuthology.orchestra.run.smithi070.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-15T21:51:41.600 INFO:teuthology.orchestra.run.smithi070.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-15T21:51:41.669 INFO:teuthology.orchestra.run.smithi070.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-15T21:51:41.670 INFO:teuthology.orchestra.run.smithi070.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-15T21:51:41.672 INFO:teuthology.orchestra.run.smithi070.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-15T21:51:41.677 INFO:teuthology.orchestra.run.smithi070.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-15T21:51:41.678 INFO:teuthology.orchestra.run.smithi070.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-15T21:51:41.681 INFO:teuthology.orchestra.run.smithi070.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-15T21:51:41.750 INFO:teuthology.orchestra.run.smithi070.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-15T21:51:41.755 INFO:teuthology.orchestra.run.smithi070.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-15T21:51:41.756 INFO:teuthology.orchestra.run.smithi070.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-15T21:51:41.758 INFO:teuthology.orchestra.run.smithi070.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-15T21:51:41.832 INFO:teuthology.orchestra.run.smithi070.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-15T21:51:41.870 INFO:teuthology.orchestra.run.smithi070.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-15T21:51:41.963 INFO:teuthology.orchestra.run.smithi070.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-15T21:51:41.967 INFO:teuthology.orchestra.run.smithi070.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-15T21:51:41.970 INFO:teuthology.orchestra.run.smithi070.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-15T21:51:41.997 INFO:teuthology.orchestra.run.smithi070.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-15T21:51:41.999 INFO:teuthology.orchestra.run.smithi070.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-15T21:51:42.002 INFO:teuthology.orchestra.run.smithi070.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-15T21:51:42.003 INFO:teuthology.orchestra.run.smithi070.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-15T21:51:42.005 INFO:teuthology.orchestra.run.smithi070.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-15T21:51:42.015 INFO:teuthology.orchestra.run.smithi070.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-15T21:51:42.044 INFO:teuthology.orchestra.run.smithi070.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-15T21:51:42.047 INFO:teuthology.orchestra.run.smithi070.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-15T21:51:42.047 INFO:teuthology.orchestra.run.smithi070.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-15T21:51:42.103 INFO:teuthology.orchestra.run.smithi070.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-15T21:51:42.103 INFO:teuthology.orchestra.run.smithi070.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-15T21:51:42.166 INFO:teuthology.orchestra.run.smithi070.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-15T21:51:42.167 INFO:teuthology.orchestra.run.smithi070.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-15T21:51:42.168 INFO:teuthology.orchestra.run.smithi070.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-15T21:51:42.169 INFO:teuthology.orchestra.run.smithi070.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-15T21:51:42.170 INFO:teuthology.orchestra.run.smithi070.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-15T21:51:42.171 INFO:teuthology.orchestra.run.smithi070.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-15T21:51:42.179 INFO:teuthology.orchestra.run.smithi070.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-15T21:51:42.188 INFO:teuthology.orchestra.run.smithi070.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-15T21:51:42.248 INFO:teuthology.orchestra.run.smithi070.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-15T21:51:42.251 INFO:teuthology.orchestra.run.smithi070.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-15T21:51:42.253 INFO:teuthology.orchestra.run.smithi070.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-15T21:51:42.329 INFO:teuthology.orchestra.run.smithi070.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-15T21:51:42.336 INFO:teuthology.orchestra.run.smithi070.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-15T21:51:42.337 INFO:teuthology.orchestra.run.smithi070.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-15T21:51:42.339 INFO:teuthology.orchestra.run.smithi070.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-15T21:51:42.340 INFO:teuthology.orchestra.run.smithi070.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-15T21:51:42.351 INFO:teuthology.orchestra.run.smithi070.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-15T21:51:42.352 INFO:teuthology.orchestra.run.smithi070.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-15T21:51:42.411 INFO:teuthology.orchestra.run.smithi070.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-15T21:51:42.411 INFO:teuthology.orchestra.run.smithi070.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-15T21:51:42.413 INFO:teuthology.orchestra.run.smithi070.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-15T21:51:42.492 INFO:teuthology.orchestra.run.smithi070.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-15T21:51:42.496 INFO:teuthology.orchestra.run.smithi070.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-15T21:51:42.501 INFO:teuthology.orchestra.run.smithi070.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-15T21:51:42.519 INFO:teuthology.orchestra.run.smithi070.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-15T21:51:42.520 INFO:teuthology.orchestra.run.smithi070.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-15T21:51:42.521 INFO:teuthology.orchestra.run.smithi070.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-15T21:51:42.526 INFO:teuthology.orchestra.run.smithi070.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-15T21:51:42.550 INFO:teuthology.orchestra.run.smithi001.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-15T21:51:42.573 INFO:teuthology.orchestra.run.smithi070.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-15T21:51:42.710 INFO:teuthology.orchestra.run.smithi001.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-15T21:51:42.716 INFO:teuthology.orchestra.run.smithi001.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-15T21:51:42.719 INFO:teuthology.orchestra.run.smithi001.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-15T21:51:42.792 INFO:teuthology.orchestra.run.smithi001.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-15T21:51:42.878 INFO:teuthology.orchestra.run.smithi070.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-15T21:51:42.879 INFO:teuthology.orchestra.run.smithi070.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-15T21:51:42.893 INFO:teuthology.orchestra.run.smithi070.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-15T21:51:42.929 INFO:teuthology.orchestra.run.smithi070.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-15T21:51:42.938 INFO:teuthology.orchestra.run.smithi070.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-15T21:51:42.940 INFO:teuthology.orchestra.run.smithi070.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-15T21:51:42.993 INFO:teuthology.orchestra.run.smithi070.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-15T21:51:43.022 INFO:teuthology.orchestra.run.smithi001.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-15T21:51:43.226 INFO:teuthology.orchestra.run.smithi070.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-15T21:51:43.226 INFO:teuthology.orchestra.run.smithi070.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-15T21:51:44.033 INFO:teuthology.orchestra.run.smithi001.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-15T21:51:44.033 INFO:teuthology.orchestra.run.smithi001.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-15T21:51:44.050 INFO:teuthology.orchestra.run.smithi001.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-15T21:51:44.127 INFO:teuthology.orchestra.run.smithi001.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-15T21:51:44.143 INFO:teuthology.orchestra.run.smithi001.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-15T21:51:44.173 INFO:teuthology.orchestra.run.smithi001.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-15T21:51:44.247 INFO:teuthology.orchestra.run.smithi001.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-15T21:51:44.635 INFO:teuthology.orchestra.run.smithi001.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-15T21:51:44.636 INFO:teuthology.orchestra.run.smithi001.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-15T21:51:44.864 INFO:teuthology.orchestra.run.smithi070.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-15T21:51:44.866 INFO:teuthology.orchestra.run.smithi070.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-326-g8921c8ef-1jammy [237 kB] 2024-09-15T21:51:44.871 INFO:teuthology.orchestra.run.smithi070.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-326-g8921c8ef-1jammy [34.0 kB] 2024-09-15T21:51:44.872 INFO:teuthology.orchestra.run.smithi070.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-326-g8921c8ef-1jammy [23.5 kB] 2024-09-15T21:51:44.873 INFO:teuthology.orchestra.run.smithi070.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-15T21:51:44.874 INFO:teuthology.orchestra.run.smithi070.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-15T21:51:45.250 INFO:teuthology.orchestra.run.smithi070.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-15T21:51:45.880 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 181 MB in 5s (36.4 MB/s) 2024-09-15T21:51:46.016 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-15T21:51:46.110 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-15T21:51:46.115 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-15T21:51:46.156 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-15T21:51:46.450 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-15T21:51:46.477 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-15T21:51:46.517 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T21:51:46.581 INFO:teuthology.orchestra.run.smithi001.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-15T21:51:46.583 INFO:teuthology.orchestra.run.smithi001.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-326-g8921c8ef-1jammy [237 kB] 2024-09-15T21:51:46.588 INFO:teuthology.orchestra.run.smithi001.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-326-g8921c8ef-1jammy [34.0 kB] 2024-09-15T21:51:46.589 INFO:teuthology.orchestra.run.smithi001.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-326-g8921c8ef-1jammy [23.5 kB] 2024-09-15T21:51:46.590 INFO:teuthology.orchestra.run.smithi001.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-15T21:51:46.591 INFO:teuthology.orchestra.run.smithi001.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-15T21:51:46.845 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cmd2. 2024-09-15T21:51:46.871 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-15T21:51:46.913 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-15T21:51:47.093 INFO:teuthology.orchestra.run.smithi001.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-15T21:51:47.273 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-15T21:51:47.299 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-15T21:51:47.381 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T21:51:47.685 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-15T21:51:47.711 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-15T21:51:47.743 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T21:51:47.746 INFO:teuthology.orchestra.run.smithi001.stdout:Fetched 181 MB in 7s (27.4 MB/s) 2024-09-15T21:51:47.886 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-15T21:51:47.986 INFO:teuthology.orchestra.run.smithi001.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-15T21:51:47.991 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-15T21:51:48.035 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-15T21:51:48.062 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-15T21:51:48.089 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-15T21:51:48.129 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T21:51:48.304 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-15T21:51:48.331 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-15T21:51:48.362 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T21:51:48.574 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-15T21:51:48.601 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T21:51:48.649 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T21:51:48.657 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-cmd2. 2024-09-15T21:51:48.684 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-15T21:51:48.723 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-15T21:51:49.011 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-15T21:51:49.037 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T21:51:49.068 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-15T21:51:49.069 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T21:51:49.095 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-15T21:51:49.176 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T21:51:49.430 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-15T21:51:49.457 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T21:51:49.497 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T21:51:49.647 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-15T21:51:49.674 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-15T21:51:49.713 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T21:51:49.842 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-15T21:51:49.868 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-15T21:51:49.909 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T21:51:50.075 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-15T21:51:50.097 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-15T21:51:50.149 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T21:51:50.194 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librados2. 2024-09-15T21:51:50.221 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../010-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:50.252 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:50.695 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-15T21:51:50.697 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librbd1. 2024-09-15T21:51:50.722 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T21:51:50.723 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../011-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:50.763 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:50.778 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T21:51:51.198 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-15T21:51:51.208 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs2. 2024-09-15T21:51:51.225 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T21:51:51.234 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:51.264 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T21:51:51.274 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:51.527 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rados. 2024-09-15T21:51:51.553 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../013-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:51.585 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:51.634 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-15T21:51:51.661 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T21:51:51.709 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T21:51:51.880 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-15T21:51:51.906 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:51:51.946 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:52.120 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-15T21:51:52.147 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-15T21:51:52.203 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T21:51:52.207 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cephfs. 2024-09-15T21:51:52.233 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:52.548 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package librados2. 2024-09-15T21:51:52.575 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../010-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:52.584 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-15T21:51:52.611 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:51:52.614 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:52.651 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:52.988 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-prettytable. 2024-09-15T21:51:53.014 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-15T21:51:53.054 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-15T21:51:53.101 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package librbd1. 2024-09-15T21:51:53.127 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../011-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:53.167 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:53.324 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rbd. 2024-09-15T21:51:53.350 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:53.390 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:53.701 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-15T21:51:53.716 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-15T21:51:53.751 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T21:51:53.778 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libcephfs2. 2024-09-15T21:51:53.805 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:53.911 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:54.004 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-15T21:51:54.018 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-15T21:51:54.062 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T21:51:54.264 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-rados. 2024-09-15T21:51:54.289 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../013-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:54.339 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:54.373 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-15T21:51:54.400 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-15T21:51:54.440 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T21:51:54.667 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-15T21:51:54.694 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:51:54.733 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:54.759 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua5.1. 2024-09-15T21:51:54.775 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-15T21:51:54.809 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-15T21:51:54.986 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-cephfs. 2024-09-15T21:51:55.013 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:55.053 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:55.096 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-any. 2024-09-15T21:51:55.111 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-15T21:51:55.154 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-15T21:51:55.383 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package zip. 2024-09-15T21:51:55.399 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-15T21:51:55.432 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-15T21:51:55.441 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking zip (3.0-12build2) ... 2024-09-15T21:51:55.460 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:51:55.507 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:55.736 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package unzip. 2024-09-15T21:51:55.752 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-15T21:51:55.786 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-15T21:51:55.860 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-prettytable. 2024-09-15T21:51:55.887 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-15T21:51:55.927 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-15T21:51:56.148 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package luarocks. 2024-09-15T21:51:56.175 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-15T21:51:56.179 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-rbd. 2024-09-15T21:51:56.195 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:56.215 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-15T21:51:56.238 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:56.598 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librgw2. 2024-09-15T21:51:56.624 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-15T21:51:56.625 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../027-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:56.651 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-15T21:51:56.664 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:56.699 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T21:51:57.018 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-15T21:51:57.045 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-15T21:51:57.093 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T21:51:57.234 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rgw. 2024-09-15T21:51:57.260 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:57.300 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:57.446 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-15T21:51:57.462 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-15T21:51:57.512 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T21:51:57.596 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-15T21:51:57.621 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-15T21:51:57.653 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T21:51:57.866 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package lua5.1. 2024-09-15T21:51:57.893 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-15T21:51:57.932 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-15T21:51:57.972 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libradosstriper1. 2024-09-15T21:51:57.999 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:58.039 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:58.252 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package lua-any. 2024-09-15T21:51:58.276 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-15T21:51:58.327 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-15T21:51:58.442 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-common. 2024-09-15T21:51:58.469 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../031-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:58.509 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:58.663 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package zip. 2024-09-15T21:51:58.690 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-15T21:51:58.738 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking zip (3.0-12build2) ... 2024-09-15T21:51:59.367 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package unzip. 2024-09-15T21:51:59.394 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-15T21:51:59.441 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-15T21:51:59.805 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-base. 2024-09-15T21:51:59.832 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../032-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:51:59.853 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package luarocks. 2024-09-15T21:51:59.873 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:51:59.880 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-15T21:51:59.920 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-15T21:52:00.303 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package librgw2. 2024-09-15T21:52:00.330 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../027-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:00.369 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:00.435 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-15T21:52:00.461 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-15T21:52:00.501 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-15T21:52:00.820 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cheroot. 2024-09-15T21:52:00.836 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-15T21:52:00.879 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T21:52:00.972 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-rgw. 2024-09-15T21:52:00.999 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:01.046 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:01.198 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-15T21:52:01.225 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-15T21:52:01.265 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-15T21:52:01.458 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-15T21:52:01.485 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-15T21:52:01.524 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T21:52:01.543 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-15T21:52:01.558 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-15T21:52:01.593 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-15T21:52:01.821 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-15T21:52:01.836 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libradosstriper1. 2024-09-15T21:52:01.847 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-15T21:52:01.863 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:01.887 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-15T21:52:01.903 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:02.173 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempora. 2024-09-15T21:52:02.199 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-15T21:52:02.239 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-15T21:52:02.381 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-common. 2024-09-15T21:52:02.408 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../031-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:02.455 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:02.543 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-portend. 2024-09-15T21:52:02.569 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-15T21:52:02.609 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-15T21:52:02.870 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-15T21:52:02.886 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-15T21:52:02.920 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-15T21:52:03.198 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-15T21:52:03.224 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-15T21:52:03.264 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-15T21:52:03.602 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-natsort. 2024-09-15T21:52:03.628 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-15T21:52:03.668 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-15T21:52:03.979 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-logutils. 2024-09-15T21:52:03.985 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-base. 2024-09-15T21:52:04.005 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-15T21:52:04.012 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../032-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:04.046 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-15T21:52:04.061 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:04.323 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-15T21:52:04.354 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-15T21:52:04.382 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-15T21:52:04.693 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-mako. 2024-09-15T21:52:04.719 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-15T21:52:04.759 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T21:52:04.890 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-15T21:52:04.917 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-15T21:52:04.965 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-15T21:52:05.096 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-15T21:52:05.122 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-15T21:52:05.163 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-15T21:52:05.334 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-cheroot. 2024-09-15T21:52:05.361 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-15T21:52:05.409 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T21:52:05.424 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-15T21:52:05.451 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-15T21:52:05.482 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-15T21:52:05.737 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-15T21:52:05.764 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-15T21:52:05.777 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webob. 2024-09-15T21:52:05.803 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-15T21:52:05.804 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-15T21:52:05.843 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T21:52:06.065 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-15T21:52:06.092 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-15T21:52:06.123 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-15T21:52:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-waitress. 2024-09-15T21:52:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-15T21:52:06.266 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T21:52:06.426 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-15T21:52:06.453 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-15T21:52:06.493 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-15T21:52:06.557 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempita. 2024-09-15T21:52:06.583 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-15T21:52:06.624 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T21:52:06.795 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-tempora. 2024-09-15T21:52:06.822 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-15T21:52:06.862 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-15T21:52:06.885 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-paste. 2024-09-15T21:52:06.911 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-15T21:52:06.951 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T21:52:07.148 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-portend. 2024-09-15T21:52:07.175 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-15T21:52:07.215 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-15T21:52:07.263 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-15T21:52:07.289 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-15T21:52:07.329 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T21:52:07.509 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-15T21:52:07.537 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-15T21:52:07.576 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-15T21:52:07.607 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-15T21:52:07.633 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-15T21:52:07.673 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-15T21:52:07.879 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-15T21:52:07.906 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-15T21:52:07.945 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-15T21:52:08.228 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webtest. 2024-09-15T21:52:08.253 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-15T21:52:08.316 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-natsort. 2024-09-15T21:52:08.318 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-15T21:52:08.343 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-15T21:52:08.382 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-15T21:52:08.646 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pecan. 2024-09-15T21:52:08.668 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-logutils. 2024-09-15T21:52:08.672 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-15T21:52:08.685 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-15T21:52:08.713 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T21:52:08.718 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-15T21:52:09.005 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-15T21:52:09.032 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-15T21:52:09.068 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-certifi. 2024-09-15T21:52:09.071 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-15T21:52:09.094 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-15T21:52:09.134 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-15T21:52:09.357 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-mako. 2024-09-15T21:52:09.385 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-15T21:52:09.424 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T21:52:09.445 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-idna. 2024-09-15T21:52:09.471 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-15T21:52:09.512 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T21:52:09.752 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-15T21:52:09.779 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-15T21:52:09.789 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-urllib3. 2024-09-15T21:52:09.804 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-15T21:52:09.819 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-15T21:52:09.839 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T21:52:10.096 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-15T21:52:10.123 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-15T21:52:10.151 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests. 2024-09-15T21:52:10.162 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-15T21:52:10.177 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-15T21:52:10.217 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T21:52:10.433 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-webob. 2024-09-15T21:52:10.459 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-15T21:52:10.499 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T21:52:10.562 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-15T21:52:10.589 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-15T21:52:10.637 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T21:52:10.827 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-waitress. 2024-09-15T21:52:10.854 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-15T21:52:10.897 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T21:52:10.923 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-15T21:52:10.949 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:10.990 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:11.205 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-tempita. 2024-09-15T21:52:11.232 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-15T21:52:11.271 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T21:52:11.378 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-15T21:52:11.404 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:11.444 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:11.600 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-paste. 2024-09-15T21:52:11.626 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-15T21:52:11.666 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T21:52:11.764 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-15T21:52:11.790 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-15T21:52:11.830 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-15T21:52:12.003 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-15T21:52:12.018 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-15T21:52:12.061 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T21:52:12.108 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-openssl. 2024-09-15T21:52:12.123 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-15T21:52:12.175 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-15T21:52:12.363 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-15T21:52:12.390 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-15T21:52:12.430 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-15T21:52:12.469 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr. 2024-09-15T21:52:12.496 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:12.527 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:12.733 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-webtest. 2024-09-15T21:52:12.760 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-15T21:52:12.799 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-15T21:52:12.889 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mon. 2024-09-15T21:52:12.915 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:12.947 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:13.086 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pecan. 2024-09-15T21:52:13.113 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-15T21:52:13.152 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T21:52:13.476 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-osd. 2024-09-15T21:52:13.502 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:13.534 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:14.350 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-certifi. 2024-09-15T21:52:14.377 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-15T21:52:14.416 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-15T21:52:14.736 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-idna. 2024-09-15T21:52:14.763 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-15T21:52:14.802 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T21:52:15.095 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph. 2024-09-15T21:52:15.110 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../068-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:15.153 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:15.313 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-urllib3. 2024-09-15T21:52:15.340 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-15T21:52:15.380 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T21:52:15.489 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-fuse. 2024-09-15T21:52:15.516 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:15.555 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:15.708 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-requests. 2024-09-15T21:52:15.735 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-15T21:52:15.775 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T21:52:15.901 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mds. 2024-09-15T21:52:15.927 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:15.989 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:16.069 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-15T21:52:16.097 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-15T21:52:16.135 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T21:52:16.345 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephadm. 2024-09-15T21:52:16.371 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../071-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:16.412 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:16.438 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-15T21:52:16.454 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:16.497 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:16.722 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-15T21:52:16.749 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-15T21:52:16.789 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-15T21:52:16.885 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-15T21:52:16.912 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:16.951 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:17.100 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-15T21:52:17.124 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T21:52:17.166 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T21:52:17.271 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-15T21:52:17.298 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-15T21:52:17.337 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-15T21:52:17.640 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-openssl. 2024-09-15T21:52:17.667 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-15T21:52:17.707 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-15T21:52:18.027 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mgr. 2024-09-15T21:52:18.054 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:18.085 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:18.155 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-babel. 2024-09-15T21:52:18.182 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T21:52:18.221 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T21:52:18.488 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mon. 2024-09-15T21:52:18.515 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:18.541 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jinja2. 2024-09-15T21:52:18.554 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:18.568 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-15T21:52:18.607 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T21:52:18.936 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-15T21:52:18.963 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:19.002 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:19.174 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-osd. 2024-09-15T21:52:19.202 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:19.241 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:19.289 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-15T21:52:19.316 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-15T21:52:19.355 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-15T21:52:19.641 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-routes. 2024-09-15T21:52:19.668 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-15T21:52:19.708 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T21:52:20.086 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-15T21:52:20.113 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:20.152 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:20.394 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph. 2024-09-15T21:52:20.410 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../068-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:20.452 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:20.763 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-fuse. 2024-09-15T21:52:20.790 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:20.821 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:21.166 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mds. 2024-09-15T21:52:21.194 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:21.233 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:21.391 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-15T21:52:21.419 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-15T21:52:21.457 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T21:52:21.636 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package cephadm. 2024-09-15T21:52:21.663 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../071-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:21.702 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:21.919 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-joblib. 2024-09-15T21:52:21.946 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-15T21:52:21.977 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T21:52:22.005 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-15T21:52:22.032 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-15T21:52:22.071 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-15T21:52:22.330 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-15T21:52:22.358 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-15T21:52:22.391 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-15T21:52:22.407 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T21:52:22.440 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T21:52:22.483 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-15T21:52:22.735 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn. 2024-09-15T21:52:22.763 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-15T21:52:22.802 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T21:52:23.446 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-babel. 2024-09-15T21:52:23.473 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T21:52:23.504 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T21:52:23.769 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-15T21:52:23.797 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:23.798 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-jinja2. 2024-09-15T21:52:23.826 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-15T21:52:23.836 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:23.856 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T21:52:24.160 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-15T21:52:24.181 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:24.218 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:24.530 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-15T21:52:24.546 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-15T21:52:24.579 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-15T21:52:24.789 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cachetools. 2024-09-15T21:52:24.816 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-15T21:52:24.855 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-15T21:52:24.890 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-routes. 2024-09-15T21:52:24.918 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-15T21:52:24.957 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T21:52:25.141 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-15T21:52:25.169 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-15T21:52:25.208 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-15T21:52:25.285 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-15T21:52:25.313 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:25.352 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:25.578 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-15T21:52:25.594 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-15T21:52:25.628 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T21:52:25.922 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rsa. 2024-09-15T21:52:25.950 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-15T21:52:25.989 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-15T21:52:26.284 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-google-auth. 2024-09-15T21:52:26.312 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-15T21:52:26.351 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-15T21:52:26.612 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-15T21:52:26.632 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-15T21:52:26.639 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-15T21:52:26.648 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-15T21:52:26.670 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T21:52:26.690 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T21:52:26.973 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-websocket. 2024-09-15T21:52:27.001 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-15T21:52:27.040 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-15T21:52:27.227 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-joblib. 2024-09-15T21:52:27.255 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-15T21:52:27.293 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T21:52:27.351 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-15T21:52:27.379 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-15T21:52:27.418 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T21:52:27.647 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-15T21:52:27.674 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-15T21:52:27.799 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-15T21:52:28.090 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-15T21:52:28.118 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:28.118 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-sklearn. 2024-09-15T21:52:28.146 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-15T21:52:28.156 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:28.185 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T21:52:28.476 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-15T21:52:28.503 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-15T21:52:28.542 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T21:52:28.862 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-15T21:52:28.889 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T21:52:28.894 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-15T21:52:28.922 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:28.928 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T21:52:28.960 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:29.147 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package jq. 2024-09-15T21:52:29.163 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T21:52:29.206 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-15T21:52:29.458 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package socat. 2024-09-15T21:52:29.474 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-15T21:52:29.517 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-15T21:52:29.820 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package xmlstarlet. 2024-09-15T21:52:29.836 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-15T21:52:29.887 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-15T21:52:29.939 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-cachetools. 2024-09-15T21:52:29.966 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-15T21:52:30.005 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-15T21:52:30.275 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-test. 2024-09-15T21:52:30.300 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-15T21:52:30.302 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../099-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:30.328 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-15T21:52:30.349 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:30.366 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-15T21:52:30.886 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-15T21:52:30.914 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-15T21:52:30.944 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T21:52:31.231 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-rsa. 2024-09-15T21:52:31.258 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-15T21:52:31.297 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-15T21:52:31.618 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-google-auth. 2024-09-15T21:52:31.645 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-15T21:52:31.684 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-15T21:52:32.005 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-15T21:52:32.032 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-15T21:52:32.070 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T21:52:32.382 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-websocket. 2024-09-15T21:52:32.409 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-15T21:52:32.448 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-15T21:52:32.637 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-volume. 2024-09-15T21:52:32.665 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:32.703 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:32.777 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-15T21:52:32.804 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-15T21:52:32.843 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T21:52:33.074 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-15T21:52:33.102 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:33.140 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:33.460 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-colorama. 2024-09-15T21:52:33.482 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-15T21:52:33.487 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-15T21:52:33.498 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:33.526 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-15T21:52:33.540 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:33.804 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephfs-shell. 2024-09-15T21:52:33.831 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:33.845 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-15T21:52:33.870 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:33.872 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-15T21:52:33.903 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T21:52:34.106 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephfs-top. 2024-09-15T21:52:34.134 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:34.164 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:34.240 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-15T21:52:34.267 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T21:52:34.306 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T21:52:34.392 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-15T21:52:34.409 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:34.450 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:34.575 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package jq. 2024-09-15T21:52:34.592 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T21:52:34.633 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-15T21:52:34.761 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-15T21:52:34.778 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-15T21:52:34.819 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T21:52:34.903 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package socat. 2024-09-15T21:52:34.931 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-15T21:52:34.969 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-15T21:52:35.157 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-15T21:52:35.185 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-15T21:52:35.242 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-15T21:52:35.273 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package xmlstarlet. 2024-09-15T21:52:35.289 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-15T21:52:35.330 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-15T21:52:35.579 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package nvme-cli. 2024-09-15T21:52:35.603 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-15T21:52:35.646 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T21:52:35.685 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-test. 2024-09-15T21:52:35.713 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../099-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:35.751 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:36.026 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package pkg-config. 2024-09-15T21:52:36.053 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-15T21:52:36.084 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T21:52:36.328 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-15T21:52:36.355 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-15T21:52:36.395 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-15T21:52:36.765 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-15T21:52:36.792 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-15T21:52:36.831 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-15T21:52:37.117 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastescript. 2024-09-15T21:52:37.138 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-15T21:52:37.175 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-15T21:52:37.495 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pluggy. 2024-09-15T21:52:37.523 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-15T21:52:37.561 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-15T21:52:37.872 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-psutil. 2024-09-15T21:52:37.900 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-15T21:52:37.939 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-15T21:52:38.206 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ceph-volume. 2024-09-15T21:52:38.233 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:38.272 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:38.275 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-py. 2024-09-15T21:52:38.303 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-15T21:52:38.350 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-15T21:52:38.651 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-15T21:52:38.670 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pygments. 2024-09-15T21:52:38.679 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:38.697 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-15T21:52:38.717 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:38.736 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T21:52:39.012 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-colorama. 2024-09-15T21:52:39.040 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-15T21:52:39.070 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-15T21:52:39.289 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package cephfs-shell. 2024-09-15T21:52:39.306 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:39.347 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:39.457 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-15T21:52:39.473 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-15T21:52:39.506 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-15T21:52:39.609 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package cephfs-top. 2024-09-15T21:52:39.636 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T21:52:39.675 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:39.784 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-toml. 2024-09-15T21:52:39.812 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-15T21:52:39.851 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-15T21:52:39.953 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-15T21:52:39.981 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:40.119 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:40.129 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pytest. 2024-09-15T21:52:40.157 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-15T21:52:40.195 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T21:52:40.439 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-15T21:52:40.467 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-15T21:52:40.505 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T21:52:40.548 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplejson. 2024-09-15T21:52:40.577 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-15T21:52:40.615 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-15T21:52:40.810 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-15T21:52:40.826 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-15T21:52:40.859 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-15T21:52:40.884 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-15T21:52:40.900 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-15T21:52:40.942 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-15T21:52:41.230 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package nvme-cli. 2024-09-15T21:52:41.258 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-15T21:52:41.296 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T21:52:41.671 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package radosgw. 2024-09-15T21:52:41.699 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../122-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:41.726 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package pkg-config. 2024-09-15T21:52:41.737 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:41.754 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-15T21:52:41.793 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T21:52:42.046 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-15T21:52:42.074 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-15T21:52:42.112 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-15T21:52:42.532 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-fuse. 2024-09-15T21:52:42.548 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:42.582 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-15T21:52:42.590 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:42.610 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-15T21:52:42.648 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-15T21:52:42.926 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pastescript. 2024-09-15T21:52:42.928 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-15T21:52:42.954 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-15T21:52:42.984 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-15T21:52:43.187 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T21:52:43.288 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T21:52:43.313 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pluggy. 2024-09-15T21:52:43.341 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-15T21:52:43.379 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-15T21:52:43.527 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-15T21:52:43.640 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-psutil. 2024-09-15T21:52:43.657 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-15T21:52:43.690 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-15T21:52:43.842 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-15T21:52:44.018 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-py. 2024-09-15T21:52:44.047 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-15T21:52:44.085 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-15T21:52:44.285 INFO:teuthology.orchestra.run.smithi070.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-15T21:52:44.348 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:44.363 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pygments. 2024-09-15T21:52:44.392 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-15T21:52:44.421 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T21:52:44.847 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user cephadm....done 2024-09-15T21:52:44.859 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-15T21:52:44.876 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-15T21:52:44.909 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-15T21:52:45.004 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T21:52:45.245 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-toml. 2024-09-15T21:52:45.272 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-15T21:52:45.273 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-15T21:52:45.311 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-15T21:52:45.514 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-15T21:52:45.614 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-pytest. 2024-09-15T21:52:45.615 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-15T21:52:45.643 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-15T21:52:45.681 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T21:52:45.867 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-15T21:52:46.026 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package python3-simplejson. 2024-09-15T21:52:46.055 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-15T21:52:46.092 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-15T21:52:46.126 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T21:52:46.252 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-15T21:52:46.362 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-15T21:52:46.379 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-15T21:52:46.420 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-15T21:52:46.570 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T21:52:46.922 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-15T21:52:47.165 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-15T21:52:47.233 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package radosgw. 2024-09-15T21:52:47.261 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../122-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:47.299 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:47.433 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-15T21:52:47.701 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-15T21:52:47.961 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-15T21:52:48.220 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-15T21:52:48.277 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package rbd-fuse. 2024-09-15T21:52:48.290 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T21:52:48.326 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:48.480 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-15T21:52:48.624 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-15T21:52:48.714 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:48.874 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T21:52:48.973 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T21:52:49.000 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T21:52:49.099 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T21:52:49.233 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-15T21:52:49.265 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-15T21:52:49.493 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T21:52:49.587 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-15T21:52:49.619 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-15T21:52:49.878 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-15T21:52:49.989 INFO:teuthology.orchestra.run.smithi001.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-15T21:52:50.059 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:50.285 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-15T21:52:50.309 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-15T21:52:50.364 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T21:52:50.465 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-15T21:52:50.567 INFO:teuthology.orchestra.run.smithi001.stdout:Adding system user cephadm....done 2024-09-15T21:52:50.741 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T21:52:50.842 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T21:52:50.968 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-15T21:52:51.075 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-15T21:52:51.244 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T21:52:51.335 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-15T21:52:51.461 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-15T21:52:51.503 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-15T21:52:51.729 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-15T21:52:51.812 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up zip (3.0-12build2) ... 2024-09-15T21:52:51.938 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T21:52:51.972 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T21:52:52.098 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-15T21:52:52.408 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T21:52:52.632 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T21:52:52.776 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-15T21:52:52.891 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T21:52:53.017 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-15T21:52:53.044 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-15T21:52:53.143 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T21:52:53.312 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-15T21:52:53.444 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-15T21:52:53.580 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-15T21:52:53.820 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-15T21:52:53.823 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-15T21:52:54.062 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T21:52:54.074 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-15T21:52:54.434 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-15T21:52:54.456 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T21:52:54.693 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:54.732 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-15T21:52:54.952 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T21:52:55.033 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T21:52:55.079 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T21:52:55.196 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-15T21:52:55.368 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-15T21:52:55.439 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T21:52:55.565 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-15T21:52:55.619 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-15T21:52:55.761 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:52:55.833 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-15T21:52:56.063 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T21:52:56.213 INFO:teuthology.orchestra.run.smithi001.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-15T21:52:56.239 INFO:teuthology.orchestra.run.smithi001.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-15T21:52:56.294 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T21:52:56.380 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T21:52:56.420 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-15T21:52:56.788 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T21:52:56.889 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-15T21:52:57.157 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T21:52:57.425 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-15T21:52:57.478 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T21:52:57.729 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T21:52:57.734 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up zip (3.0-12build2) ... 2024-09-15T21:52:57.847 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-15T21:52:57.860 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T21:52:58.089 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T21:52:58.190 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-15T21:52:58.350 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T21:52:58.537 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T21:52:58.659 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-15T21:52:58.780 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T21:52:58.881 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-15T21:52:58.910 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-15T21:52:58.998 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T21:52:59.161 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T21:52:59.287 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-15T21:52:59.307 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-15T21:52:59.597 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-15T21:52:59.717 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-15T21:52:59.977 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T21:53:00.110 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-15T21:53:00.345 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T21:53:00.366 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-15T21:53:00.638 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-15T21:53:00.675 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-15T21:53:00.918 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-15T21:53:00.939 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T21:53:01.194 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T21:53:01.290 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-15T21:53:01.320 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-15T21:53:01.541 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-15T21:53:01.604 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T21:53:01.642 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:01.705 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T21:53:01.927 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T21:53:01.981 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T21:53:02.287 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T21:53:02.299 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-15T21:53:02.550 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T21:53:02.676 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-15T21:53:02.802 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T21:53:02.892 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-15T21:53:03.137 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T21:53:03.263 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T21:53:03.509 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T21:53:03.647 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-15T21:53:03.744 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T21:53:03.879 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-15T21:53:03.899 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-15T21:53:04.016 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-15T21:53:04.146 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T21:53:04.247 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-15T21:53:04.267 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T21:53:04.356 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T21:53:04.393 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T21:53:04.649 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-15T21:53:04.702 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T21:53:04.892 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-15T21:53:05.004 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T21:53:05.127 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T21:53:05.253 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-15T21:53:05.288 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-15T21:53:05.500 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-15T21:53:05.546 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-15T21:53:05.759 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-15T21:53:05.805 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-15T21:53:06.002 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T21:53:06.073 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-15T21:53:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-15T21:53:06.332 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-15T21:53:06.591 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-15T21:53:06.646 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-15T21:53:06.851 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T21:53:06.914 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T21:53:06.977 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-15T21:53:07.267 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T21:53:07.295 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T21:53:07.368 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:07.421 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T21:53:07.494 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:07.620 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-15T21:53:07.697 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T21:53:07.956 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:08.023 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-15T21:53:08.090 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:08.208 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-15T21:53:08.291 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T21:53:08.433 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-15T21:53:08.484 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:08.559 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T21:53:08.627 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:08.648 INFO:teuthology.orchestra.run.smithi001.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-15T21:53:08.761 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:08.886 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T21:53:08.975 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T21:53:08.976 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T21:53:09.004 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T21:53:09.397 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-15T21:53:09.479 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:09.597 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:09.665 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-15T21:53:09.698 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:09.791 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-15T21:53:09.840 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:09.958 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T21:53:10.033 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T21:53:10.159 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T21:53:10.494 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T21:53:10.803 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T21:53:11.079 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-15T21:53:11.111 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:11.237 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:11.274 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-15T21:53:11.355 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:11.533 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-15T21:53:11.565 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:11.691 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:12.085 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T21:53:12.234 INFO:teuthology.orchestra.run.smithi070.stdout:Adding group ceph....done 2024-09-15T21:53:12.353 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-15T21:53:12.611 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user ceph....done 2024-09-15T21:53:12.763 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-15T21:53:12.780 INFO:teuthology.orchestra.run.smithi070.stdout:Setting system user ceph properties....done 2024-09-15T21:53:12.798 INFO:teuthology.orchestra.run.smithi070.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-15T21:53:12.932 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-15T21:53:13.048 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T21:53:13.251 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-15T21:53:13.384 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T21:53:13.485 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:13.611 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:13.701 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:13.745 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-15T21:53:13.907 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T21:53:13.908 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T21:53:14.056 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:14.182 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:14.309 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-15T21:53:14.385 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:14.511 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:14.585 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:14.711 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:14.829 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:14.989 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T21:53:14.989 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T21:53:15.030 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T21:53:15.031 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T21:53:15.488 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:15.505 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:15.623 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:15.749 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:15.837 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-15T21:53:15.875 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:16.000 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T21:53:16.314 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:16.557 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T21:53:16.557 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T21:53:17.016 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:17.225 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T21:53:17.225 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T21:53:17.288 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:17.389 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:17.490 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:17.632 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:17.700 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:17.758 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:17.884 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:17.974 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T21:53:17.974 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T21:53:18.453 INFO:teuthology.orchestra.run.smithi001.stdout:Adding group ceph....done 2024-09-15T21:53:18.493 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:18.620 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:18.771 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:18.804 INFO:teuthology.orchestra.run.smithi001.stdout:Adding system user ceph....done 2024-09-15T21:53:18.978 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T21:53:18.979 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T21:53:18.989 INFO:teuthology.orchestra.run.smithi001.stdout:Setting system user ceph properties....done 2024-09-15T21:53:19.006 INFO:teuthology.orchestra.run.smithi001.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-15T21:53:19.152 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-15T21:53:19.472 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:19.501 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-15T21:53:19.615 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:19.740 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:19.891 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:19.960 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:20.175 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T21:53:20.175 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T21:53:20.253 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T21:53:20.361 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T21:53:20.540 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T21:53:20.654 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:20.764 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:21.216 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T21:53:21.216 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T21:53:21.690 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T21:53:21.702 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:22.174 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-15T21:53:22.385 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T21:53:22.388 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-15T21:53:22.491 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-09-15T21:53:22.662 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:22.703 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-09-15T21:53:22.704 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-09-15T21:53:22.897 INFO:teuthology.orchestra.run.smithi070.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-15T21:53:22.897 INFO:teuthology.orchestra.run.smithi070.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-15T21:53:22.897 INFO:teuthology.orchestra.run.smithi070.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-15T21:53:22.897 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T21:53:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T21:53:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T21:53:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T21:53:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T21:53:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T21:53:22.898 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T21:53:22.898 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-09-15T21:53:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-15T21:53:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-15T21:53:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-15T21:53:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-15T21:53:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T21:53:22.900 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-09-15T21:53:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-15T21:53:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-15T21:53:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-15T21:53:22.931 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T21:53:22.931 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T21:53:22.942 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-09-15T21:53:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-15T21:53:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-15T21:53:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-15T21:53:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-15T21:53:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-15T21:53:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-15T21:53:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T21:53:22.945 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages will be upgraded: 2024-09-15T21:53:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-15T21:53:22.997 INFO:teuthology.orchestra.run.smithi070.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-15T21:53:22.997 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 55.8 MB of archives. 2024-09-15T21:53:22.997 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-15T21:53:22.997 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-15T21:53:23.129 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-15T21:53:23.137 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-15T21:53:23.178 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-15T21:53:23.178 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-15T21:53:23.179 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-15T21:53:23.189 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-15T21:53:23.190 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-15T21:53:23.192 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-15T21:53:23.194 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-15T21:53:23.194 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-15T21:53:23.195 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-15T21:53:23.196 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-15T21:53:23.213 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-15T21:53:23.213 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-15T21:53:23.215 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-15T21:53:23.388 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:23.537 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-15T21:53:23.539 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-15T21:53:23.539 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-15T21:53:23.542 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-15T21:53:23.542 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-15T21:53:23.546 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-15T21:53:23.547 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-15T21:53:23.554 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-15T21:53:23.554 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-15T21:53:23.575 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-15T21:53:23.575 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-15T21:53:23.585 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-15T21:53:23.604 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T21:53:23.605 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T21:53:23.606 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-15T21:53:23.609 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-15T21:53:23.610 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-15T21:53:23.610 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-15T21:53:23.611 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-15T21:53:23.622 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-15T21:53:23.623 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-15T21:53:23.835 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-15T21:53:23.836 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-15T21:53:23.836 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-15T21:53:23.836 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-15T21:53:23.836 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-15T21:53:23.836 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-15T21:53:23.847 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-15T21:53:23.847 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-15T21:53:24.073 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:24.259 INFO:teuthology.orchestra.run.smithi070.stdout:Preconfiguring packages ... 2024-09-15T21:53:24.365 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T21:53:24.365 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T21:53:24.399 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 55.8 MB in 1s (62.3 MB/s) 2024-09-15T21:53:24.692 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-15T21:53:24.698 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T21:53:24.825 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:24.837 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T21:53:24.951 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:25.102 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:25.323 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T21:53:25.323 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T21:53:25.498 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-15T21:53:25.778 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:25.946 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:26.071 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:26.214 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T21:53:26.576 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T21:53:26.589 INFO:teuthology.orchestra.run.smithi070.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-15T21:53:26.677 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T21:53:26.829 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T21:53:26.861 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package flex. 2024-09-15T21:53:26.954 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-15T21:53:26.959 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-15T21:53:27.009 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-15T21:53:27.492 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T21:53:27.563 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T21:53:27.641 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-15T21:53:28.044 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T21:53:28.232 INFO:teuthology.orchestra.run.smithi001.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T21:53:28.236 DEBUG:teuthology.orchestra.run.smithi001:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-15T21:53:28.300 INFO:teuthology.orchestra.run.smithi001.stdout:Reading package lists... 2024-09-15T21:53:28.515 INFO:teuthology.orchestra.run.smithi001.stdout:Building dependency tree... 2024-09-15T21:53:28.516 INFO:teuthology.orchestra.run.smithi001.stdout:Reading state information... 2024-09-15T21:53:28.568 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-15T21:53:28.574 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T21:53:28.699 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T21:53:28.733 INFO:teuthology.orchestra.run.smithi001.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-15T21:53:28.733 INFO:teuthology.orchestra.run.smithi001.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-15T21:53:28.733 INFO:teuthology.orchestra.run.smithi001.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-15T21:53:28.733 INFO:teuthology.orchestra.run.smithi001.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T21:53:28.733 INFO:teuthology.orchestra.run.smithi001.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T21:53:28.734 INFO:teuthology.orchestra.run.smithi001.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T21:53:28.734 INFO:teuthology.orchestra.run.smithi001.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T21:53:28.734 INFO:teuthology.orchestra.run.smithi001.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T21:53:28.734 INFO:teuthology.orchestra.run.smithi001.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T21:53:28.734 INFO:teuthology.orchestra.run.smithi001.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T21:53:28.736 INFO:teuthology.orchestra.run.smithi001.stdout:The following additional packages will be installed: 2024-09-15T21:53:28.736 INFO:teuthology.orchestra.run.smithi001.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-15T21:53:28.736 INFO:teuthology.orchestra.run.smithi001.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-15T21:53:28.736 INFO:teuthology.orchestra.run.smithi001.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-15T21:53:28.737 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-15T21:53:28.737 INFO:teuthology.orchestra.run.smithi001.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T21:53:28.740 INFO:teuthology.orchestra.run.smithi001.stdout:Suggested packages: 2024-09-15T21:53:28.740 INFO:teuthology.orchestra.run.smithi001.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-15T21:53:28.741 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-15T21:53:28.741 INFO:teuthology.orchestra.run.smithi001.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-15T21:53:28.782 INFO:teuthology.orchestra.run.smithi001.stdout:The following NEW packages will be installed: 2024-09-15T21:53:28.782 INFO:teuthology.orchestra.run.smithi001.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-15T21:53:28.782 INFO:teuthology.orchestra.run.smithi001.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-15T21:53:28.783 INFO:teuthology.orchestra.run.smithi001.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-15T21:53:28.783 INFO:teuthology.orchestra.run.smithi001.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-15T21:53:28.783 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-15T21:53:28.783 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-15T21:53:28.784 INFO:teuthology.orchestra.run.smithi001.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T21:53:28.785 INFO:teuthology.orchestra.run.smithi001.stdout:The following packages will be upgraded: 2024-09-15T21:53:28.785 INFO:teuthology.orchestra.run.smithi001.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-15T21:53:28.857 INFO:teuthology.orchestra.run.smithi001.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-15T21:53:28.857 INFO:teuthology.orchestra.run.smithi001.stdout:Need to get 55.8 MB of archives. 2024-09-15T21:53:28.858 INFO:teuthology.orchestra.run.smithi001.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-15T21:53:28.858 INFO:teuthology.orchestra.run.smithi001.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-15T21:53:28.991 INFO:teuthology.orchestra.run.smithi001.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-15T21:53:28.999 INFO:teuthology.orchestra.run.smithi001.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-15T21:53:29.039 INFO:teuthology.orchestra.run.smithi001.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-15T21:53:29.039 INFO:teuthology.orchestra.run.smithi001.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-15T21:53:29.040 INFO:teuthology.orchestra.run.smithi001.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-15T21:53:29.052 INFO:teuthology.orchestra.run.smithi001.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-15T21:53:29.052 INFO:teuthology.orchestra.run.smithi001.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-15T21:53:29.055 INFO:teuthology.orchestra.run.smithi001.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-15T21:53:29.056 INFO:teuthology.orchestra.run.smithi001.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-15T21:53:29.057 INFO:teuthology.orchestra.run.smithi001.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-15T21:53:29.058 INFO:teuthology.orchestra.run.smithi001.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-15T21:53:29.059 INFO:teuthology.orchestra.run.smithi001.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-15T21:53:29.073 INFO:teuthology.orchestra.run.smithi001.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-15T21:53:29.074 INFO:teuthology.orchestra.run.smithi001.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-15T21:53:29.075 INFO:teuthology.orchestra.run.smithi001.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-15T21:53:29.108 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T21:53:29.239 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T21:53:29.353 INFO:teuthology.orchestra.run.smithi001.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-15T21:53:29.353 INFO:teuthology.orchestra.run.smithi001.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-15T21:53:29.410 INFO:teuthology.orchestra.run.smithi001.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-15T21:53:29.413 INFO:teuthology.orchestra.run.smithi001.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-15T21:53:29.413 INFO:teuthology.orchestra.run.smithi001.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-15T21:53:29.418 INFO:teuthology.orchestra.run.smithi001.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-15T21:53:29.419 INFO:teuthology.orchestra.run.smithi001.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-15T21:53:29.427 INFO:teuthology.orchestra.run.smithi001.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-15T21:53:29.427 INFO:teuthology.orchestra.run.smithi001.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-15T21:53:29.448 INFO:teuthology.orchestra.run.smithi001.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-15T21:53:29.449 INFO:teuthology.orchestra.run.smithi001.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-15T21:53:29.458 INFO:teuthology.orchestra.run.smithi001.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-15T21:53:29.478 INFO:teuthology.orchestra.run.smithi001.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-15T21:53:29.481 INFO:teuthology.orchestra.run.smithi001.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-15T21:53:29.481 INFO:teuthology.orchestra.run.smithi001.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-15T21:53:29.482 INFO:teuthology.orchestra.run.smithi001.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-15T21:53:29.482 INFO:teuthology.orchestra.run.smithi001.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-15T21:53:29.492 INFO:teuthology.orchestra.run.smithi001.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-15T21:53:29.494 INFO:teuthology.orchestra.run.smithi001.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-15T21:53:29.674 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T21:53:29.697 INFO:teuthology.orchestra.run.smithi001.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-15T21:53:29.697 INFO:teuthology.orchestra.run.smithi001.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-15T21:53:29.697 INFO:teuthology.orchestra.run.smithi001.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-15T21:53:29.697 INFO:teuthology.orchestra.run.smithi001.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-15T21:53:29.698 INFO:teuthology.orchestra.run.smithi001.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-15T21:53:29.698 INFO:teuthology.orchestra.run.smithi001.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-15T21:53:29.709 INFO:teuthology.orchestra.run.smithi001.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-15T21:53:29.710 INFO:teuthology.orchestra.run.smithi001.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-15T21:53:30.048 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package bison. 2024-09-15T21:53:30.111 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-15T21:53:30.116 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-15T21:53:30.143 INFO:teuthology.orchestra.run.smithi001.stdout:Preconfiguring packages ... 2024-09-15T21:53:30.159 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T21:53:30.304 INFO:teuthology.orchestra.run.smithi001.stdout:Fetched 55.8 MB in 1s (60.9 MB/s) 2024-09-15T21:53:30.552 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-15T21:53:30.580 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-15T21:53:30.618 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T21:53:30.838 INFO:teuthology.orchestra.run.smithi001.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-15T21:53:30.844 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T21:53:30.955 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package dump. 2024-09-15T21:53:30.983 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-15T21:53:31.011 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T21:53:31.264 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking dump (0.4b47-3) ... 2024-09-15T21:53:31.666 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-15T21:53:31.743 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package indent. 2024-09-15T21:53:31.760 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T21:53:31.793 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T21:53:32.032 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-15T21:53:32.046 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-15T21:53:32.088 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T21:53:32.400 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-15T21:53:32.428 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-15T21:53:32.467 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T21:53:32.676 INFO:teuthology.orchestra.run.smithi001.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-15T21:53:32.711 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-15T21:53:32.728 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-15T21:53:32.777 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T21:53:32.992 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package flex. 2024-09-15T21:53:33.099 INFO:teuthology.orchestra.run.smithi001.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173987 files and directories currently installed.) 2024-09-15T21:53:33.105 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-15T21:53:33.115 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-15T21:53:33.143 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-15T21:53:33.156 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-15T21:53:33.181 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T21:53:33.434 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-15T21:53:33.451 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-15T21:53:33.493 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T21:53:33.729 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjson-perl. 2024-09-15T21:53:33.745 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-15T21:53:33.779 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-15T21:53:33.790 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T21:53:33.970 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-15T21:53:34.074 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-15T21:53:34.102 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-15T21:53:34.140 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T21:53:34.391 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T21:53:34.924 INFO:teuthology.orchestra.run.smithi001.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-15T21:53:34.929 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T21:53:35.053 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T21:53:35.421 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T21:53:35.526 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T21:53:35.844 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-15T21:53:35.871 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T21:53:35.910 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T21:53:35.946 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T21:53:36.180 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-15T21:53:36.207 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T21:53:36.246 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T21:53:36.277 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package bison. 2024-09-15T21:53:36.381 INFO:teuthology.orchestra.run.smithi001.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174060 files and directories currently installed.) 2024-09-15T21:53:36.387 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-15T21:53:36.429 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T21:53:36.626 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-15T21:53:36.654 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T21:53:36.692 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T21:53:36.772 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-15T21:53:36.800 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-15T21:53:36.830 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T21:53:37.037 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-15T21:53:37.065 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-15T21:53:37.103 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T21:53:37.150 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package dump. 2024-09-15T21:53:37.178 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-15T21:53:37.216 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking dump (0.4b47-3) ... 2024-09-15T21:53:37.398 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-15T21:53:37.426 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T21:53:37.456 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T21:53:37.528 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package indent. 2024-09-15T21:53:37.545 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T21:53:37.586 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T21:53:37.810 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-15T21:53:37.837 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T21:53:37.872 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-15T21:53:37.876 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T21:53:37.889 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-15T21:53:38.014 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T21:53:38.188 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-15T21:53:38.216 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T21:53:38.246 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T21:53:38.487 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-15T21:53:38.516 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-15T21:53:38.557 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-15T21:53:38.561 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T21:53:38.584 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T21:53:38.623 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T21:53:38.868 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-15T21:53:38.896 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T21:53:38.897 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-15T21:53:38.926 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-15T21:53:38.934 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T21:53:38.972 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T21:53:39.309 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-15T21:53:39.338 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-15T21:53:39.376 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T21:53:39.416 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-15T21:53:39.441 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-15T21:53:39.480 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T21:53:39.653 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-15T21:53:39.682 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-15T21:53:39.728 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T21:53:39.842 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package modemmanager. 2024-09-15T21:53:39.869 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T21:53:39.908 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T21:53:40.031 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libjson-perl. 2024-09-15T21:53:40.060 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-15T21:53:40.106 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-15T21:53:40.426 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-15T21:53:40.454 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-15T21:53:40.492 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T21:53:40.624 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package network-manager. 2024-09-15T21:53:40.651 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T21:53:40.699 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-15T21:53:41.307 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ppp. 2024-09-15T21:53:41.334 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-15T21:53:41.600 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T21:53:41.922 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package pptp-linux. 2024-09-15T21:53:41.950 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-15T21:53:41.989 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-15T21:53:42.170 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-15T21:53:42.198 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T21:53:42.233 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-15T21:53:42.237 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T21:53:42.249 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-15T21:53:42.292 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-15T21:53:42.489 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-15T21:53:42.506 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T21:53:42.548 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T21:53:42.595 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-15T21:53:42.622 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-15T21:53:42.661 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-client-common (238) ... 2024-09-15T21:53:42.943 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-15T21:53:42.948 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-15T21:53:42.971 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T21:53:42.976 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T21:53:43.015 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T21:53:43.017 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T21:53:43.437 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-15T21:53:43.466 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-15T21:53:43.537 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-common. 2024-09-15T21:53:43.565 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-15T21:53:43.622 INFO:teuthology.orchestra.run.smithi070.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-15T21:53:43.668 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-common (238) ... 2024-09-15T21:53:43.775 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T21:53:44.128 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-14. 2024-09-15T21:53:44.156 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T21:53:44.198 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T21:53:44.258 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-15T21:53:44.287 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T21:53:44.333 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T21:53:44.761 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-15T21:53:44.789 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T21:53:44.836 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T21:53:45.181 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-15T21:53:45.209 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T21:53:45.255 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T21:53:45.473 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql. 2024-09-15T21:53:45.489 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-15T21:53:45.523 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql (14+238) ... 2024-09-15T21:53:45.567 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-15T21:53:45.595 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T21:53:45.641 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T21:53:45.809 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-client. 2024-09-15T21:53:45.825 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-15T21:53:45.867 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-client (14+238) ... 2024-09-15T21:53:45.927 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-15T21:53:45.953 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T21:53:46.002 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T21:53:46.111 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-15T21:53:46.139 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-15T21:53:46.177 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-15T21:53:46.489 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-15T21:53:46.497 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package tcl8.6. 2024-09-15T21:53:46.517 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-15T21:53:46.525 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-15T21:53:46.555 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T21:53:46.556 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T21:53:46.800 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package tcl. 2024-09-15T21:53:46.828 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-15T21:53:46.871 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-15T21:53:46.976 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package modemmanager. 2024-09-15T21:53:47.004 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T21:53:47.050 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T21:53:47.219 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package wpasupplicant. 2024-09-15T21:53:47.248 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-15T21:53:47.286 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T21:53:47.632 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-15T21:53:47.660 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-15T21:53:47.690 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-15T21:53:47.824 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package network-manager. 2024-09-15T21:53:47.852 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T21:53:47.900 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-15T21:53:48.002 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-15T21:53:48.030 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-15T21:53:48.078 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T21:53:48.398 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-client-common (238) ... 2024-09-15T21:53:48.507 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package ppp. 2024-09-15T21:53:48.535 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-15T21:53:48.617 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-15T21:53:48.743 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T21:53:48.817 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T21:53:48.869 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T21:53:48.995 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T21:53:49.105 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T21:53:49.205 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T21:53:49.346 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package pptp-linux. 2024-09-15T21:53:49.375 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-15T21:53:49.421 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-15T21:53:49.680 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-15T21:53:49.690 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-15T21:53:49.707 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-15T21:53:49.748 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-15T21:53:49.761 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T21:53:50.052 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-15T21:53:50.080 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-15T21:53:50.126 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking postgresql-client-common (238) ... 2024-09-15T21:53:50.131 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T21:53:50.131 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T21:53:50.430 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-15T21:53:50.459 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T21:53:50.497 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T21:53:50.631 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T21:53:50.757 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T21:53:50.893 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T21:53:51.018 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-15T21:53:51.110 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package postgresql-common. 2024-09-15T21:53:51.138 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-15T21:53:51.144 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T21:53:51.196 INFO:teuthology.orchestra.run.smithi001.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-15T21:53:51.225 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking postgresql-common (238) ... 2024-09-15T21:53:51.270 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T21:53:51.387 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T21:53:51.488 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T21:53:51.634 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package postgresql-14. 2024-09-15T21:53:51.662 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T21:53:51.695 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T21:53:52.178 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T21:53:52.304 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up dump (0.4b47-3) ... 2024-09-15T21:53:52.381 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-15T21:53:52.439 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T21:53:52.648 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T21:53:52.791 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-15T21:53:52.917 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-15T21:53:53.043 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T21:53:53.045 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package postgresql. 2024-09-15T21:53:53.075 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-15T21:53:53.128 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking postgresql (14+238) ... 2024-09-15T21:53:53.133 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-15T21:53:53.203 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T21:53:53.329 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T21:53:53.422 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package postgresql-client. 2024-09-15T21:53:53.452 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-15T21:53:53.472 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T21:53:53.497 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking postgresql-client (14+238) ... 2024-09-15T21:53:53.573 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T21:53:53.708 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-15T21:53:53.791 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-15T21:53:53.820 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-15T21:53:53.857 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-15T21:53:53.884 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-client (14+238) ... 2024-09-15T21:53:54.010 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-15T21:53:54.177 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package tcl8.6. 2024-09-15T21:53:54.206 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-15T21:53:54.243 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T21:53:54.473 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:53:54.473 INFO:teuthology.orchestra.run.smithi070.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-15T21:53:54.473 INFO:teuthology.orchestra.run.smithi070.stdout:which means they are currently configured by ifupdown: 2024-09-15T21:53:54.473 INFO:teuthology.orchestra.run.smithi070.stdout:- enp3s0f1 2024-09-15T21:53:54.473 INFO:teuthology.orchestra.run.smithi070.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-15T21:53:54.473 INFO:teuthology.orchestra.run.smithi070.stdout:remove their configuration from /etc/network/interfaces. 2024-09-15T21:53:54.474 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:53:54.529 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package tcl. 2024-09-15T21:53:54.558 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-15T21:53:54.586 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-15T21:53:54.601 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-15T21:53:54.892 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-15T21:53:54.949 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package wpasupplicant. 2024-09-15T21:53:54.978 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-15T21:53:55.015 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T21:53:55.228 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-15T21:53:55.345 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-15T21:53:55.373 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-15T21:53:55.411 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-15T21:53:55.731 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T21:53:55.790 INFO:teuthology.orchestra.run.smithi001.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-15T21:53:55.818 INFO:teuthology.orchestra.run.smithi001.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-15T21:53:55.865 INFO:teuthology.orchestra.run.smithi001.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T21:53:56.009 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T21:53:56.161 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up postgresql-client-common (238) ... 2024-09-15T21:53:56.236 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-15T21:53:56.420 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-15T21:53:56.435 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-common (238) ... 2024-09-15T21:53:56.571 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T21:53:56.722 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T21:53:56.873 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T21:53:57.008 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T21:53:57.142 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T21:53:57.674 INFO:teuthology.orchestra.run.smithi001.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-15T21:53:57.765 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T21:53:57.872 INFO:teuthology.orchestra.run.smithi070.stdout:Adding user postgres to group ssl-cert 2024-09-15T21:53:58.100 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:53:58.100 INFO:teuthology.orchestra.run.smithi070.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-15T21:53:58.151 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T21:53:58.151 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T21:53:58.301 INFO:teuthology.orchestra.run.smithi070.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-15T21:53:58.301 INFO:teuthology.orchestra.run.smithi070.stdout:Removing obsolete dictionary files: 2024-09-15T21:53:58.667 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T21:53:58.801 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T21:53:58.873 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-15T21:53:58.936 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T21:53:59.229 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T21:53:59.262 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-15T21:53:59.548 INFO:teuthology.orchestra.run.smithi070.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-15T21:53:59.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-15T21:53:59.601 INFO:teuthology.orchestra.run.smithi070.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-15T21:53:59.601 INFO:teuthology.orchestra.run.smithi070.stdout:This user must also own the server process. 2024-09-15T21:53:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:53:59.601 INFO:teuthology.orchestra.run.smithi070.stdout:The database cluster will be initialized with locale "en_US". 2024-09-15T21:53:59.601 INFO:teuthology.orchestra.run.smithi070.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-15T21:53:59.601 INFO:teuthology.orchestra.run.smithi070.stdout:The default text search configuration will be set to "english". 2024-09-15T21:53:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:53:59.601 INFO:teuthology.orchestra.run.smithi070.stdout:Data page checksums are disabled. 2024-09-15T21:53:59.601 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:53:59.602 INFO:teuthology.orchestra.run.smithi070.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-15T21:53:59.602 INFO:teuthology.orchestra.run.smithi070.stdout:creating subdirectories ... ok 2024-09-15T21:53:59.602 INFO:teuthology.orchestra.run.smithi070.stdout:selecting dynamic shared memory implementation ... posix 2024-09-15T21:53:59.617 INFO:teuthology.orchestra.run.smithi070.stdout:selecting default max_connections ... 100 2024-09-15T21:53:59.636 INFO:teuthology.orchestra.run.smithi070.stdout:selecting default shared_buffers ... 128MB 2024-09-15T21:53:59.645 INFO:teuthology.orchestra.run.smithi070.stdout:selecting default time zone ... Etc/UTC 2024-09-15T21:53:59.646 INFO:teuthology.orchestra.run.smithi070.stdout:creating configuration files ... ok 2024-09-15T21:53:59.655 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T21:53:59.759 INFO:teuthology.orchestra.run.smithi070.stdout:running bootstrap script ... ok 2024-09-15T21:53:59.806 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T21:53:59.957 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T21:54:00.083 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T21:54:00.391 INFO:teuthology.orchestra.run.smithi070.stdout:performing post-bootstrap initialization ... ok 2024-09-15T21:54:00.763 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T21:54:00.889 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up dump (0.4b47-3) ... 2024-09-15T21:54:00.976 INFO:teuthology.orchestra.run.smithi001.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-15T21:54:01.005 INFO:teuthology.orchestra.run.smithi070.stdout:syncing data to disk ... ok 2024-09-15T21:54:01.032 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T21:54:01.134 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T21:54:01.260 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-15T21:54:01.386 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-15T21:54:01.387 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-15T21:54:01.512 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T21:54:01.602 INFO:teuthology.orchestra.run.smithi001.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-15T21:54:01.680 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T21:54:01.831 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T21:54:02.032 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T21:54:02.158 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T21:54:02.303 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-15T21:54:02.513 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up postgresql-client (14+238) ... 2024-09-15T21:54:02.672 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-15T21:54:03.197 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:03.197 INFO:teuthology.orchestra.run.smithi001.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-15T21:54:03.197 INFO:teuthology.orchestra.run.smithi001.stdout:which means they are currently configured by ifupdown: 2024-09-15T21:54:03.197 INFO:teuthology.orchestra.run.smithi001.stdout:- ens1f0 2024-09-15T21:54:03.197 INFO:teuthology.orchestra.run.smithi001.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-15T21:54:03.197 INFO:teuthology.orchestra.run.smithi001.stdout:remove their configuration from /etc/network/interfaces. 2024-09-15T21:54:03.197 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:03.323 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-15T21:54:03.673 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-15T21:54:04.001 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-15T21:54:04.129 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T21:54:04.255 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-15T21:54:04.381 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql (14+238) ... 2024-09-15T21:54:04.483 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T21:54:04.507 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T21:54:04.626 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T21:54:04.633 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T21:54:04.794 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-15T21:54:04.881 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T21:54:04.882 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T21:54:04.920 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up postgresql-common (238) ... 2024-09-15T21:54:05.445 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T21:54:05.537 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-15T21:54:05.823 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T21:54:05.839 INFO:teuthology.orchestra.run.smithi001.stdout:Adding user postgres to group ssl-cert 2024-09-15T21:54:05.966 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T21:54:06.050 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:06.050 INFO:teuthology.orchestra.run.smithi001.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-15T21:54:06.247 INFO:teuthology.orchestra.run.smithi001.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-15T21:54:06.247 INFO:teuthology.orchestra.run.smithi001.stdout:Removing obsolete dictionary files: 2024-09-15T21:54:06.791 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-15T21:54:07.068 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-15T21:54:07.168 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T21:54:07.171 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T21:54:07.506 INFO:teuthology.orchestra.run.smithi001.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-15T21:54:07.534 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-15T21:54:07.575 INFO:teuthology.orchestra.run.smithi001.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-15T21:54:07.575 INFO:teuthology.orchestra.run.smithi001.stdout:This user must also own the server process. 2024-09-15T21:54:07.575 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:07.575 INFO:teuthology.orchestra.run.smithi001.stdout:The database cluster will be initialized with locale "en_US". 2024-09-15T21:54:07.576 INFO:teuthology.orchestra.run.smithi001.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-15T21:54:07.576 INFO:teuthology.orchestra.run.smithi001.stdout:The default text search configuration will be set to "english". 2024-09-15T21:54:07.576 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:07.576 INFO:teuthology.orchestra.run.smithi001.stdout:Data page checksums are disabled. 2024-09-15T21:54:07.576 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:07.576 INFO:teuthology.orchestra.run.smithi001.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-15T21:54:07.576 INFO:teuthology.orchestra.run.smithi001.stdout:creating subdirectories ... ok 2024-09-15T21:54:07.576 INFO:teuthology.orchestra.run.smithi001.stdout:selecting dynamic shared memory implementation ... posix 2024-09-15T21:54:07.592 INFO:teuthology.orchestra.run.smithi001.stdout:selecting default max_connections ... 100 2024-09-15T21:54:07.614 INFO:teuthology.orchestra.run.smithi001.stdout:selecting default shared_buffers ... 128MB 2024-09-15T21:54:07.626 INFO:teuthology.orchestra.run.smithi001.stdout:selecting default time zone ... Etc/UTC 2024-09-15T21:54:07.627 INFO:teuthology.orchestra.run.smithi001.stdout:creating configuration files ... ok 2024-09-15T21:54:07.708 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T21:54:07.714 DEBUG:teuthology.parallel:result is None 2024-09-15T21:54:07.745 INFO:teuthology.orchestra.run.smithi001.stdout:running bootstrap script ... ok 2024-09-15T21:54:08.402 INFO:teuthology.orchestra.run.smithi001.stdout:performing post-bootstrap initialization ... ok 2024-09-15T21:54:09.065 INFO:teuthology.orchestra.run.smithi001.stdout:syncing data to disk ... ok 2024-09-15T21:54:09.458 INFO:teuthology.orchestra.run.smithi001.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-15T21:54:12.228 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T21:54:12.354 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-15T21:54:12.480 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up postgresql (14+238) ... 2024-09-15T21:54:12.608 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T21:54:12.732 INFO:teuthology.orchestra.run.smithi001.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T21:54:12.994 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T21:54:12.994 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T21:54:13.534 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T21:54:13.627 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-15T21:54:13.971 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T21:54:14.123 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T21:54:16.084 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-15T21:54:16.184 INFO:teuthology.orchestra.run.smithi001.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T21:54:16.710 INFO:teuthology.orchestra.run.smithi001.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T21:54:16.716 DEBUG:teuthology.parallel:result is None 2024-09-15T21:54:16.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T21:54:16.868 DEBUG:teuthology.orchestra.run.smithi001:> dpkg-query -W -f '${Version}' ceph 2024-09-15T21:54:16.888 INFO:teuthology.orchestra.run.smithi001.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-15T21:54:16.889 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T21:54:16.889 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-15T21:54:16.891 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T21:54:17.033 DEBUG:teuthology.orchestra.run.smithi070:> dpkg-query -W -f '${Version}' ceph 2024-09-15T21:54:17.053 INFO:teuthology.orchestra.run.smithi070.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-15T21:54:17.053 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T21:54:17.053 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-15T21:54:17.055 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T21:54:17.055 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:17.055 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T21:54:17.071 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:17.071 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T21:54:17.110 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T21:54:17.110 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:17.110 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T21:54:17.128 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T21:54:17.183 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:17.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T21:54:17.197 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T21:54:17.252 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T21:54:17.252 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:17.252 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T21:54:17.265 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T21:54:17.319 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:17.319 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T21:54:17.332 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T21:54:17.388 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T21:54:17.388 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:17.388 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T21:54:17.402 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T21:54:17.454 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:17.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T21:54:17.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T21:54:17.524 INFO:teuthology.run_tasks:Running task ceph... 2024-09-15T21:54:17.607 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-15T21:54:17.608 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 777 /var/log/ceph 2024-09-15T21:54:17.610 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2024-09-15T21:54:17.623 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-15T21:54:17.623 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T21:54:17.664 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T21:54:17.676 INFO:tasks.ceph:Creating extra log directories... 2024-09-15T21:54:17.677 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T21:54:17.720 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T21:54:17.738 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-15T21:54:17.738 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-15T21:54:17.738 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-15T21:54:17.738 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:17.738 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T21:54:17.780 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T21:54:17.856 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:17.856 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T21:54:17.862 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T21:54:17.941 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-15T21:54:17.941 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-15T21:54:17.941 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906202', 'branch': 'squid', 'description': 'fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7906202', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 3393, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'sleep_before_teardown': 0, 'subset': '294/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi001.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMp1Bx/OJuXa6xAFNw8Qg0IG+/etQTvovNJd/mqXmUcSUjWoLAssRfrTtWdMExilc6zfYmsdxkyWkAvF9sYy9TQ=', 'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCGa67M8Aujp2ssmovEpjT19XW7V4TKlj1TE4cym0BLIiOEmBxQgtNMTdONXqWawq7Iha1eg1+uLmseCZ0xbsP8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_cephfs_shell']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-15T21:54:17.942 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T21:54:17.944 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T21:54:17.986 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T21:54:17.992 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T21:54:18.041 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:18.041 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T21:54:18.051 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T21:54:18.051 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_1 2024-09-15T21:54:18.099 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T21:54:18.099 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T21:54:18.099 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-15T21:54:18.099 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T21:54:18.100 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-15 21:47:54.707842511 +0000 2024-09-15T21:54:18.100 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-15 21:47:54.703842547 +0000 2024-09-15T21:54:18.100 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-15 21:47:54.703842547 +0000 2024-09-15T21:54:18.100 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: - 2024-09-15T21:54:18.100 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T21:54:18.154 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-15T21:54:18.154 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-15T21:54:18.154 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000301318 s, 1.7 MB/s 2024-09-15T21:54:18.155 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T21:54:18.205 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_2 2024-09-15T21:54:18.255 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T21:54:18.256 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T21:54:18.256 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-15T21:54:18.256 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T21:54:18.256 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-15 21:47:55.487835544 +0000 2024-09-15T21:54:18.256 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-15 21:47:55.219837938 +0000 2024-09-15T21:54:18.256 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-15 21:47:55.219837938 +0000 2024-09-15T21:54:18.256 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: - 2024-09-15T21:54:18.256 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T21:54:18.310 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-15T21:54:18.310 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-15T21:54:18.310 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000262503 s, 2.0 MB/s 2024-09-15T21:54:18.311 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T21:54:18.361 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_3 2024-09-15T21:54:18.413 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T21:54:18.413 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T21:54:18.414 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-15T21:54:18.414 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T21:54:18.414 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-15 21:47:55.955831364 +0000 2024-09-15T21:54:18.414 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-15 21:47:55.703833615 +0000 2024-09-15T21:54:18.414 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-15 21:47:55.703833615 +0000 2024-09-15T21:54:18.414 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: - 2024-09-15T21:54:18.414 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T21:54:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-15T21:54:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-15T21:54:18.466 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000310632 s, 1.6 MB/s 2024-09-15T21:54:18.467 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T21:54:18.517 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_4 2024-09-15T21:54:18.563 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T21:54:18.563 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T21:54:18.563 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 943 Links: 1 2024-09-15T21:54:18.563 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T21:54:18.563 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-15 21:47:56.575825826 +0000 2024-09-15T21:54:18.563 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-15 21:47:56.291828362 +0000 2024-09-15T21:54:18.564 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-15 21:47:56.291828362 +0000 2024-09-15T21:54:18.564 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: - 2024-09-15T21:54:18.564 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T21:54:18.618 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-15T21:54:18.618 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-15T21:54:18.618 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000312317 s, 1.6 MB/s 2024-09-15T21:54:18.619 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T21:54:18.669 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T21:54:18.669 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:18.669 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T21:54:18.675 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T21:54:18.675 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-09-15T21:54:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T21:54:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T21:54:18.722 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-15T21:54:18.722 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T21:54:18.722 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-15 21:47:48.429305612 +0000 2024-09-15T21:54:18.722 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-15 21:47:48.425305648 +0000 2024-09-15T21:54:18.722 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-15 21:47:48.425305648 +0000 2024-09-15T21:54:18.722 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-15T21:54:18.723 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T21:54:18.776 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-15T21:54:18.776 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-15T21:54:18.776 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000317485 s, 1.6 MB/s 2024-09-15T21:54:18.777 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T21:54:18.827 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-09-15T21:54:18.873 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T21:54:18.873 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T21:54:18.873 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-15T21:54:18.873 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T21:54:18.873 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-15 21:47:49.213298627 +0000 2024-09-15T21:54:18.873 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-15 21:47:48.921301229 +0000 2024-09-15T21:54:18.874 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-15 21:47:48.921301229 +0000 2024-09-15T21:54:18.874 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-15T21:54:18.874 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T21:54:18.926 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-15T21:54:18.927 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-15T21:54:18.927 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000197448 s, 2.6 MB/s 2024-09-15T21:54:18.928 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T21:54:18.977 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-09-15T21:54:19.025 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T21:54:19.025 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T21:54:19.026 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-15T21:54:19.026 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T21:54:19.026 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-15 21:47:49.705294242 +0000 2024-09-15T21:54:19.026 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-15 21:47:49.445296560 +0000 2024-09-15T21:54:19.026 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-15 21:47:49.445296560 +0000 2024-09-15T21:54:19.026 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-15T21:54:19.026 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T21:54:19.079 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-15T21:54:19.079 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-15T21:54:19.079 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000309548 s, 1.7 MB/s 2024-09-15T21:54:19.080 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T21:54:19.130 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-09-15T21:54:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T21:54:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T21:54:19.177 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 943 Links: 1 2024-09-15T21:54:19.177 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T21:54:19.177 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-15 21:47:50.189289931 +0000 2024-09-15T21:54:19.177 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-15 21:47:49.937292175 +0000 2024-09-15T21:54:19.177 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-15 21:47:49.937292175 +0000 2024-09-15T21:54:19.177 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-15T21:54:19.178 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T21:54:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-15T21:54:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-15T21:54:19.232 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000318552 s, 1.6 MB/s 2024-09-15T21:54:19.233 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T21:54:19.283 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T21:54:19.283 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi001.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T21:54:19.283 INFO:tasks.ceph:Generating config... 2024-09-15T21:54:19.285 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-15T21:54:19.286 INFO:tasks.ceph:[client] debug client = 20 2024-09-15T21:54:19.286 INFO:tasks.ceph:[client] debug ms = 1 2024-09-15T21:54:19.286 INFO:tasks.ceph:[client] pid file = 2024-09-15T21:54:19.286 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-15T21:54:19.286 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-15T21:54:19.287 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-15T21:54:19.287 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-15T21:54:19.287 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-15T21:54:19.287 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-15T21:54:19.287 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-15T21:54:19.287 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-15T21:54:19.288 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-15T21:54:19.288 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-15T21:54:19.288 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-15T21:54:19.288 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-15T21:54:19.288 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-15T21:54:19.288 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-15T21:54:19.289 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-15T21:54:19.289 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-15T21:54:19.289 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-15T21:54:19.289 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-15T21:54:19.289 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-15T21:54:19.289 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-15T21:54:19.289 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-15T21:54:19.290 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-15T21:54:19.290 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-15T21:54:19.290 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-15T21:54:19.290 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-15T21:54:19.290 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-15T21:54:19.290 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-15T21:54:19.291 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-15T21:54:19.291 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-15T21:54:19.291 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-15T21:54:19.291 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-15T21:54:19.291 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-15T21:54:19.291 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-15T21:54:19.292 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-15T21:54:19.292 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-15T21:54:19.292 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-15T21:54:19.292 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-15T21:54:19.292 INFO:tasks.ceph:Setting up mon.a... 2024-09-15T21:54:19.293 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-15T21:54:19.329 INFO:teuthology.orchestra.run.smithi001.stdout:creating /etc/ceph/ceph.keyring 2024-09-15T21:54:19.343 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-15T21:54:19.425 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T21:54:19.479 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.1'), ('mon.b', '172.21.15.70'), ('mon.c', '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]')] 2024-09-15T21:54:19.480 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.1,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-15T21:54:19.480 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:19.481 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T21:54:19.527 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.1 --add b 172.21.15.70 --addv c '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:19.614 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:19.614 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: generated fsid a77d0aed-4b44-4b66-9239-aae9fcdd297c 2024-09-15T21:54:19.614 INFO:teuthology.orchestra.run.smithi001.stdout:setting min_mon_release = quincy 2024-09-15T21:54:19.614 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 0 2024-09-15T21:54:19.615 INFO:teuthology.orchestra.run.smithi001.stdout:fsid a77d0aed-4b44-4b66-9239-aae9fcdd297c 2024-09-15T21:54:19.615 INFO:teuthology.orchestra.run.smithi001.stdout:last_changed 2024-09-15T21:54:19.615424+0000 2024-09-15T21:54:19.615 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-15T21:54:19.615424+0000 2024-09-15T21:54:19.615 INFO:teuthology.orchestra.run.smithi001.stdout:min_mon_release 17 (quincy) 2024-09-15T21:54:19.615 INFO:teuthology.orchestra.run.smithi001.stdout:election_strategy: 1 2024-09-15T21:54:19.615 INFO:teuthology.orchestra.run.smithi001.stdout:0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-15T21:54:19.615 INFO:teuthology.orchestra.run.smithi001.stdout:1: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.b 2024-09-15T21:54:19.615 INFO:teuthology.orchestra.run.smithi001.stdout:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2024-09-15T21:54:19.615 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-15T21:54:19.616 DEBUG:teuthology.orchestra.run.smithi001:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T21:54:19.664 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a77d0aed-4b44-4b66-9239-aae9fcdd297c... 2024-09-15T21:54:19.665 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T21:54:19.708 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T21:54:19.738 INFO:teuthology.orchestra.run.smithi001.stdout:[global] 2024-09-15T21:54:19.738 INFO:teuthology.orchestra.run.smithi001.stdout: chdir = "" 2024-09-15T21:54:19.738 INFO:teuthology.orchestra.run.smithi001.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T21:54:19.738 INFO:teuthology.orchestra.run.smithi001.stdout: auth supported = cephx 2024-09-15T21:54:19.738 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.738 INFO:teuthology.orchestra.run.smithi001.stdout: filestore xattr use omap = true 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: mon clock drift allowed = 1.000 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: osd crush chooseleaf type = 0 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: auth debug = true 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: ms die on old message = true 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: ms die on bug = true 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: mon pg warn max object skew = 0 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T21:54:19.739 INFO:teuthology.orchestra.run.smithi001.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T21:54:19.740 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.740 INFO:teuthology.orchestra.run.smithi001.stdout: osd pool default size = 2 2024-09-15T21:54:19.740 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.740 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd allow primary affinity = true 2024-09-15T21:54:19.740 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd allow pg remap = true 2024-09-15T21:54:19.740 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on legacy crush tunables = false 2024-09-15T21:54:19.740 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on crush straw calc version zero = false 2024-09-15T21:54:19.740 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on no sortbitwise = false 2024-09-15T21:54:19.740 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on osd down out interval zero = false 2024-09-15T21:54:19.740 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on too few osds = false 2024-09-15T21:54:19.740 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T21:54:19.740 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T21:54:19.740 INFO:teuthology.orchestra.run.smithi001.stdout: mon_allow_pool_size_one = true 2024-09-15T21:54:19.741 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.741 INFO:teuthology.orchestra.run.smithi001.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T21:54:19.741 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.741 INFO:teuthology.orchestra.run.smithi001.stdout: osd default data pool replay window = 5 2024-09-15T21:54:19.741 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.741 INFO:teuthology.orchestra.run.smithi001.stdout: mon allow pool delete = true 2024-09-15T21:54:19.741 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.741 INFO:teuthology.orchestra.run.smithi001.stdout: mon cluster log file level = debug 2024-09-15T21:54:19.741 INFO:teuthology.orchestra.run.smithi001.stdout: debug asserts on shutdown = true 2024-09-15T21:54:19.741 INFO:teuthology.orchestra.run.smithi001.stdout: mon health detail to clog = false 2024-09-15T21:54:19.741 INFO:teuthology.orchestra.run.smithi001.stdout: mon host = "172.21.15.1,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]" 2024-09-15T21:54:19.741 INFO:teuthology.orchestra.run.smithi001.stdout: fsid = a77d0aed-4b44-4b66-9239-aae9fcdd297c 2024-09-15T21:54:19.741 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout:[osd] 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout: osd journal size = 100 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout: osd scrub load threshold = 5.0 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout: osd scrub max interval = 600 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout: osd mclock profile = high_recovery_ops 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout: osd recover clone overlap = true 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout: osd recovery max chunk = 1048576 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug shutdown = true 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug op order = true 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug verify stray on activate = true 2024-09-15T21:54:19.742 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug trim objects = true 2024-09-15T21:54:19.743 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.743 INFO:teuthology.orchestra.run.smithi001.stdout: osd open classes on start = true 2024-09-15T21:54:19.743 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug pg log writeout = true 2024-09-15T21:54:19.743 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.743 INFO:teuthology.orchestra.run.smithi001.stdout: osd deep scrub update digest min age = 30 2024-09-15T21:54:19.743 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.743 INFO:teuthology.orchestra.run.smithi001.stdout: osd map max advance = 10 2024-09-15T21:54:19.743 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.743 INFO:teuthology.orchestra.run.smithi001.stdout: journal zero on create = true 2024-09-15T21:54:19.743 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.743 INFO:teuthology.orchestra.run.smithi001.stdout: filestore ondisk finisher threads = 3 2024-09-15T21:54:19.744 INFO:teuthology.orchestra.run.smithi001.stdout: filestore apply finisher threads = 3 2024-09-15T21:54:19.744 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.744 INFO:teuthology.orchestra.run.smithi001.stdout: bdev debug aio = true 2024-09-15T21:54:19.744 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug misdirected ops = true 2024-09-15T21:54:19.744 INFO:teuthology.orchestra.run.smithi001.stdout: bdev async discard = True 2024-09-15T21:54:19.744 INFO:teuthology.orchestra.run.smithi001.stdout: bdev enable discard = True 2024-09-15T21:54:19.744 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore allocator = bitmap 2024-09-15T21:54:19.744 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore block size = 96636764160 2024-09-15T21:54:19.744 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore fsck on mount = True 2024-09-15T21:54:19.745 INFO:teuthology.orchestra.run.smithi001.stdout: debug bluefs = 1/20 2024-09-15T21:54:19.745 INFO:teuthology.orchestra.run.smithi001.stdout: debug bluestore = 1/20 2024-09-15T21:54:19.745 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-09-15T21:54:19.745 INFO:teuthology.orchestra.run.smithi001.stdout: debug osd = 20 2024-09-15T21:54:19.745 INFO:teuthology.orchestra.run.smithi001.stdout: debug rocksdb = 4/10 2024-09-15T21:54:19.745 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T21:54:19.745 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd full ratio = 0.9 2024-09-15T21:54:19.745 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd nearfull ratio = 0.8 2024-09-15T21:54:19.745 INFO:teuthology.orchestra.run.smithi001.stdout: osd failsafe full ratio = 0.95 2024-09-15T21:54:19.745 INFO:teuthology.orchestra.run.smithi001.stdout: osd objectstore = bluestore 2024-09-15T21:54:19.745 INFO:teuthology.orchestra.run.smithi001.stdout: osd op complaint time = 180 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr] 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout: debug mgr = 20 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout: debug mon = 20 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout: debug auth = 20 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min pgs per osd = 4 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min bytes per osd = 10 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout: mgr/telemetry/nag = false 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout: debug client = 20 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout:[mon] 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-09-15T21:54:19.746 INFO:teuthology.orchestra.run.smithi001.stdout: debug mon = 20 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: debug paxos = 20 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: debug auth = 20 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: mon data avail warn = 5 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: mon mgr mkfs grace = 240 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min pgs per osd = 4 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd reporter subtree level = osd 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd prime pg temp = true 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min bytes per osd = 10 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.747 INFO:teuthology.orchestra.run.smithi001.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T21:54:19.748 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T21:54:19.748 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T21:54:19.748 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.748 INFO:teuthology.orchestra.run.smithi001.stdout: # 1m isn't quite enough 2024-09-15T21:54:19.748 INFO:teuthology.orchestra.run.smithi001.stdout: mon_down_mkfs_grace = 2m 2024-09-15T21:54:19.748 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.748 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_filestore_osds = false 2024-09-15T21:54:19.748 INFO:teuthology.orchestra.run.smithi001.stdout: mon down mkfs grace = 300 2024-09-15T21:54:19.748 INFO:teuthology.orchestra.run.smithi001.stdout: mon op complaint time = 120 2024-09-15T21:54:19.748 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on pool no app = False 2024-09-15T21:54:19.748 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:19.748 INFO:teuthology.orchestra.run.smithi001.stdout:[client] 2024-09-15T21:54:19.748 INFO:teuthology.orchestra.run.smithi001.stdout: rgw cache enabled = true 2024-09-15T21:54:19.749 INFO:teuthology.orchestra.run.smithi001.stdout: rgw enable ops log = true 2024-09-15T21:54:19.749 INFO:teuthology.orchestra.run.smithi001.stdout: rgw enable usage log = true 2024-09-15T21:54:19.749 INFO:teuthology.orchestra.run.smithi001.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T21:54:19.749 INFO:teuthology.orchestra.run.smithi001.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T21:54:19.749 INFO:teuthology.orchestra.run.smithi001.stdout: client mount timeout = 600 2024-09-15T21:54:19.749 INFO:teuthology.orchestra.run.smithi001.stdout: debug client = 20 2024-09-15T21:54:19.749 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-09-15T21:54:19.749 INFO:teuthology.orchestra.run.smithi001.stdout: pid file = "" 2024-09-15T21:54:19.749 INFO:teuthology.orchestra.run.smithi001.stdout: rados mon op timeout = 900 2024-09-15T21:54:19.749 INFO:teuthology.orchestra.run.smithi001.stdout: rados osd op timeout = 900 2024-09-15T21:54:19.749 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.a] 2024-09-15T21:54:19.750 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.b] 2024-09-15T21:54:19.750 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.c] 2024-09-15T21:54:19.750 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a] 2024-09-15T21:54:19.750 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b] 2024-09-15T21:54:19.750 INFO:teuthology.orchestra.run.smithi001.stdout:[mds] 2024-09-15T21:54:19.750 INFO:teuthology.orchestra.run.smithi001.stdout: debug mds = 20 2024-09-15T21:54:19.750 INFO:teuthology.orchestra.run.smithi001.stdout: debug mds balancer = 20 2024-09-15T21:54:19.750 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-09-15T21:54:19.750 INFO:teuthology.orchestra.run.smithi001.stdout: mds debug frag = True 2024-09-15T21:54:19.750 INFO:teuthology.orchestra.run.smithi001.stdout: mds debug scatterstat = True 2024-09-15T21:54:19.750 INFO:teuthology.orchestra.run.smithi001.stdout: mds op complaint time = 180 2024-09-15T21:54:19.750 INFO:teuthology.orchestra.run.smithi001.stdout: mds verify scatter = True 2024-09-15T21:54:19.750 INFO:teuthology.orchestra.run.smithi001.stdout: osd op complaint time = 180 2024-09-15T21:54:19.751 INFO:teuthology.orchestra.run.smithi001.stdout: rados mon op timeout = 900 2024-09-15T21:54:19.751 INFO:teuthology.orchestra.run.smithi001.stdout: rados osd op timeout = 900 2024-09-15T21:54:19.752 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-09-15T21:54:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-09-15T21:54:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T21:54:19.752 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-09-15T21:54:19.753 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T21:54:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T21:54:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-09-15T21:54:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-09-15T21:54:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-09-15T21:54:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-09-15T21:54:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-09-15T21:54:19.754 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-09-15T21:54:19.755 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.1,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]" 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = a77d0aed-4b44-4b66-9239-aae9fcdd297c 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-09-15T21:54:19.756 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug trim objects = true 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-09-15T21:54:19.757 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: bdev async discard = True 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: bdev enable discard = True 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore allocator = bitmap 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-15T21:54:19.758 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: osd op complaint time = 180 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-15T21:54:19.759 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-15T21:54:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-15T21:54:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-09-15T21:54:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: debug client = 20 2024-09-15T21:54:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.760 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-09-15T21:54:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-15T21:54:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-09-15T21:54:19.760 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-09-15T21:54:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-09-15T21:54:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-09-15T21:54:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-09-15T21:54:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-09-15T21:54:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-09-15T21:54:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-09-15T21:54:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-09-15T21:54:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T21:54:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T21:54:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T21:54:19.761 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: mon down mkfs grace = 300 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: mon op complaint time = 120 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on pool no app = False 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-09-15T21:54:19.762 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: client mount timeout = 600 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: debug client = 20 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = "" 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: rados mon op timeout = 900 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout: rados osd op timeout = 900 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2024-09-15T21:54:19.763 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b] 2024-09-15T21:54:19.764 INFO:teuthology.orchestra.run.smithi070.stdout:[mds] 2024-09-15T21:54:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: debug mds = 20 2024-09-15T21:54:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: debug mds balancer = 20 2024-09-15T21:54:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-09-15T21:54:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: mds debug frag = True 2024-09-15T21:54:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: mds debug scatterstat = True 2024-09-15T21:54:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: mds op complaint time = 180 2024-09-15T21:54:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: mds verify scatter = True 2024-09-15T21:54:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: osd op complaint time = 180 2024-09-15T21:54:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: rados mon op timeout = 900 2024-09-15T21:54:19.764 INFO:teuthology.orchestra.run.smithi070.stdout: rados osd op timeout = 900 2024-09-15T21:54:19.765 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-15T21:54:19.765 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-15T21:54:19.846 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-15T21:54:19.846 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:19.846 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-15T21:54:19.851 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:19.851 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-15T21:54:19.899 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T21:54:19.899 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:19.899 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T21:54:19.899 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T21:54:19.966 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:19.966 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:20.020 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-09-15T21:54:20.021 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:20.021 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T21:54:20.021 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T21:54:20.042 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:20.043 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:20.093 INFO:tasks.ceph:Setting up mon nodes... 2024-09-15T21:54:20.093 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-15T21:54:20.094 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T21:54:20.139 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T21:54:20.142 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T21:54:20.186 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T21:54:20.193 INFO:tasks.ceph:Setting up mds nodes... 2024-09-15T21:54:20.193 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T21:54:20.237 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T21:54:20.240 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-15T21:54:20.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T21:54:20.340 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T21:54:20.343 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-15T21:54:20.396 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-15T21:54:20.397 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T21:54:20.433 INFO:teuthology.orchestra.run.smithi001.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-15T21:54:20.445 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-15T21:54:20.446 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi001.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T21:54:20.446 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-15T21:54:20.500 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T21:54:20.500 INFO:tasks.ceph:role: osd.0 2024-09-15T21:54:20.500 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T21:54:20.500 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T21:54:20.557 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T21:54:20.558 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T21:54:20.558 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T21:54:20.558 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T21:54:20.558 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T21:54:20.558 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2024-09-15T21:54:20.558 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T21:54:20.558 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T21:54:20.558 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T21:54:20.558 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T21:54:20.582 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2024-09-15T21:54:20.583 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2024-09-15T21:54:20.584 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-15T21:54:20.641 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-15T21:54:20.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:54:20.694 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T21:54:20.695 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-15T21:54:20.750 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T21:54:20.750 INFO:tasks.ceph:role: osd.1 2024-09-15T21:54:20.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T21:54:20.751 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T21:54:20.807 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T21:54:20.807 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T21:54:20.807 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T21:54:20.807 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T21:54:20.807 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T21:54:20.808 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2024-09-15T21:54:20.808 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T21:54:20.808 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T21:54:20.808 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T21:54:20.808 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T21:54:20.831 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2024-09-15T21:54:20.833 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2024-09-15T21:54:20.834 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-15T21:54:20.890 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-15T21:54:20.939 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T21:54:20.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:54:20.941 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-15T21:54:20.995 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T21:54:20.995 INFO:tasks.ceph:role: osd.2 2024-09-15T21:54:20.995 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T21:54:20.995 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T21:54:21.051 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T21:54:21.051 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T21:54:21.051 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T21:54:21.051 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T21:54:21.051 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T21:54:21.051 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2024-09-15T21:54:21.051 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T21:54:21.051 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T21:54:21.051 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T21:54:21.051 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T21:54:21.075 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2024-09-15T21:54:21.077 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2024-09-15T21:54:21.077 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-15T21:54:21.135 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-15T21:54:21.188 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T21:54:21.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:54:21.189 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-15T21:54:21.243 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T21:54:21.243 INFO:tasks.ceph:role: osd.3 2024-09-15T21:54:21.243 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T21:54:21.243 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T21:54:21.299 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T21:54:21.299 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T21:54:21.299 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T21:54:21.299 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T21:54:21.300 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T21:54:21.300 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2024-09-15T21:54:21.300 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T21:54:21.300 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T21:54:21.300 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T21:54:21.300 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T21:54:21.323 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2024-09-15T21:54:21.325 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2024-09-15T21:54:21.325 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-15T21:54:21.388 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-15T21:54:21.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:54:21.442 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T21:54:21.442 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:21.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:21.543+0000 7f531829c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-15T21:54:21.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:21.543+0000 7f531829c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-15T21:54:21.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:21.543+0000 7f531829c7c0 -1 bdev(0x565200d11800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-15T21:54:21.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:21.543+0000 7f531829c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-15T21:54:24.924 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-15T21:54:24.939 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:25.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:25.023+0000 7fc71955b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-15T21:54:25.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:25.023+0000 7fc71955b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-15T21:54:25.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:25.023+0000 7fc71955b7c0 -1 bdev(0x556fee555800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-15T21:54:25.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:25.023+0000 7fc71955b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-15T21:54:28.149 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-15T21:54:28.204 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:28.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:28.283+0000 7fcdbf22b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-15T21:54:28.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:28.283+0000 7fcdbf22b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-15T21:54:28.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:28.283+0000 7fcdbf22b7c0 -1 bdev(0x5574c8761800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-15T21:54:28.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:28.287+0000 7fcdbf22b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-15T21:54:31.447 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-15T21:54:31.504 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:31.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:31.587+0000 7f25885fd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-15T21:54:31.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:31.587+0000 7f25885fd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-15T21:54:31.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:31.587+0000 7f25885fd7c0 -1 bdev(0x560cfb1df800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-15T21:54:31.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:31.587+0000 7f25885fd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-15T21:54:34.703 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-15T21:54:34.760 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-15T21:54:34.774 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T21:54:34.775 INFO:tasks.ceph:role: osd.4 2024-09-15T21:54:34.775 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-15T21:54:34.775 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T21:54:34.830 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T21:54:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T21:54:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T21:54:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T21:54:34.830 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T21:54:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-15T21:54:34.830 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T21:54:34.830 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T21:54:34.830 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T21:54:34.830 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T21:54:34.854 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-15T21:54:34.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-15T21:54:34.855 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-15T21:54:34.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-15T21:54:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T21:54:34.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:54:34.963 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-15T21:54:35.016 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T21:54:35.017 INFO:tasks.ceph:role: osd.5 2024-09-15T21:54:35.017 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-15T21:54:35.017 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T21:54:35.073 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T21:54:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T21:54:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T21:54:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T21:54:35.073 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T21:54:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-15T21:54:35.073 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T21:54:35.073 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T21:54:35.073 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T21:54:35.073 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T21:54:35.096 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-15T21:54:35.098 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-15T21:54:35.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-15T21:54:35.157 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-15T21:54:35.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:54:35.209 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T21:54:35.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-15T21:54:35.262 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T21:54:35.262 INFO:tasks.ceph:role: osd.6 2024-09-15T21:54:35.263 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-15T21:54:35.263 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T21:54:35.317 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T21:54:35.318 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T21:54:35.318 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T21:54:35.318 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T21:54:35.318 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T21:54:35.318 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-15T21:54:35.318 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T21:54:35.318 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T21:54:35.318 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T21:54:35.318 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T21:54:35.341 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-15T21:54:35.343 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-15T21:54:35.343 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-15T21:54:35.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-15T21:54:35.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:54:35.455 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T21:54:35.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-15T21:54:35.508 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T21:54:35.508 INFO:tasks.ceph:role: osd.7 2024-09-15T21:54:35.508 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-15T21:54:35.509 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T21:54:35.567 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T21:54:35.567 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T21:54:35.567 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T21:54:35.567 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T21:54:35.567 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T21:54:35.568 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-09-15T21:54:35.568 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T21:54:35.568 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T21:54:35.568 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T21:54:35.568 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T21:54:35.591 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-09-15T21:54:35.593 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-09-15T21:54:35.593 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-15T21:54:35.652 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-15T21:54:35.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:54:35.707 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T21:54:35.708 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:35.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:35.819+0000 7fc9267597c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-15T21:54:35.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:35.819+0000 7fc9267597c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-15T21:54:35.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:35.819+0000 7fc9267597c0 -1 bdev(0x56433218d800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-15T21:54:35.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:35.819+0000 7fc9267597c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-15T21:54:38.961 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-15T21:54:38.975 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:39.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:39.055+0000 7fb07e4187c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-15T21:54:39.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:39.055+0000 7fb07e4187c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-15T21:54:39.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:39.055+0000 7fb07e4187c0 -1 bdev(0x55a06b22d800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-15T21:54:39.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:39.055+0000 7fb07e4187c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-15T21:54:42.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-15T21:54:42.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:42.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:42.359+0000 7fb13b08b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-15T21:54:42.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:42.359+0000 7fb13b08b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-15T21:54:42.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:42.359+0000 7fb13b08b7c0 -1 bdev(0x5637d7cc7800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-15T21:54:42.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:42.359+0000 7fb13b08b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-15T21:54:45.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-15T21:54:45.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:45.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:45.619+0000 7f5a5a4827c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-15T21:54:45.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:45.619+0000 7f5a5a4827c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-15T21:54:45.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:45.619+0000 7f5a5a4827c0 -1 bdev(0x55f44b5bd800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-15T21:54:45.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:45.619+0000 7f5a5a4827c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-15T21:54:47.944 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T21:54:47.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T21:54:48.752 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-15T21:54:48.766 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-15T21:54:48.766 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:48.766 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-15T21:54:48.780 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:48.780 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-15T21:54:48.835 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:48.835 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-15T21:54:48.891 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:48.892 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-15T21:54:48.947 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:48.947 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-15T21:54:49.002 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:49.003 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-15T21:54:49.059 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:49.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-15T21:54:49.074 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:49.074 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-15T21:54:49.128 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:49.128 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-15T21:54:49.184 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:49.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-15T21:54:49.239 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:49.239 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-15T21:54:49.291 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:49.291 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-15T21:54:49.344 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:49.344 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-15T21:54:49.350 INFO:tasks.ceph:Adding keys to all mons... 2024-09-15T21:54:49.350 DEBUG:teuthology.orchestra.run.smithi001:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T21:54:49.392 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T21:54:49.402 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr.y] 2024-09-15T21:54:49.402 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCMV+dmkpNdCBAAT51hidj27L/T0tH5osOpiw== 2024-09-15T21:54:49.402 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a] 2024-09-15T21:54:49.402 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCMV+dmiMI6DhAA5mR3Rtjj5Rkmro25VAMtfQ== 2024-09-15T21:54:49.402 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.0] 2024-09-15T21:54:49.402 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCNV+dm3J6fIBAAFcQf/pmSLuwunpBSg/1Zvg== 2024-09-15T21:54:49.402 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.1] 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCRV+dmLZxwARAANgGZmZ7W4l1b6dhnLojRSg== 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.2] 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCUV+dmJuckERAAgcoMES3RPO+pw/a4AvArIw== 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.3] 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCXV+dmH08fIxAAlAQTReUC89NonjmdPAkSBA== 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr.x] 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCMV+dm8fpUCxAAiOC8+IWnXu62CCGTD9LHug== 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b] 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCMV+dmYW6DFBAAV6+Y0uZwpjZEg1ZfRWdtRg== 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.4] 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCbV+dmAhsZMRAAcBovO3NGlg7zFf8v/mDxXQ== 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.5] 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCfV+dmtG2DAxAAUmbCXixBEeN/e7cGU1U1hg== 2024-09-15T21:54:49.403 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.6] 2024-09-15T21:54:49.404 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCiV+dmyIuqFRAAWBYhQLeROAeqMytd7M8CfA== 2024-09-15T21:54:49.404 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.7] 2024-09-15T21:54:49.404 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQClV+dmjvotJRAAyHoWPQDllt6Po4UurBcf5w== 2024-09-15T21:54:49.404 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2024-09-15T21:54:49.404 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCMV+dmfpbrGRAA5tTriIldy8QYr+dZxosTvQ== 2024-09-15T21:54:49.404 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2024-09-15T21:54:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCMV+dmkpNdCBAAT51hidj27L/T0tH5osOpiw== 2024-09-15T21:54:49.405 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2024-09-15T21:54:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCMV+dmiMI6DhAA5mR3Rtjj5Rkmro25VAMtfQ== 2024-09-15T21:54:49.405 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2024-09-15T21:54:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCNV+dm3J6fIBAAFcQf/pmSLuwunpBSg/1Zvg== 2024-09-15T21:54:49.405 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2024-09-15T21:54:49.405 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCRV+dmLZxwARAANgGZmZ7W4l1b6dhnLojRSg== 2024-09-15T21:54:49.406 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2024-09-15T21:54:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCUV+dmJuckERAAgcoMES3RPO+pw/a4AvArIw== 2024-09-15T21:54:49.406 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.3] 2024-09-15T21:54:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCXV+dmH08fIxAAlAQTReUC89NonjmdPAkSBA== 2024-09-15T21:54:49.406 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2024-09-15T21:54:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCMV+dm8fpUCxAAiOC8+IWnXu62CCGTD9LHug== 2024-09-15T21:54:49.407 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b] 2024-09-15T21:54:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCMV+dmYW6DFBAAV6+Y0uZwpjZEg1ZfRWdtRg== 2024-09-15T21:54:49.407 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.4] 2024-09-15T21:54:49.407 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCbV+dmAhsZMRAAcBovO3NGlg7zFf8v/mDxXQ== 2024-09-15T21:54:49.407 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.5] 2024-09-15T21:54:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCfV+dmtG2DAxAAUmbCXixBEeN/e7cGU1U1hg== 2024-09-15T21:54:49.408 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.6] 2024-09-15T21:54:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCiV+dmyIuqFRAAWBYhQLeROAeqMytd7M8CfA== 2024-09-15T21:54:49.408 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.7] 2024-09-15T21:54:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQClV+dmjvotJRAAyHoWPQDllt6Po4UurBcf5w== 2024-09-15T21:54:49.408 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-09-15T21:54:49.408 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCMV+dmfpbrGRAA5tTriIldy8QYr+dZxosTvQ== 2024-09-15T21:54:49.410 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T21:54:49.452 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T21:54:49.498 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T21:54:49.500 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T21:54:49.546 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:49.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:49.587 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:49.629 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:49.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:49.719 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:49.764 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:49.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:49.847 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T21:54:49.892 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T21:54:49.937 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T21:54:49.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T21:54:50.022 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:50.028 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:50.105 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:50.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:50.189 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:50.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:50.277 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:50.284 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T21:54:50.328 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T21:54:50.330 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T21:54:50.409 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-15T21:54:50.410 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-15T21:54:50.430 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T21:54:50.526 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-15T21:54:50.537 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-15T21:54:50.551 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T21:54:50.642 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-15T21:54:50.652 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-15T21:54:50.708 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T21:54:50.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-15T21:54:50.813 DEBUG:teuthology.orchestra.run.smithi001:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:50.816 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T21:54:50.860 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-15T21:54:50.861 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-15T21:54:50.861 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-15T21:54:50.864 INFO:tasks.ceph.mon.a:Started 2024-09-15T21:54:50.864 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-15T21:54:50.864 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-15T21:54:50.905 INFO:tasks.ceph.mon.b:Started 2024-09-15T21:54:50.906 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-15T21:54:50.906 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-15T21:54:50.908 INFO:tasks.ceph.mon.c:Started 2024-09-15T21:54:50.908 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-15T21:54:50.908 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-15T21:54:50.908 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-15T21:54:50.913 INFO:tasks.ceph.mgr.y:Started 2024-09-15T21:54:50.913 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-15T21:54:50.913 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-15T21:54:50.915 INFO:tasks.ceph.mgr.x:Started 2024-09-15T21:54:50.915 INFO:tasks.ceph:Setting crush tunables to default 2024-09-15T21:54:50.916 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph osd crush tunables default 2024-09-15T21:54:51.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.034+0000 7f59d1082640 1 Processor -- start 2024-09-15T21:54:51.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.034+0000 7f59d1082640 1 -- start start 2024-09-15T21:54:51.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.034+0000 7f59d1082640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:51.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.034+0000 7f59d1082640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59cc072020 con 0x7f59cc06bf20 2024-09-15T21:54:51.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.034+0000 7f59d1082640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59cc06c300 con 0x7f59cc141c30 2024-09-15T21:54:51.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.034+0000 7f59d1082640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f59cc0739e0 con 0x7f59cc1417c0 2024-09-15T21:54:51.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.034+0000 7f59cad9d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f59cc06bf20 0x7f59cc071910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37066/0 (socket says 172.21.15.1:37066) 2024-09-15T21:54:51.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.034+0000 7f59cad9d640 1 -- 172.21.15.1:0/1000455935 learned_addr learned my addr 172.21.15.1:0/1000455935 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:54:51.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.034+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:51.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.034+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 msgr2=0x7f59cc147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T21:54:51.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.034+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 msgr2=0x7f59cc147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T21:54:51.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.034+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T21:54:51.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.034+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T21:54:51.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.238+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:51.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.238+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 msgr2=0x7f59cc147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T21:54:51.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.238+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 msgr2=0x7f59cc147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T21:54:51.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.238+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T21:54:51.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.238+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T21:54:51.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.642+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:51.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.642+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 msgr2=0x7f59cc147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T21:54:51.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.642+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 msgr2=0x7f59cc147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T21:54:51.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.642+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T21:54:51.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:51.642+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T21:54:52.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:52.446+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:52.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:52.446+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 msgr2=0x7f59cc147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T21:54:52.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:52.446+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 msgr2=0x7f59cc147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T21:54:52.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:52.446+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T21:54:52.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:52.446+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T21:54:54.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59c8d99640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 msgr2=0x7f59cc147860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59c8d99640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.70:3300/0 conn(0x7f59cc1417c0 0x7f59cc147860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59c8d99640 1 -- 172.21.15.1:0/1000455935 >> v1:172.21.15.70:6789/0 conn(0x7f59cc141c30 legacy=0x7f59cc1521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59c8d99640 1 -- 172.21.15.1:0/1000455935 >> v1:172.21.15.1:6789/0 conn(0x7f59cc06bf20 legacy=0x7f59cc071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59c8d99640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59c8d99640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59c8d99640 1 -- 172.21.15.1:0/1000455935 --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f59cc0739e0 con 0x7f59b80036d0 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59c8d99640 1 -- 172.21.15.1:0/1000455935 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f59b8008d70 con 0x7f59b8006190 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59cad9d640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59cad9d640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 msgr2=0x7f59b8005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59cad9d640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 msgr2=0x7f59b8005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59cad9d640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 msgr2=0x7f59b8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T21:54:54.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 msgr2=0x7f59b8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T21:54:54.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T21:54:54.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59cad9d640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T21:54:54.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.034+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T21:54:54.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.238+0000 7f59cad9d640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:54.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.238+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:54.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.238+0000 7f59cad9d640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 msgr2=0x7f59b8005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T21:54:54.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.238+0000 7f59cad9d640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 msgr2=0x7f59b8005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T21:54:54.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.238+0000 7f59cad9d640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T21:54:54.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.238+0000 7f59cad9d640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T21:54:54.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.238+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 msgr2=0x7f59b8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T21:54:54.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.238+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 msgr2=0x7f59b8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T21:54:54.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.238+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T21:54:54.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.238+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T21:54:54.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.642+0000 7f59cad9d640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:54.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.642+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.642+0000 7f59cad9d640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 msgr2=0x7f59b8005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T21:54:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.642+0000 7f59cad9d640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 msgr2=0x7f59b8005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T21:54:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.642+0000 7f59cad9d640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T21:54:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.642+0000 7f59cad9d640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T21:54:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.642+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 msgr2=0x7f59b8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T21:54:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.642+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 msgr2=0x7f59b8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T21:54:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.642+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T21:54:54.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:54.642+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T21:54:55.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:55.446+0000 7f59cad9d640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:55.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:55.446+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:55.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:55.446+0000 7f59cad9d640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 msgr2=0x7f59b8005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T21:54:55.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:55.446+0000 7f59cad9d640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 msgr2=0x7f59b8005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T21:54:55.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:55.446+0000 7f59cad9d640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T21:54:55.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:55.446+0000 7f59cad9d640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T21:54:55.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:55.446+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 msgr2=0x7f59b8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T21:54:55.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:55.446+0000 7f59ca59c640 1 -- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 msgr2=0x7f59b8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T21:54:55.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:55.446+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T21:54:55.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:55.446+0000 7f59ca59c640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T21:54:56.525 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:56.522+0000 7f5339589180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T21:54:57.002 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:56.998+0000 7f5339589180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T21:54:57.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59c8d99640 1 -- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 msgr2=0x7f59b8008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T21:54:57.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59c8d99640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b8006190 0x7f59b8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59c8d99640 1 -- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 msgr2=0x7f59b8005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T21:54:57.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59c8d99640 1 --2- 172.21.15.1:0/1000455935 >> v2:172.21.15.1:3300/0 conn(0x7f59b80036d0 0x7f59b8005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59cb59e640 1 -- 172.21.15.1:0/1000455935 reap_dead start 2024-09-15T21:54:57.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59c8d99640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b80051d0 0x7f59b8005650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59c8d99640 1 -- 172.21.15.1:0/1000455935 --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59cc0bb1b0 con 0x7f59cc06bf20 2024-09-15T21:54:57.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59c8d99640 1 -- 172.21.15.1:0/1000455935 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59b8005d90 con 0x7f59b8006620 2024-09-15T21:54:57.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59c8d99640 1 -- 172.21.15.1:0/1000455935 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f59cc0739e0 con 0x7f59b80051d0 2024-09-15T21:54:57.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59cb59e640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b80051d0 0x7f59b8005650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59c9d9b640 1 -- 172.21.15.1:0/1000455935 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 299102934 0 0) 0x7f59cc0bb1b0 con 0x7f59cc06bf20 2024-09-15T21:54:57.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59c9d9b640 1 -- 172.21.15.1:0/1000455935 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59b4003530 con 0x7f59cc06bf20 2024-09-15T21:54:57.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59cb59e640 1 -- 172.21.15.1:0/1000455935 >> v1:172.21.15.70:6789/0 conn(0x7f59b8006620 legacy=0x7f59b8003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59c9d9b640 1 -- 172.21.15.1:0/1000455935 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2167250285 0 0) 0x7f59b8005d90 con 0x7f59b8006620 2024-09-15T21:54:57.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59cb59e640 1 -- 172.21.15.1:0/1000455935 >> v1:172.21.15.1:6789/0 conn(0x7f59cc06bf20 legacy=0x7f59b800b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.034+0000 7f59cb59e640 1 -- 172.21.15.1:0/1000455935 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b8010910 con 0x7f59b80051d0 2024-09-15T21:54:57.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.038+0000 7f59cb59e640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b80051d0 0x7f59b8005650 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f59cc1489d0 tx=0x7f59c401c050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d940aa6163e49405 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:57.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.038+0000 7f59c9d9b640 1 -- 172.21.15.1:0/1000455935 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c40a4d20 con 0x7f59b80051d0 2024-09-15T21:54:57.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.038+0000 7f59c9d9b640 1 -- 172.21.15.1:0/1000455935 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c40a8070 con 0x7f59b80051d0 2024-09-15T21:54:57.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.038+0000 7f59c9d9b640 1 -- 172.21.15.1:0/1000455935 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4004260 con 0x7f59b80051d0 2024-09-15T21:54:57.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.038+0000 7f59d1082640 1 -- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b80051d0 msgr2=0x7f59b8005650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.038+0000 7f59d1082640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b80051d0 0x7f59b8005650 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f59cc1489d0 tx=0x7f59c401c050 comp rx=0 tx=0).stop 2024-09-15T21:54:57.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.038+0000 7f59d1082640 1 -- 172.21.15.1:0/1000455935 shutdown_connections 2024-09-15T21:54:57.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.038+0000 7f59d1082640 1 --2- 172.21.15.1:0/1000455935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b80051d0 0x7f59b8005650 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.038+0000 7f59d1082640 1 -- 172.21.15.1:0/1000455935 >> 172.21.15.1:0/1000455935 conn(0x7f59cc0ba370 msgr2=0x7f59cc0ba780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:57.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.038+0000 7f59d1082640 1 -- 172.21.15.1:0/1000455935 shutdown_connections 2024-09-15T21:54:57.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.038+0000 7f59d1082640 1 -- 172.21.15.1:0/1000455935 wait complete. 2024-09-15T21:54:57.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59d1082640 1 Processor -- start 2024-09-15T21:54:57.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59d1082640 1 -- start start 2024-09-15T21:54:57.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59d1082640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b80051d0 0x7f59cc0adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59d1082640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59b8006620 0x7f59cc0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59d1082640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59cc06bf20 0x7f59cc1431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59d1082640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc14b220 con 0x7f59cc06bf20 2024-09-15T21:54:57.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59d1082640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc14b0a0 con 0x7f59b8006620 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59d1082640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f59cc14b3a0 con 0x7f59b80051d0 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59cb59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59cc06bf20 0x7f59cc1431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59cb59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59cc06bf20 0x7f59cc1431b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51824/0 (socket says 172.21.15.1:51824) 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59cb59e640 1 -- 172.21.15.1:0/3331938989 learned_addr learned my addr 172.21.15.1:0/3331938989 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59cad9d640 1 --2- 172.21.15.1:0/3331938989 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b80051d0 0x7f59cc0adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59ca59c640 1 --2- 172.21.15.1:0/3331938989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59b8006620 0x7f59cc0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59cb59e640 1 -- 172.21.15.1:0/3331938989 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b80051d0 msgr2=0x7f59cc0adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59cb59e640 1 --2- 172.21.15.1:0/3331938989 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b80051d0 0x7f59cc0adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59cb59e640 1 -- 172.21.15.1:0/3331938989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59b8006620 msgr2=0x7f59cc0af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59cb59e640 1 --2- 172.21.15.1:0/3331938989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59b8006620 0x7f59cc0af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.042+0000 7f59cb59e640 1 -- 172.21.15.1:0/3331938989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc0b0190 con 0x7f59cc06bf20 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.046+0000 7f59cb59e640 1 --2- 172.21.15.1:0/3331938989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59cc06bf20 0x7f59cc1431b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f59c4000c10 tx=0x7f59c4018df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.046+0000 7f59b37fe640 1 -- 172.21.15.1:0/3331938989 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c40bb070 con 0x7f59cc06bf20 2024-09-15T21:54:57.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.046+0000 7f59b37fe640 1 -- 172.21.15.1:0/3331938989 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c40070c0 con 0x7f59cc06bf20 2024-09-15T21:54:57.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.046+0000 7f59d1082640 1 -- 172.21.15.1:0/3331938989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59cc0b0470 con 0x7f59cc06bf20 2024-09-15T21:54:57.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.046+0000 7f59b37fe640 1 -- 172.21.15.1:0/3331938989 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c40074b0 con 0x7f59cc06bf20 2024-09-15T21:54:57.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.046+0000 7f59d1082640 1 -- 172.21.15.1:0/3331938989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59cc0afc00 con 0x7f59cc06bf20 2024-09-15T21:54:57.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.046+0000 7f59b37fe640 1 -- 172.21.15.1:0/3331938989 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f59c40be070 con 0x7f59cc06bf20 2024-09-15T21:54:57.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.046+0000 7f59b37fe640 1 -- 172.21.15.1:0/3331938989 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f59c4003600 con 0x7f59cc06bf20 2024-09-15T21:54:57.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.046+0000 7f59d1082640 1 -- 172.21.15.1:0/3331938989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59cc072820 con 0x7f59cc06bf20 2024-09-15T21:54:57.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.050+0000 7f59b37fe640 1 -- 172.21.15.1:0/3331938989 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f59c4015dd0 con 0x7f59cc06bf20 2024-09-15T21:54:57.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.114+0000 7f59d1082640 1 -- 172.21.15.1:0/3331938989 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f59cc0afef0 con 0x7f59cc06bf20 2024-09-15T21:54:57.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.114+0000 7f59b37fe640 1 -- 172.21.15.1:0/3331938989 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f59c40c6090 con 0x7f59cc06bf20 2024-09-15T21:54:57.119 INFO:teuthology.orchestra.run.smithi001.stderr:adjusted tunables profile to default 2024-09-15T21:54:57.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.118+0000 7f59d1082640 1 -- 172.21.15.1:0/3331938989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59cc06bf20 msgr2=0x7f59cc1431b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.118+0000 7f59d1082640 1 --2- 172.21.15.1:0/3331938989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59cc06bf20 0x7f59cc1431b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f59c4000c10 tx=0x7f59c4018df0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.118+0000 7f59d1082640 1 -- 172.21.15.1:0/3331938989 shutdown_connections 2024-09-15T21:54:57.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.118+0000 7f59d1082640 1 --2- 172.21.15.1:0/3331938989 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f59cc06bf20 0x7f59cc1431b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.118+0000 7f59d1082640 1 --2- 172.21.15.1:0/3331938989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59b8006620 0x7f59cc0af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.118+0000 7f59d1082640 1 --2- 172.21.15.1:0/3331938989 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f59b80051d0 0x7f59cc0adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.118+0000 7f59d1082640 1 -- 172.21.15.1:0/3331938989 >> 172.21.15.1:0/3331938989 conn(0x7f59cc0ba370 msgr2=0x7f59cc0b8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:57.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.118+0000 7f59d1082640 1 -- 172.21.15.1:0/3331938989 shutdown_connections 2024-09-15T21:54:57.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:57.118+0000 7f59d1082640 1 -- 172.21.15.1:0/3331938989 wait complete. 2024-09-15T21:54:57.136 INFO:tasks.ceph:check_enable_crimson: False 2024-09-15T21:54:57.136 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-15T21:54:57.136 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:57.136 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-15T21:54:57.148 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:57.148 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-15T21:54:57.201 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:57.202 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-15T21:54:57.202 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:57.198+0000 7f5339589180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T21:54:57.257 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:54:57.257 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-15T21:54:57.271 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:57.271+0000 7f3970d6a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T21:54:57.314 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:57.314 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-15T21:54:57.329 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:57.329 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-15T21:54:57.385 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:57.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-15T21:54:57.440 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-15T21:54:57.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-15T21:54:57.495 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new fa48708f-0cb2-4d7b-ad99-83a0e11814b1 0 2024-09-15T21:54:57.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.651+0000 7f9853879640 1 Processor -- start 2024-09-15T21:54:57.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.651+0000 7f9853879640 1 -- start start 2024-09-15T21:54:57.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.651+0000 7f9853879640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f984c0b4d70 0x7f984c144f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.651+0000 7f9853879640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f984c13e340 0x7f984c13e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9853879640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984c1444c0 con 0x7f984c072d50 2024-09-15T21:54:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9853879640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f984c145480 con 0x7f984c13e340 2024-09-15T21:54:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9853879640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f984c074010 con 0x7f984c0b4d70 2024-09-15T21:54:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9850e14640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f984c0b4d70 0x7f984c144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9850e14640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f984c0b4d70 0x7f984c144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36888/0 (socket says 172.21.15.70:36888) 2024-09-15T21:54:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9850e14640 1 -- 172.21.15.70:0/3647873421 learned_addr learned my addr 172.21.15.70:0/3647873421 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9851e16640 1 --2- 172.21.15.70:0/3647873421 >> v2:172.21.15.1:3300/0 conn(0x7f984c13e340 0x7f984c13e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9850e14640 1 -- 172.21.15.70:0/3647873421 >> v2:172.21.15.1:3300/0 conn(0x7f984c13e340 msgr2=0x7f984c13e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9850e14640 1 --2- 172.21.15.70:0/3647873421 >> v2:172.21.15.1:3300/0 conn(0x7f984c13e340 0x7f984c13e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9850e14640 1 -- 172.21.15.70:0/3647873421 >> v1:172.21.15.1:6789/0 conn(0x7f984c072d50 legacy=0x7f984c0719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:57.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9850e14640 1 -- 172.21.15.70:0/3647873421 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984c073130 con 0x7f984c0b4d70 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9850e14640 1 --2- 172.21.15.70:0/3647873421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f984c0b4d70 0x7f984c144f40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f984c0b1740 tx=0x7f983c01c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=136c761f9dcc992e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9843fff640 1 -- 172.21.15.70:0/3647873421 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c0b0070 con 0x7f984c0b4d70 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9843fff640 1 -- 172.21.15.70:0/3647873421 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c0ab600 con 0x7f984c0b4d70 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9843fff640 1 -- 172.21.15.70:0/3647873421 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c0ab9d0 con 0x7f984c0b4d70 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.655+0000 7f9853879640 1 -- 172.21.15.70:0/3647873421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f984c0b4d70 msgr2=0x7f984c144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 --2- 172.21.15.70:0/3647873421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f984c0b4d70 0x7f984c144f40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f984c0b1740 tx=0x7f983c01c270 comp rx=0 tx=0).stop 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 -- 172.21.15.70:0/3647873421 shutdown_connections 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 --2- 172.21.15.70:0/3647873421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f984c0b4d70 0x7f984c144f40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 --2- 172.21.15.70:0/3647873421 >> v2:172.21.15.1:3300/0 conn(0x7f984c13e340 0x7f984c13e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 -- 172.21.15.70:0/3647873421 >> 172.21.15.70:0/3647873421 conn(0x7f984c0ba370 msgr2=0x7f984c0ba780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 -- 172.21.15.70:0/3647873421 shutdown_connections 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 -- 172.21.15.70:0/3647873421 wait complete. 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 Processor -- start 2024-09-15T21:54:57.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 -- start start 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c072d50 0x7f984c140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f984c0b4d70 0x7f984c14d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f984c13e340 0x7f984c14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f984c06be40 con 0x7f984c072d50 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f984c06bcc0 con 0x7f984c0b4d70 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f984c06bfc0 con 0x7f984c13e340 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9850e14640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f984c0b4d70 0x7f984c14d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9851e16640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f984c13e340 0x7f984c14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9850e14640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f984c0b4d70 0x7f984c14d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36892/0 (socket says 172.21.15.70:36892) 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9850e14640 1 -- 172.21.15.70:0/1195204608 learned_addr learned my addr 172.21.15.70:0/1195204608 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9851615640 1 --2- 172.21.15.70:0/1195204608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c072d50 0x7f984c140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9850e14640 1 -- 172.21.15.70:0/1195204608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f984c13e340 msgr2=0x7f984c14db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9850e14640 1 --2- 172.21.15.70:0/1195204608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f984c13e340 0x7f984c14db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9850e14640 1 -- 172.21.15.70:0/1195204608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c072d50 msgr2=0x7f984c140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9850e14640 1 --2- 172.21.15.70:0/1195204608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c072d50 0x7f984c140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9850e14640 1 -- 172.21.15.70:0/1195204608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984c141dc0 con 0x7f984c0b4d70 2024-09-15T21:54:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9851e16640 1 --2- 172.21.15.70:0/1195204608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f984c13e340 0x7f984c14db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:54:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9850e14640 1 --2- 172.21.15.70:0/1195204608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f984c0b4d70 0x7f984c14d640 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f983c0ae040 tx=0x7f983c019010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9841ffb640 1 -- 172.21.15.70:0/1195204608 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c0b0040 con 0x7f984c0b4d70 2024-09-15T21:54:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9841ffb640 1 -- 172.21.15.70:0/1195204608 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c0b9070 con 0x7f984c0b4d70 2024-09-15T21:54:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 -- 172.21.15.70:0/1195204608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f984c13ee10 con 0x7f984c0b4d70 2024-09-15T21:54:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9841ffb640 1 -- 172.21.15.70:0/1195204608 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c0b4870 con 0x7f984c0b4d70 2024-09-15T21:54:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 -- 172.21.15.70:0/1195204608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f984c13af50 con 0x7f984c0b4d70 2024-09-15T21:54:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9841ffb640 1 -- 172.21.15.70:0/1195204608 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f983c0ab480 con 0x7f984c0b4d70 2024-09-15T21:54:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9841ffb640 1 -- 172.21.15.70:0/1195204608 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f983c0bea40 con 0x7f984c0b4d70 2024-09-15T21:54:57.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.659+0000 7f9853879640 1 -- 172.21.15.70:0/1195204608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f984c14d170 con 0x7f984c0b4d70 2024-09-15T21:54:57.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.671+0000 7f9841ffb640 1 -- 172.21.15.70:0/1195204608 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f984c1444c0 con 0x7f984c0b4d70 2024-09-15T21:54:57.732 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:57.735+0000 7f3970d6a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T21:54:57.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.739+0000 7f9853879640 1 -- 172.21.15.70:0/1195204608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fa48708f-0cb2-4d7b-ad99-83a0e11814b1", "id": 0} v 0) -- 0x7f984c0b6c50 con 0x7f984c0b4d70 2024-09-15T21:54:57.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.747+0000 7f9841ffb640 1 -- 172.21.15.70:0/1195204608 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa48708f-0cb2-4d7b-ad99-83a0e11814b1", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f983c0be460 con 0x7f984c0b4d70 2024-09-15T21:54:57.744 INFO:teuthology.orchestra.run.smithi070.stdout:0 2024-09-15T21:54:57.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.747+0000 7f9853879640 1 -- 172.21.15.70:0/1195204608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f984c0b4d70 msgr2=0x7f984c14d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.747+0000 7f9853879640 1 --2- 172.21.15.70:0/1195204608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f984c0b4d70 0x7f984c14d640 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f983c0ae040 tx=0x7f983c019010 comp rx=0 tx=0).stop 2024-09-15T21:54:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.747+0000 7f9853879640 1 -- 172.21.15.70:0/1195204608 shutdown_connections 2024-09-15T21:54:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.747+0000 7f9853879640 1 --2- 172.21.15.70:0/1195204608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f984c13e340 0x7f984c14db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.747+0000 7f9853879640 1 --2- 172.21.15.70:0/1195204608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f984c0b4d70 0x7f984c14d640 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.747+0000 7f9853879640 1 --2- 172.21.15.70:0/1195204608 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f984c072d50 0x7f984c140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.747+0000 7f9853879640 1 -- 172.21.15.70:0/1195204608 >> 172.21.15.70:0/1195204608 conn(0x7f984c0ba370 msgr2=0x7f984c1434d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.747+0000 7f9853879640 1 -- 172.21.15.70:0/1195204608 shutdown_connections 2024-09-15T21:54:57.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.747+0000 7f9853879640 1 -- 172.21.15.70:0/1195204608 wait complete. 2024-09-15T21:54:57.766 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 7299a093-9550-4267-95b4-073361e64c32 1 2024-09-15T21:54:57.787 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:57.786+0000 7f5339589180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T21:54:57.843 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:57.842+0000 7f5339589180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T21:54:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec2cf8640 1 Processor -- start 2024-09-15T21:54:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec2cf8640 1 -- start start 2024-09-15T21:54:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec2cf8640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2ebc072d50 0x7f2ebc144f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec2cf8640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ebc1444c0 con 0x7f2ebc0b4d70 2024-09-15T21:54:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec2cf8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ebc073130 con 0x7f2ebc13e340 2024-09-15T21:54:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec2cf8640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f2ebc145480 con 0x7f2ebc072d50 2024-09-15T21:54:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec1295640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f2ebc13e340 0x7f2ebc14ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:33352/0 (socket says 172.21.15.70:33352) 2024-09-15T21:54:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec1295640 1 -- 172.21.15.70:0/4221369960 learned_addr learned my addr 172.21.15.70:0/4221369960 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-09-15T21:54:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3613657234 0 0) 0x7f2ebc073130 con 0x7f2ebc13e340 2024-09-15T21:54:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec0a94640 1 --2- 172.21.15.70:0/4221369960 >> v2:172.21.15.1:3300/0 conn(0x7f2ebc072d50 0x7f2ebc144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2eac003530 con 0x7f2ebc13e340 2024-09-15T21:54:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 <== mon.1 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3022113779 0 0) 0x7f2eac003530 con 0x7f2ebc13e340 2024-09-15T21:54:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 >> v2:172.21.15.1:3300/0 conn(0x7f2ebc072d50 msgr2=0x7f2ebc144f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 --2- 172.21.15.70:0/4221369960 >> v2:172.21.15.1:3300/0 conn(0x7f2ebc072d50 0x7f2ebc144f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 >> v1:172.21.15.1:6789/0 conn(0x7f2ebc0b4d70 legacy=0x7f2ebc0719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc144740 con 0x7f2ebc13e340 2024-09-15T21:54:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 <== mon.1 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f2eb4001a00 con 0x7f2ebc13e340 2024-09-15T21:54:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 >> v1:172.21.15.70:6789/0 conn(0x7f2ebc13e340 legacy=0x7f2ebc14ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 --2- 172.21.15.70:0/4221369960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac0039c0 0x7f2eac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 --2- 172.21.15.70:0/4221369960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2eac004810 0x7f2eac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 --2- 172.21.15.70:0/4221369960 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2eac0052f0 0x7f2eac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc145480 con 0x7f2eac004810 2024-09-15T21:54:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac00c1c0 con 0x7f2eac0039c0 2024-09-15T21:54:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2eac00c3c0 con 0x7f2eac0052f0 2024-09-15T21:54:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec0a94640 1 --2- 172.21.15.70:0/4221369960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac0039c0 0x7f2eac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec1295640 1 --2- 172.21.15.70:0/4221369960 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2eac0052f0 0x7f2eac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ebbfff640 1 --2- 172.21.15.70:0/4221369960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2eac004810 0x7f2eac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec1295640 1 -- 172.21.15.70:0/4221369960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac0039c0 msgr2=0x7f2eac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec1295640 1 --2- 172.21.15.70:0/4221369960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eac0039c0 0x7f2eac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec1295640 1 -- 172.21.15.70:0/4221369960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2eac004810 msgr2=0x7f2eac004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec1295640 1 --2- 172.21.15.70:0/4221369960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2eac004810 0x7f2eac004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.879+0000 7f2ec1295640 1 -- 172.21.15.70:0/4221369960 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac003530 con 0x7f2eac0052f0 2024-09-15T21:54:57.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec1295640 1 -- 172.21.15.70:0/4221369960 reap_dead start 2024-09-15T21:54:57.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec1295640 1 --2- 172.21.15.70:0/4221369960 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2eac0052f0 0x7f2eac00b9d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400a830 tx=0x7f2eb401d360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea2de840af21e67d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:57.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400a480 con 0x7f2eac0052f0 2024-09-15T21:54:57.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb40ad630 con 0x7f2eac0052f0 2024-09-15T21:54:57.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ebb7fe640 1 -- 172.21.15.70:0/4221369960 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb40ada20 con 0x7f2eac0052f0 2024-09-15T21:54:57.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/4221369960 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2eac0052f0 msgr2=0x7f2eac00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 --2- 172.21.15.70:0/4221369960 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2eac0052f0 0x7f2eac00b9d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400a830 tx=0x7f2eb401d360 comp rx=0 tx=0).stop 2024-09-15T21:54:57.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/4221369960 shutdown_connections 2024-09-15T21:54:57.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 --2- 172.21.15.70:0/4221369960 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2eac0052f0 0x7f2eac00b9d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/4221369960 >> 172.21.15.70:0/4221369960 conn(0x7f2ebc0ba370 msgr2=0x7f2ebc0ba780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:57.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/4221369960 shutdown_connections 2024-09-15T21:54:57.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/4221369960 wait complete. 2024-09-15T21:54:57.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 Processor -- start 2024-09-15T21:54:57.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 -- start start 2024-09-15T21:54:57.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2eac0052f0 0x7f2ebc145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ebc147f80 0x7f2ebc149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ebc14a210 0x7f2ebc13a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc1450c0 con 0x7f2ebc14a210 2024-09-15T21:54:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc144f40 con 0x7f2ebc147f80 2024-09-15T21:54:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec2cf8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2ebc145240 con 0x7f2eac0052f0 2024-09-15T21:54:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec0a94640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2eac0052f0 0x7f2ebc145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ebbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ebc147f80 0x7f2ebc149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec0a94640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2eac0052f0 0x7f2ebc145890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:60640/0 (socket says 172.21.15.70:60640) 2024-09-15T21:54:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec0a94640 1 -- 172.21.15.70:0/3094518078 learned_addr learned my addr 172.21.15.70:0/3094518078 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.883+0000 7f2ec1295640 1 --2- 172.21.15.70:0/3094518078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ebc14a210 0x7f2ebc13a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2ec0a94640 1 -- 172.21.15.70:0/3094518078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ebc147f80 msgr2=0x7f2ebc149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2ec0a94640 1 --2- 172.21.15.70:0/3094518078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ebc147f80 0x7f2ebc149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2ec0a94640 1 -- 172.21.15.70:0/3094518078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ebc14a210 msgr2=0x7f2ebc13a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2ec0a94640 1 --2- 172.21.15.70:0/3094518078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ebc14a210 0x7f2ebc13a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2ec0a94640 1 -- 172.21.15.70:0/3094518078 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc14a9d0 con 0x7f2eac0052f0 2024-09-15T21:54:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2ec0a94640 1 --2- 172.21.15.70:0/3094518078 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2eac0052f0 0x7f2ebc145890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800b7a0 tx=0x7f2ea800bc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2eb97fa640 1 -- 172.21.15.70:0/3094518078 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8018070 con 0x7f2eac0052f0 2024-09-15T21:54:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2eb97fa640 1 -- 172.21.15.70:0/3094518078 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea80107d0 con 0x7f2eac0052f0 2024-09-15T21:54:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/3094518078 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ebc148f10 con 0x7f2eac0052f0 2024-09-15T21:54:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2eb97fa640 1 -- 172.21.15.70:0/3094518078 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8010ba0 con 0x7f2eac0052f0 2024-09-15T21:54:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/3094518078 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ebc1471d0 con 0x7f2eac0052f0 2024-09-15T21:54:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2eb97fa640 1 -- 172.21.15.70:0/3094518078 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2ea801b070 con 0x7f2eac0052f0 2024-09-15T21:54:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2eb97fa640 1 -- 172.21.15.70:0/3094518078 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f2ea80147e0 con 0x7f2eac0052f0 2024-09-15T21:54:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/3094518078 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ebc0b4a60 con 0x7f2eac0052f0 2024-09-15T21:54:57.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.887+0000 7f2eb97fa640 1 -- 172.21.15.70:0/3094518078 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2ea8010de0 con 0x7f2eac0052f0 2024-09-15T21:54:57.898 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:57.894+0000 7f5339589180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T21:54:57.931 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:57.931+0000 7f3970d6a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T21:54:57.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.955+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/3094518078 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7299a093-9550-4267-95b4-073361e64c32", "id": 1} v 0) -- 0x7f2ebc14ffd0 con 0x7f2eac0052f0 2024-09-15T21:54:57.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.959+0000 7f2eb97fa640 1 -- 172.21.15.70:0/3094518078 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7299a093-9550-4267-95b4-073361e64c32", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f2ea8014a30 con 0x7f2eac0052f0 2024-09-15T21:54:57.959 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-09-15T21:54:57.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.963+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/3094518078 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2eac0052f0 msgr2=0x7f2ebc145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:57.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.963+0000 7f2ec2cf8640 1 --2- 172.21.15.70:0/3094518078 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2eac0052f0 0x7f2ebc145890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800b7a0 tx=0x7f2ea800bc60 comp rx=0 tx=0).stop 2024-09-15T21:54:57.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.963+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/3094518078 shutdown_connections 2024-09-15T21:54:57.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.963+0000 7f2ec2cf8640 1 --2- 172.21.15.70:0/3094518078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ebc14a210 0x7f2ebc13a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.963+0000 7f2ec2cf8640 1 --2- 172.21.15.70:0/3094518078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ebc147f80 0x7f2ebc149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.963+0000 7f2ec2cf8640 1 --2- 172.21.15.70:0/3094518078 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2eac0052f0 0x7f2ebc145890 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:57.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.963+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/3094518078 >> 172.21.15.70:0/3094518078 conn(0x7f2ebc0ba370 msgr2=0x7f2ebc13d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:57.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.963+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/3094518078 shutdown_connections 2024-09-15T21:54:57.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:57.963+0000 7f2ec2cf8640 1 -- 172.21.15.70:0/3094518078 wait complete. 2024-09-15T21:54:57.975 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 144e63cd-0e36-4988-8d50-6b99198752d3 2 2024-09-15T21:54:57.979 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:57.978+0000 7f5339589180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T21:54:58.033 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:58.030+0000 7f5339589180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T21:54:58.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2eddef0640 1 Processor -- start 2024-09-15T21:54:58.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2eddef0640 1 -- start start 2024-09-15T21:54:58.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2eddef0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 0x7f2ed80ba960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2eddef0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2ed80bc080 0x7f2ed81450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2eddef0640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ed80b8ed0 con 0x7f2ed80b8760 2024-09-15T21:54:58.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2eddef0640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f2ed8073fb0 con 0x7f2ed80bc080 2024-09-15T21:54:58.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2eddef0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed80b9450 con 0x7f2ed8068370 2024-09-15T21:54:58.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2ed77fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 0x7f2ed80ba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2ed77fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 0x7f2ed80ba960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:60650/0 (socket says 172.21.15.70:60650) 2024-09-15T21:54:58.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2ed77fe640 1 -- 172.21.15.70:0/1055410557 learned_addr learned my addr 172.21.15.70:0/1055410557 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:58.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2ed77fe640 1 -- 172.21.15.70:0/1055410557 >> v2:172.21.15.1:3300/0 conn(0x7f2ed80bc080 msgr2=0x7f2ed81450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:58.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2ed7fff640 1 --2- 172.21.15.70:0/1055410557 >> v2:172.21.15.1:3300/0 conn(0x7f2ed80bc080 0x7f2ed81450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2ed77fe640 1 --2- 172.21.15.70:0/1055410557 >> v2:172.21.15.1:3300/0 conn(0x7f2ed80bc080 0x7f2ed81450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2ed77fe640 1 -- 172.21.15.70:0/1055410557 >> v1:172.21.15.1:6789/0 conn(0x7f2ed80b8760 legacy=0x7f2ed81449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:58.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2ed77fe640 1 -- 172.21.15.70:0/1055410557 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed8068750 con 0x7f2ed8068370 2024-09-15T21:54:58.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.083+0000 7f2ed7fff640 1 --2- 172.21.15.70:0/1055410557 >> v2:172.21.15.1:3300/0 conn(0x7f2ed80bc080 0x7f2ed81450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:54:58.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2ed77fe640 1 --2- 172.21.15.70:0/1055410557 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 0x7f2ed80ba960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009870 tx=0x7f2ec801c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69bc2f21dc87862 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:58.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2ed67fc640 1 -- 172.21.15.70:0/1055410557 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec80b1070 con 0x7f2ed8068370 2024-09-15T21:54:58.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2ed67fc640 1 -- 172.21.15.70:0/1055410557 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec80ac620 con 0x7f2ed8068370 2024-09-15T21:54:58.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2ed67fc640 1 -- 172.21.15.70:0/1055410557 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec80ac9f0 con 0x7f2ed8068370 2024-09-15T21:54:58.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 -- 172.21.15.70:0/1055410557 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 msgr2=0x7f2ed80ba960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 --2- 172.21.15.70:0/1055410557 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 0x7f2ed80ba960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009870 tx=0x7f2ec801c4f0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 -- 172.21.15.70:0/1055410557 shutdown_connections 2024-09-15T21:54:58.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 --2- 172.21.15.70:0/1055410557 >> v2:172.21.15.1:3300/0 conn(0x7f2ed80bc080 0x7f2ed81450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 --2- 172.21.15.70:0/1055410557 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 0x7f2ed80ba960 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 -- 172.21.15.70:0/1055410557 >> 172.21.15.70:0/1055410557 conn(0x7f2ed80a09b0 msgr2=0x7f2ed8067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:58.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 -- 172.21.15.70:0/1055410557 shutdown_connections 2024-09-15T21:54:58.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 -- 172.21.15.70:0/1055410557 wait complete. 2024-09-15T21:54:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 Processor -- start 2024-09-15T21:54:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 -- start start 2024-09-15T21:54:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 0x7f2ed80b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80bc080 0x7f2ed81e0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ed8143e60 0x7f2ed809d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed8154c60 con 0x7f2ed8143e60 2024-09-15T21:54:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed8154ae0 con 0x7f2ed80bc080 2024-09-15T21:54:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2eddef0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed8154de0 con 0x7f2ed8068370 2024-09-15T21:54:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2ed77fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 0x7f2ed80b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2ed6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80bc080 0x7f2ed81e0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2ed77fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 0x7f2ed80b3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:60658/0 (socket says 172.21.15.70:60658) 2024-09-15T21:54:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.087+0000 7f2ed77fe640 1 -- 172.21.15.70:0/2463497246 learned_addr learned my addr 172.21.15.70:0/2463497246 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2ed7fff640 1 --2- 172.21.15.70:0/2463497246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ed8143e60 0x7f2ed809d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2ed77fe640 1 -- 172.21.15.70:0/2463497246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80bc080 msgr2=0x7f2ed81e0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2ed77fe640 1 --2- 172.21.15.70:0/2463497246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80bc080 0x7f2ed81e0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2ed77fe640 1 -- 172.21.15.70:0/2463497246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ed8143e60 msgr2=0x7f2ed809d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2ed77fe640 1 --2- 172.21.15.70:0/2463497246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ed8143e60 0x7f2ed809d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2ed77fe640 1 -- 172.21.15.70:0/2463497246 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed80b5600 con 0x7f2ed8068370 2024-09-15T21:54:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2ed6ffd640 1 --2- 172.21.15.70:0/2463497246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80bc080 0x7f2ed81e0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:54:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2ed77fe640 1 --2- 172.21.15.70:0/2463497246 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 0x7f2ed80b3780 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80af040 tx=0x7f2ec801ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2ebffff640 1 -- 172.21.15.70:0/2463497246 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec80bb020 con 0x7f2ed8068370 2024-09-15T21:54:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2ebffff640 1 -- 172.21.15.70:0/2463497246 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec80b7640 con 0x7f2ed8068370 2024-09-15T21:54:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2ebffff640 1 -- 172.21.15.70:0/2463497246 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec80b1040 con 0x7f2ed8068370 2024-09-15T21:54:58.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2eddef0640 1 -- 172.21.15.70:0/2463497246 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed80b2f80 con 0x7f2ed8068370 2024-09-15T21:54:58.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2eddef0640 1 -- 172.21.15.70:0/2463497246 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed80b2a60 con 0x7f2ed8068370 2024-09-15T21:54:58.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2ebffff640 1 -- 172.21.15.70:0/2463497246 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2ec80be020 con 0x7f2ed8068370 2024-09-15T21:54:58.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2ebffff640 1 -- 172.21.15.70:0/2463497246 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f2ec80ab3c0 con 0x7f2ed8068370 2024-09-15T21:54:58.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.091+0000 7f2eddef0640 1 -- 172.21.15.70:0/2463497246 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ed80ba960 con 0x7f2ed8068370 2024-09-15T21:54:58.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.095+0000 7f2ebffff640 1 -- 172.21.15.70:0/2463497246 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2ec80c5030 con 0x7f2ed8068370 2024-09-15T21:54:58.114 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:58.110+0000 7f5339589180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T21:54:58.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.163+0000 7f2eddef0640 1 -- 172.21.15.70:0/2463497246 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "144e63cd-0e36-4988-8d50-6b99198752d3", "id": 2} v 0) -- 0x7f2ed80b2d70 con 0x7f2ed8068370 2024-09-15T21:54:58.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.167+0000 7f2ebffff640 1 -- 172.21.15.70:0/2463497246 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "144e63cd-0e36-4988-8d50-6b99198752d3", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f2ec8016110 con 0x7f2ed8068370 2024-09-15T21:54:58.166 INFO:teuthology.orchestra.run.smithi070.stdout:2 2024-09-15T21:54:58.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.167+0000 7f2eddef0640 1 -- 172.21.15.70:0/2463497246 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 msgr2=0x7f2ed80b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.167+0000 7f2eddef0640 1 --2- 172.21.15.70:0/2463497246 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 0x7f2ed80b3780 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80af040 tx=0x7f2ec801ad30 comp rx=0 tx=0).stop 2024-09-15T21:54:58.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.167+0000 7f2eddef0640 1 -- 172.21.15.70:0/2463497246 shutdown_connections 2024-09-15T21:54:58.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.167+0000 7f2eddef0640 1 --2- 172.21.15.70:0/2463497246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2ed8143e60 0x7f2ed809d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.167+0000 7f2eddef0640 1 --2- 172.21.15.70:0/2463497246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ed80bc080 0x7f2ed81e0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.167+0000 7f2eddef0640 1 --2- 172.21.15.70:0/2463497246 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ed8068370 0x7f2ed80b3780 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.167+0000 7f2eddef0640 1 -- 172.21.15.70:0/2463497246 >> 172.21.15.70:0/2463497246 conn(0x7f2ed80a09b0 msgr2=0x7f2ed80b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:58.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.167+0000 7f2eddef0640 1 -- 172.21.15.70:0/2463497246 shutdown_connections 2024-09-15T21:54:58.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.167+0000 7f2eddef0640 1 -- 172.21.15.70:0/2463497246 wait complete. 2024-09-15T21:54:58.169 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:58.166+0000 7f5339589180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T21:54:58.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 8ef87915-483d-453e-8d9d-6e19986d537f 3 2024-09-15T21:54:58.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bff415640 1 Processor -- start 2024-09-15T21:54:58.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bff415640 1 -- start start 2024-09-15T21:54:58.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bff415640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0bf8067c60 0x7f0bf8141660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bff415640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0bf80b5a20 0x7f0bf8141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bff415640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf8068040 con 0x7f0bf8072ce0 2024-09-15T21:54:58.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bff415640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f0bf8071430 con 0x7f0bf80b5a20 2024-09-15T21:54:58.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bff415640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f0bf8072500 con 0x7f0bf8067c60 2024-09-15T21:54:58.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bfd1b1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0bf8067c60 0x7f0bf8141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bfd1b1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0bf8067c60 0x7f0bf8141660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36918/0 (socket says 172.21.15.70:36918) 2024-09-15T21:54:58.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bfd1b1640 1 -- 172.21.15.70:0/1386556420 learned_addr learned my addr 172.21.15.70:0/1386556420 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:58.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bfc9b0640 1 --2- 172.21.15.70:0/1386556420 >> v2:172.21.15.1:3300/0 conn(0x7f0bf80b5a20 0x7f0bf8141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bfd1b1640 1 -- 172.21.15.70:0/1386556420 >> v2:172.21.15.1:3300/0 conn(0x7f0bf80b5a20 msgr2=0x7f0bf8141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:58.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bfd1b1640 1 --2- 172.21.15.70:0/1386556420 >> v2:172.21.15.1:3300/0 conn(0x7f0bf80b5a20 0x7f0bf8141ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bfd1b1640 1 -- 172.21.15.70:0/1386556420 >> v1:172.21.15.1:6789/0 conn(0x7f0bf8072ce0 legacy=0x7f0bf814adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:58.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.299+0000 7f0bfd1b1640 1 -- 172.21.15.70:0/1386556420 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf8070de0 con 0x7f0bf8067c60 2024-09-15T21:54:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bfd1b1640 1 --2- 172.21.15.70:0/1386556420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bf8067c60 0x7f0bf8141660 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80b3f60 tx=0x7f0bf401c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73b511361a275a8a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bebfff640 1 -- 172.21.15.70:0/1386556420 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf40b1070 con 0x7f0bf8067c60 2024-09-15T21:54:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bebfff640 1 -- 172.21.15.70:0/1386556420 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf40ac620 con 0x7f0bf8067c60 2024-09-15T21:54:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bebfff640 1 -- 172.21.15.70:0/1386556420 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf40ac9f0 con 0x7f0bf8067c60 2024-09-15T21:54:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bff415640 1 -- 172.21.15.70:0/1386556420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bf8067c60 msgr2=0x7f0bf8141660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bff415640 1 --2- 172.21.15.70:0/1386556420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bf8067c60 0x7f0bf8141660 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80b3f60 tx=0x7f0bf401c420 comp rx=0 tx=0).stop 2024-09-15T21:54:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bff415640 1 -- 172.21.15.70:0/1386556420 shutdown_connections 2024-09-15T21:54:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bff415640 1 --2- 172.21.15.70:0/1386556420 >> v2:172.21.15.1:3300/0 conn(0x7f0bf80b5a20 0x7f0bf8141ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bff415640 1 --2- 172.21.15.70:0/1386556420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bf8067c60 0x7f0bf8141660 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bff415640 1 -- 172.21.15.70:0/1386556420 >> 172.21.15.70:0/1386556420 conn(0x7f0bf80b63a0 msgr2=0x7f0bf80b67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bff415640 1 -- 172.21.15.70:0/1386556420 shutdown_connections 2024-09-15T21:54:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bff415640 1 -- 172.21.15.70:0/1386556420 wait complete. 2024-09-15T21:54:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bff415640 1 Processor -- start 2024-09-15T21:54:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.303+0000 7f0bff415640 1 -- start start 2024-09-15T21:54:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bff415640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bf8067c60 0x7f0bf81da460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bff415640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bf8072ce0 0x7f0bf813cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bff415640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bf80b5a20 0x7f0bf813d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bff415640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf8155160 con 0x7f0bf8072ce0 2024-09-15T21:54:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bff415640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf8073580 con 0x7f0bf8067c60 2024-09-15T21:54:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bff415640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf81552e0 con 0x7f0bf80b5a20 2024-09-15T21:54:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bfd9b2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bf80b5a20 0x7f0bf813d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bfd1b1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bf8067c60 0x7f0bf81da460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bfd1b1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bf8067c60 0x7f0bf81da460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36932/0 (socket says 172.21.15.70:36932) 2024-09-15T21:54:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bfd1b1640 1 -- 172.21.15.70:0/2023058193 learned_addr learned my addr 172.21.15.70:0/2023058193 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bfc9b0640 1 --2- 172.21.15.70:0/2023058193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bf8072ce0 0x7f0bf813cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bfd1b1640 1 -- 172.21.15.70:0/2023058193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bf80b5a20 msgr2=0x7f0bf813d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bfd1b1640 1 --2- 172.21.15.70:0/2023058193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bf80b5a20 0x7f0bf813d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bfd1b1640 1 -- 172.21.15.70:0/2023058193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bf8072ce0 msgr2=0x7f0bf813cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bfd1b1640 1 --2- 172.21.15.70:0/2023058193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bf8072ce0 0x7f0bf813cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bfd1b1640 1 -- 172.21.15.70:0/2023058193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf81e0e30 con 0x7f0bf8067c60 2024-09-15T21:54:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bfd9b2640 1 --2- 172.21.15.70:0/2023058193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bf80b5a20 0x7f0bf813d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:54:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bfd1b1640 1 --2- 172.21.15.70:0/2023058193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bf8067c60 0x7f0bf81da460 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0bf401aad0 tx=0x7f0bf40191c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0be9ffb640 1 -- 172.21.15.70:0/2023058193 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf40b1040 con 0x7f0bf8067c60 2024-09-15T21:54:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0be9ffb640 1 -- 172.21.15.70:0/2023058193 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf40ba070 con 0x7f0bf8067c60 2024-09-15T21:54:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0be9ffb640 1 -- 172.21.15.70:0/2023058193 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf40b5680 con 0x7f0bf8067c60 2024-09-15T21:54:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bff415640 1 -- 172.21.15.70:0/2023058193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf81e1110 con 0x7f0bf8067c60 2024-09-15T21:54:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bff415640 1 -- 172.21.15.70:0/2023058193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf8142220 con 0x7f0bf8067c60 2024-09-15T21:54:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0be9ffb640 1 -- 172.21.15.70:0/2023058193 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0bf40b5820 con 0x7f0bf8067c60 2024-09-15T21:54:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0be9ffb640 1 -- 172.21.15.70:0/2023058193 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f0bf40bfd50 con 0x7f0bf8067c60 2024-09-15T21:54:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.307+0000 7f0bff415640 1 -- 172.21.15.70:0/2023058193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf8145ab0 con 0x7f0bf8067c60 2024-09-15T21:54:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.311+0000 7f0be9ffb640 1 -- 172.21.15.70:0/2023058193 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0bf40160d0 con 0x7f0bf8067c60 2024-09-15T21:54:58.327 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:58.326+0000 7f5339589180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T21:54:58.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.379+0000 7f0bff415640 1 -- 172.21.15.70:0/2023058193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8ef87915-483d-453e-8d9d-6e19986d537f", "id": 3} v 0) -- 0x7f0bf8146730 con 0x7f0bf8067c60 2024-09-15T21:54:58.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.383+0000 7f0be9ffb640 1 -- 172.21.15.70:0/2023058193 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ef87915-483d-453e-8d9d-6e19986d537f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f0bf40bf460 con 0x7f0bf8067c60 2024-09-15T21:54:58.382 INFO:teuthology.orchestra.run.smithi070.stdout:3 2024-09-15T21:54:58.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.383+0000 7f0bff415640 1 -- 172.21.15.70:0/2023058193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bf8067c60 msgr2=0x7f0bf81da460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.383+0000 7f0bff415640 1 --2- 172.21.15.70:0/2023058193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bf8067c60 0x7f0bf81da460 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0bf401aad0 tx=0x7f0bf40191c0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.383+0000 7f0bff415640 1 -- 172.21.15.70:0/2023058193 shutdown_connections 2024-09-15T21:54:58.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.383+0000 7f0bff415640 1 --2- 172.21.15.70:0/2023058193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0bf80b5a20 0x7f0bf813d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.383+0000 7f0bff415640 1 --2- 172.21.15.70:0/2023058193 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0bf8072ce0 0x7f0bf813cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.383+0000 7f0bff415640 1 --2- 172.21.15.70:0/2023058193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bf8067c60 0x7f0bf81da460 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.383+0000 7f0bff415640 1 -- 172.21.15.70:0/2023058193 >> 172.21.15.70:0/2023058193 conn(0x7f0bf80b63a0 msgr2=0x7f0bf8147790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:58.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.383+0000 7f0bff415640 1 -- 172.21.15.70:0/2023058193 shutdown_connections 2024-09-15T21:54:58.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.383+0000 7f0bff415640 1 -- 172.21.15.70:0/2023058193 wait complete. 2024-09-15T21:54:58.392 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:58.390+0000 7f5339589180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T21:54:58.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 307bd14a-a3ef-4565-9bba-4ae91e65b01d 4 2024-09-15T21:54:58.506 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:58.507+0000 7f3970d6a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T21:54:58.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c41bdd640 1 Processor -- start 2024-09-15T21:54:58.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c41bdd640 1 -- start start 2024-09-15T21:54:58.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c41bdd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6c3c06e3f0 0x7f6c3c06e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c41bdd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6c3c150060 0x7f6c3c152450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c41bdd640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c3c0b76c0 con 0x7f6c3c06f600 2024-09-15T21:54:58.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c41bdd640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f6c3c06f9e0 con 0x7f6c3c150060 2024-09-15T21:54:58.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c41bdd640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f6c3c0b7930 con 0x7f6c3c06e3f0 2024-09-15T21:54:58.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c3affd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6c3c06e3f0 0x7f6c3c06e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c3affd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6c3c06e3f0 0x7f6c3c06e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36940/0 (socket says 172.21.15.70:36940) 2024-09-15T21:54:58.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c3affd640 1 -- 172.21.15.70:0/1241816754 learned_addr learned my addr 172.21.15.70:0/1241816754 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:58.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c3bfff640 1 --2- 172.21.15.70:0/1241816754 >> v2:172.21.15.1:3300/0 conn(0x7f6c3c150060 0x7f6c3c152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c3affd640 1 -- 172.21.15.70:0/1241816754 >> v2:172.21.15.1:3300/0 conn(0x7f6c3c150060 msgr2=0x7f6c3c152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:58.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c3affd640 1 --2- 172.21.15.70:0/1241816754 >> v2:172.21.15.1:3300/0 conn(0x7f6c3c150060 0x7f6c3c152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c3affd640 1 -- 172.21.15.70:0/1241816754 >> v1:172.21.15.1:6789/0 conn(0x7f6c3c06f600 legacy=0x7f6c3c1477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:58.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.511+0000 7f6c3affd640 1 -- 172.21.15.70:0/1241816754 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3c14b2f0 con 0x7f6c3c06e3f0 2024-09-15T21:54:58.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c3affd640 1 --2- 172.21.15.70:0/1241816754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c3c06e3f0 0x7f6c3c06e860 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c074400 tx=0x7f6c2401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80dfbafd3d5dd3de server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:58.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c3a7fc640 1 -- 172.21.15.70:0/1241816754 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240b0070 con 0x7f6c3c06e3f0 2024-09-15T21:54:58.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c3a7fc640 1 -- 172.21.15.70:0/1241816754 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c240ab600 con 0x7f6c3c06e3f0 2024-09-15T21:54:58.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c3a7fc640 1 -- 172.21.15.70:0/1241816754 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240ab9d0 con 0x7f6c3c06e3f0 2024-09-15T21:54:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 -- 172.21.15.70:0/1241816754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c3c06e3f0 msgr2=0x7f6c3c06e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 --2- 172.21.15.70:0/1241816754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c3c06e3f0 0x7f6c3c06e860 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c074400 tx=0x7f6c2401c450 comp rx=0 tx=0).stop 2024-09-15T21:54:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 -- 172.21.15.70:0/1241816754 shutdown_connections 2024-09-15T21:54:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 --2- 172.21.15.70:0/1241816754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c3c06e3f0 0x7f6c3c06e860 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 --2- 172.21.15.70:0/1241816754 >> v2:172.21.15.1:3300/0 conn(0x7f6c3c150060 0x7f6c3c152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 -- 172.21.15.70:0/1241816754 >> 172.21.15.70:0/1241816754 conn(0x7f6c3c0bb2d0 msgr2=0x7f6c3c0bb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:58.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 -- 172.21.15.70:0/1241816754 shutdown_connections 2024-09-15T21:54:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 -- 172.21.15.70:0/1241816754 wait complete. 2024-09-15T21:54:58.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 Processor -- start 2024-09-15T21:54:58.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 -- start start 2024-09-15T21:54:58.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c3c06e3f0 0x7f6c3c0b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c3c06f600 0x7f6c3c1e0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c3c150060 0x7f6c3c1e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c14ba80 con 0x7f6c3c150060 2024-09-15T21:54:58.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c09de40 con 0x7f6c3c06f600 2024-09-15T21:54:58.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c41bdd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3c14bc00 con 0x7f6c3c06e3f0 2024-09-15T21:54:58.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c3affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c3c06f600 0x7f6c3c1e0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c3affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c3c06f600 0x7f6c3c1e0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36954/0 (socket says 172.21.15.70:36954) 2024-09-15T21:54:58.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c3affd640 1 -- 172.21.15.70:0/2055801335 learned_addr learned my addr 172.21.15.70:0/2055801335 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:58.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c3b7fe640 1 --2- 172.21.15.70:0/2055801335 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c3c06e3f0 0x7f6c3c0b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.515+0000 7f6c3bfff640 1 --2- 172.21.15.70:0/2055801335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c3c150060 0x7f6c3c1e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c3affd640 1 -- 172.21.15.70:0/2055801335 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c3c06e3f0 msgr2=0x7f6c3c0b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c3affd640 1 --2- 172.21.15.70:0/2055801335 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c3c06e3f0 0x7f6c3c0b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c3affd640 1 -- 172.21.15.70:0/2055801335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c3c150060 msgr2=0x7f6c3c1e3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c3affd640 1 --2- 172.21.15.70:0/2055801335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c3c150060 0x7f6c3c1e3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c3affd640 1 -- 172.21.15.70:0/2055801335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3c1e1260 con 0x7f6c3c06f600 2024-09-15T21:54:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c3affd640 1 --2- 172.21.15.70:0/2055801335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c3c06f600 0x7f6c3c1e0d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6c2401a080 tx=0x7f6c240191f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c33fff640 1 -- 172.21.15.70:0/2055801335 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240b9070 con 0x7f6c3c06f600 2024-09-15T21:54:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c33fff640 1 -- 172.21.15.70:0/2055801335 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c240b4600 con 0x7f6c3c06f600 2024-09-15T21:54:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c41bdd640 1 -- 172.21.15.70:0/2055801335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3c1e0520 con 0x7f6c3c06f600 2024-09-15T21:54:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c33fff640 1 -- 172.21.15.70:0/2055801335 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240b0040 con 0x7f6c3c06f600 2024-09-15T21:54:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c41bdd640 1 -- 172.21.15.70:0/2055801335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c3c09c110 con 0x7f6c3c06f600 2024-09-15T21:54:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c33fff640 1 -- 172.21.15.70:0/2055801335 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6c240bc070 con 0x7f6c3c06f600 2024-09-15T21:54:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c33fff640 1 -- 172.21.15.70:0/2055801335 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f6c240bd8c0 con 0x7f6c3c06f600 2024-09-15T21:54:58.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c41bdd640 1 -- 172.21.15.70:0/2055801335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c3c1e0310 con 0x7f6c3c06f600 2024-09-15T21:54:58.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.519+0000 7f6c33fff640 1 -- 172.21.15.70:0/2055801335 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6c240160d0 con 0x7f6c3c06f600 2024-09-15T21:54:58.562 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:58.563+0000 7f3970d6a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T21:54:58.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.587+0000 7f6c41bdd640 1 -- 172.21.15.70:0/2055801335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "307bd14a-a3ef-4565-9bba-4ae91e65b01d", "id": 4} v 0) -- 0x7f6c3c0a0740 con 0x7f6c3c06f600 2024-09-15T21:54:58.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.591+0000 7f6c33fff640 1 -- 172.21.15.70:0/2055801335 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "307bd14a-a3ef-4565-9bba-4ae91e65b01d", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f6c240ab4c0 con 0x7f6c3c06f600 2024-09-15T21:54:58.590 INFO:teuthology.orchestra.run.smithi070.stdout:4 2024-09-15T21:54:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.591+0000 7f6c41bdd640 1 -- 172.21.15.70:0/2055801335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c3c06f600 msgr2=0x7f6c3c1e0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.591+0000 7f6c41bdd640 1 --2- 172.21.15.70:0/2055801335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c3c06f600 0x7f6c3c1e0d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6c2401a080 tx=0x7f6c240191f0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.591+0000 7f6c41bdd640 1 -- 172.21.15.70:0/2055801335 shutdown_connections 2024-09-15T21:54:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.591+0000 7f6c41bdd640 1 --2- 172.21.15.70:0/2055801335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6c3c150060 0x7f6c3c1e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.591+0000 7f6c41bdd640 1 --2- 172.21.15.70:0/2055801335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c3c06f600 0x7f6c3c1e0d20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.591+0000 7f6c41bdd640 1 --2- 172.21.15.70:0/2055801335 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6c3c06e3f0 0x7f6c3c0b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.591+0000 7f6c41bdd640 1 -- 172.21.15.70:0/2055801335 >> 172.21.15.70:0/2055801335 conn(0x7f6c3c0bb2d0 msgr2=0x7f6c3c09fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:58.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.591+0000 7f6c41bdd640 1 -- 172.21.15.70:0/2055801335 shutdown_connections 2024-09-15T21:54:58.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.591+0000 7f6c41bdd640 1 -- 172.21.15.70:0/2055801335 wait complete. 2024-09-15T21:54:58.606 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 934dded5-49c6-4d64-9341-e1209c0f21c1 5 2024-09-15T21:54:58.617 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:58.619+0000 7f3970d6a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T21:54:58.697 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:58.698+0000 7f3970d6a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T21:54:58.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.722+0000 7f805a95b640 1 Processor -- start 2024-09-15T21:54:58.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.722+0000 7f805a95b640 1 -- start start 2024-09-15T21:54:58.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f805a95b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8054067c60 0x7f80540aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f805a95b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f80540afa30 0x7f80540afec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f805a95b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8054147750 con 0x7f8054146bd0 2024-09-15T21:54:58.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f805a95b640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f8054068080 con 0x7f8054067c60 2024-09-15T21:54:58.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f805a95b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f80540af2c0 con 0x7f80540afa30 2024-09-15T21:54:58.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f80537fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f80540afa30 0x7f80540afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f80537fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f80540afa30 0x7f80540afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36966/0 (socket says 172.21.15.70:36966) 2024-09-15T21:54:58.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f80537fe640 1 -- 172.21.15.70:0/247683043 learned_addr learned my addr 172.21.15.70:0/247683043 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:58.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f8053fff640 1 --2- 172.21.15.70:0/247683043 >> v2:172.21.15.1:3300/0 conn(0x7f8054067c60 0x7f80540aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f80537fe640 1 -- 172.21.15.70:0/247683043 >> v2:172.21.15.1:3300/0 conn(0x7f8054067c60 msgr2=0x7f80540aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:58.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f80537fe640 1 --2- 172.21.15.70:0/247683043 >> v2:172.21.15.1:3300/0 conn(0x7f8054067c60 0x7f80540aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f80537fe640 1 -- 172.21.15.70:0/247683043 >> v1:172.21.15.70:6789/0 conn(0x7f8054146bd0 legacy=0x7f8054147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f80537fe640 1 -- 172.21.15.70:0/247683043 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80540af5a0 con 0x7f80540afa30 2024-09-15T21:54:58.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f80537fe640 1 --2- 172.21.15.70:0/247683043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80540afa30 0x7f80540afec0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f80540742e0 tx=0x7f804801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f9163978640e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:58.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f8052ffd640 1 -- 172.21.15.70:0/247683043 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80480ab660 con 0x7f80540afa30 2024-09-15T21:54:58.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f8052ffd640 1 -- 172.21.15.70:0/247683043 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80480b0070 con 0x7f80540afa30 2024-09-15T21:54:58.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.726+0000 7f8052ffd640 1 -- 172.21.15.70:0/247683043 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80480aba20 con 0x7f80540afa30 2024-09-15T21:54:58.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 -- 172.21.15.70:0/247683043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80540afa30 msgr2=0x7f80540afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 --2- 172.21.15.70:0/247683043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80540afa30 0x7f80540afec0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f80540742e0 tx=0x7f804801c460 comp rx=0 tx=0).stop 2024-09-15T21:54:58.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 -- 172.21.15.70:0/247683043 shutdown_connections 2024-09-15T21:54:58.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 --2- 172.21.15.70:0/247683043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80540afa30 0x7f80540afec0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 --2- 172.21.15.70:0/247683043 >> v2:172.21.15.1:3300/0 conn(0x7f8054067c60 0x7f80540aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 -- 172.21.15.70:0/247683043 >> 172.21.15.70:0/247683043 conn(0x7f80540b6570 msgr2=0x7f80540b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:58.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 -- 172.21.15.70:0/247683043 shutdown_connections 2024-09-15T21:54:58.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 -- 172.21.15.70:0/247683043 wait complete. 2024-09-15T21:54:58.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 Processor -- start 2024-09-15T21:54:58.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 -- start start 2024-09-15T21:54:58.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8054067c60 0x7f805414e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80540afa30 0x7f8054150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8054146bd0 0x7f8054150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f80540b0400 con 0x7f80540afa30 2024-09-15T21:54:58.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f805406f4c0 con 0x7f8054146bd0 2024-09-15T21:54:58.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8054154970 con 0x7f8054067c60 2024-09-15T21:54:58.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8058ef8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8054146bd0 0x7f8054150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8058ef8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8054146bd0 0x7f8054150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36982/0 (socket says 172.21.15.70:36982) 2024-09-15T21:54:58.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8058ef8640 1 -- 172.21.15.70:0/1568166998 learned_addr learned my addr 172.21.15.70:0/1568166998 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:58.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f80537fe640 1 --2- 172.21.15.70:0/1568166998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80540afa30 0x7f8054150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8053fff640 1 --2- 172.21.15.70:0/1568166998 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8054067c60 0x7f805414e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8058ef8640 1 -- 172.21.15.70:0/1568166998 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8054067c60 msgr2=0x7f805414e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8058ef8640 1 --2- 172.21.15.70:0/1568166998 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8054067c60 0x7f805414e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8058ef8640 1 -- 172.21.15.70:0/1568166998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80540afa30 msgr2=0x7f8054150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8058ef8640 1 --2- 172.21.15.70:0/1568166998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80540afa30 0x7f8054150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8058ef8640 1 -- 172.21.15.70:0/1568166998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805414fcc0 con 0x7f8054146bd0 2024-09-15T21:54:58.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8058ef8640 1 --2- 172.21.15.70:0/1568166998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8054146bd0 0x7f8054150dc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f804c00c730 tx=0x7f804c00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:58.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8050ff9640 1 -- 172.21.15.70:0/1568166998 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c003b80 con 0x7f8054146bd0 2024-09-15T21:54:58.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8050ff9640 1 -- 172.21.15.70:0/1568166998 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804c003d20 con 0x7f8054146bd0 2024-09-15T21:54:58.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 -- 172.21.15.70:0/1568166998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f805414da20 con 0x7f8054146bd0 2024-09-15T21:54:58.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8050ff9640 1 -- 172.21.15.70:0/1568166998 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c005310 con 0x7f8054146bd0 2024-09-15T21:54:58.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 -- 172.21.15.70:0/1568166998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f805414c550 con 0x7f8054146bd0 2024-09-15T21:54:58.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8050ff9640 1 -- 172.21.15.70:0/1568166998 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f804c0056c0 con 0x7f8054146bd0 2024-09-15T21:54:58.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f8050ff9640 1 -- 172.21.15.70:0/1568166998 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f804c012cc0 con 0x7f8054146bd0 2024-09-15T21:54:58.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.730+0000 7f805a95b640 1 -- 172.21.15.70:0/1568166998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f805414d810 con 0x7f8054146bd0 2024-09-15T21:54:58.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.734+0000 7f8050ff9640 1 -- 172.21.15.70:0/1568166998 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f804c012740 con 0x7f8054146bd0 2024-09-15T21:54:58.752 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:58.754+0000 7f3970d6a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T21:54:58.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.802+0000 7f805a95b640 1 -- 172.21.15.70:0/1568166998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "934dded5-49c6-4d64-9341-e1209c0f21c1", "id": 5} v 0) -- 0x7f80540aeb70 con 0x7f8054146bd0 2024-09-15T21:54:58.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.806+0000 7f8050ff9640 1 -- 172.21.15.70:0/1568166998 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "934dded5-49c6-4d64-9341-e1209c0f21c1", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f804c012920 con 0x7f8054146bd0 2024-09-15T21:54:58.808 INFO:teuthology.orchestra.run.smithi070.stdout:5 2024-09-15T21:54:58.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.810+0000 7f805a95b640 1 -- 172.21.15.70:0/1568166998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8054146bd0 msgr2=0x7f8054150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.810+0000 7f805a95b640 1 --2- 172.21.15.70:0/1568166998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8054146bd0 0x7f8054150dc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f804c00c730 tx=0x7f804c00cbf0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.810+0000 7f805a95b640 1 -- 172.21.15.70:0/1568166998 shutdown_connections 2024-09-15T21:54:58.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.810+0000 7f805a95b640 1 --2- 172.21.15.70:0/1568166998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8054146bd0 0x7f8054150dc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.810+0000 7f805a95b640 1 --2- 172.21.15.70:0/1568166998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f80540afa30 0x7f8054150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.810+0000 7f805a95b640 1 --2- 172.21.15.70:0/1568166998 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8054067c60 0x7f805414e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.810+0000 7f805a95b640 1 -- 172.21.15.70:0/1568166998 >> 172.21.15.70:0/1568166998 conn(0x7f80540b6570 msgr2=0x7f8054148070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:58.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.810+0000 7f805a95b640 1 -- 172.21.15.70:0/1568166998 shutdown_connections 2024-09-15T21:54:58.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.810+0000 7f805a95b640 1 -- 172.21.15.70:0/1568166998 wait complete. 2024-09-15T21:54:58.824 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new ebb7a66f-2d89-4df5-b18b-2c305cef9cb4 6 2024-09-15T21:54:58.832 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:58.834+0000 7f3970d6a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T21:54:58.887 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:58.886+0000 7f3970d6a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T21:54:58.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e9417640 1 Processor -- start 2024-09-15T21:54:58.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e9417640 1 -- start start 2024-09-15T21:54:58.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e9417640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 0x7fd3e406bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e9417640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd3e40b0f10 0x7fd3e414af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e9417640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd3e414b440 0x7fd3e414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e9417640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e406f760 con 0x7fd3e414b440 2024-09-15T21:54:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e9417640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fd3e40af920 con 0x7fd3e40b0f10 2024-09-15T21:54:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e9417640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e40b6ba0 con 0x7fd3e40af540 2024-09-15T21:54:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e2ffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 0x7fd3e406bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e2ffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 0x7fd3e406bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:60700/0 (socket says 172.21.15.70:60700) 2024-09-15T21:54:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e2ffd640 1 -- 172.21.15.70:0/3789166885 learned_addr learned my addr 172.21.15.70:0/3789166885 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e27fc640 1 --2- 172.21.15.70:0/3789166885 >> v2:172.21.15.70:3300/0 conn(0x7fd3e40b0f10 0x7fd3e414af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e37fe640 1 --2- 172.21.15.70:0/3789166885 >> v2:172.21.15.1:3300/0 conn(0x7fd3e414b440 0x7fd3e414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e2ffd640 1 -- 172.21.15.70:0/3789166885 >> v2:172.21.15.70:3300/0 conn(0x7fd3e40b0f10 msgr2=0x7fd3e414af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e2ffd640 1 --2- 172.21.15.70:0/3789166885 >> v2:172.21.15.70:3300/0 conn(0x7fd3e40b0f10 0x7fd3e414af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e2ffd640 1 -- 172.21.15.70:0/3789166885 >> v2:172.21.15.1:3300/0 conn(0x7fd3e414b440 msgr2=0x7fd3e414b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e2ffd640 1 --2- 172.21.15.70:0/3789166885 >> v2:172.21.15.1:3300/0 conn(0x7fd3e414b440 0x7fd3e414b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e2ffd640 1 -- 172.21.15.70:0/3789166885 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e40b65e0 con 0x7fd3e40af540 2024-09-15T21:54:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e37fe640 1 --2- 172.21.15.70:0/3789166885 >> v2:172.21.15.1:3300/0 conn(0x7fd3e414b440 0x7fd3e414b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:54:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.946+0000 7fd3e27fc640 1 --2- 172.21.15.70:0/3789166885 >> v2:172.21.15.70:3300/0 conn(0x7fd3e40b0f10 0x7fd3e414af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:54:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e2ffd640 1 --2- 172.21.15.70:0/3789166885 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 0x7fd3e406bfa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4069840 tx=0x7fd3d401c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb0fb18ffa69c6e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e1ffb640 1 -- 172.21.15.70:0/3789166885 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40b0070 con 0x7fd3e40af540 2024-09-15T21:54:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e1ffb640 1 -- 172.21.15.70:0/3789166885 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d40ab600 con 0x7fd3e40af540 2024-09-15T21:54:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e1ffb640 1 -- 172.21.15.70:0/3789166885 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40ab9d0 con 0x7fd3e40af540 2024-09-15T21:54:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 -- 172.21.15.70:0/3789166885 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 msgr2=0x7fd3e406bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 --2- 172.21.15.70:0/3789166885 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 0x7fd3e406bfa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4069840 tx=0x7fd3d401c520 comp rx=0 tx=0).stop 2024-09-15T21:54:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 -- 172.21.15.70:0/3789166885 shutdown_connections 2024-09-15T21:54:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 --2- 172.21.15.70:0/3789166885 >> v2:172.21.15.1:3300/0 conn(0x7fd3e414b440 0x7fd3e414b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 --2- 172.21.15.70:0/3789166885 >> v2:172.21.15.70:3300/0 conn(0x7fd3e40b0f10 0x7fd3e414af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 --2- 172.21.15.70:0/3789166885 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 0x7fd3e406bfa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 -- 172.21.15.70:0/3789166885 >> 172.21.15.70:0/3789166885 conn(0x7fd3e40b6dc0 msgr2=0x7fd3e40b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 -- 172.21.15.70:0/3789166885 shutdown_connections 2024-09-15T21:54:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 -- 172.21.15.70:0/3789166885 wait complete. 2024-09-15T21:54:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 Processor -- start 2024-09-15T21:54:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 -- start start 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 0x7fd3e40b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3e40b0f10 0x7fd3e409f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3e414b440 0x7fd3e4142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e41481a0 con 0x7fd3e414b440 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e4148320 con 0x7fd3e40b0f10 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e9417640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e41484a0 con 0x7fd3e40af540 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e2ffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 0x7fd3e40b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e27fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3e40b0f10 0x7fd3e409f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e2ffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 0x7fd3e40b1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:60716/0 (socket says 172.21.15.70:60716) 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.950+0000 7fd3e2ffd640 1 -- 172.21.15.70:0/3558585669 learned_addr learned my addr 172.21.15.70:0/3558585669 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3e37fe640 1 --2- 172.21.15.70:0/3558585669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3e414b440 0x7fd3e4142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3e27fc640 1 -- 172.21.15.70:0/3558585669 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 msgr2=0x7fd3e40b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3e27fc640 1 --2- 172.21.15.70:0/3558585669 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 0x7fd3e40b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3e27fc640 1 -- 172.21.15.70:0/3558585669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3e414b440 msgr2=0x7fd3e4142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3e27fc640 1 --2- 172.21.15.70:0/3558585669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3e414b440 0x7fd3e4142980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3e27fc640 1 -- 172.21.15.70:0/3558585669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e40b32e0 con 0x7fd3e40b0f10 2024-09-15T21:54:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3e2ffd640 1 --2- 172.21.15.70:0/3558585669 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 0x7fd3e40b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:54:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3e37fe640 1 --2- 172.21.15.70:0/3558585669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3e414b440 0x7fd3e4142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:54:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3e27fc640 1 --2- 172.21.15.70:0/3558585669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3e40b0f10 0x7fd3e409f9e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800e980 tx=0x7fd3d800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3cb7fe640 1 -- 172.21.15.70:0/3558585669 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8017070 con 0x7fd3e40b0f10 2024-09-15T21:54:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3cb7fe640 1 -- 172.21.15.70:0/3558585669 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d800ca00 con 0x7fd3e40b0f10 2024-09-15T21:54:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3e9417640 1 -- 172.21.15.70:0/3558585669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e40b3620 con 0x7fd3e40b0f10 2024-09-15T21:54:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3cb7fe640 1 -- 172.21.15.70:0/3558585669 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d800cdf0 con 0x7fd3e40b0f10 2024-09-15T21:54:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3e9417640 1 -- 172.21.15.70:0/3558585669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e40b4320 con 0x7fd3e40b0f10 2024-09-15T21:54:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3cb7fe640 1 -- 172.21.15.70:0/3558585669 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd3d801a070 con 0x7fd3e40b0f10 2024-09-15T21:54:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3cb7fe640 1 -- 172.21.15.70:0/3558585669 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fd3d80064d0 con 0x7fd3e40b0f10 2024-09-15T21:54:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3e9417640 1 -- 172.21.15.70:0/3558585669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e40b2090 con 0x7fd3e40b0f10 2024-09-15T21:54:58.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:58.954+0000 7fd3cb7fe640 1 -- 172.21.15.70:0/3558585669 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd3e40b3620 con 0x7fd3e40b0f10 2024-09-15T21:54:59.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.026+0000 7fd3e9417640 1 -- 172.21.15.70:0/3558585669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ebb7a66f-2d89-4df5-b18b-2c305cef9cb4", "id": 6} v 0) -- 0x7fd3e40b7480 con 0x7fd3e40b0f10 2024-09-15T21:54:59.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.030+0000 7fd3cb7fe640 1 -- 172.21.15.70:0/3558585669 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ebb7a66f-2d89-4df5-b18b-2c305cef9cb4", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fd3d8009360 con 0x7fd3e40b0f10 2024-09-15T21:54:59.032 INFO:teuthology.orchestra.run.smithi070.stdout:6 2024-09-15T21:54:59.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.034+0000 7fd3e9417640 1 -- 172.21.15.70:0/3558585669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3e40b0f10 msgr2=0x7fd3e409f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:59.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.034+0000 7fd3e9417640 1 --2- 172.21.15.70:0/3558585669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3e40b0f10 0x7fd3e409f9e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800e980 tx=0x7fd3d800ee40 comp rx=0 tx=0).stop 2024-09-15T21:54:59.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.034+0000 7fd3e9417640 1 -- 172.21.15.70:0/3558585669 shutdown_connections 2024-09-15T21:54:59.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.034+0000 7fd3e9417640 1 --2- 172.21.15.70:0/3558585669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd3e414b440 0x7fd3e4142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.034+0000 7fd3e9417640 1 --2- 172.21.15.70:0/3558585669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3e40b0f10 0x7fd3e409f9e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.034+0000 7fd3e9417640 1 --2- 172.21.15.70:0/3558585669 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3e40af540 0x7fd3e40b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.034+0000 7fd3e9417640 1 -- 172.21.15.70:0/3558585669 >> 172.21.15.70:0/3558585669 conn(0x7fd3e40b6dc0 msgr2=0x7fd3e409c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:59.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.034+0000 7fd3e9417640 1 -- 172.21.15.70:0/3558585669 shutdown_connections 2024-09-15T21:54:59.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.034+0000 7fd3e9417640 1 -- 172.21.15.70:0/3558585669 wait complete. 2024-09-15T21:54:59.044 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:59.046+0000 7f3970d6a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T21:54:59.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new f5ff9c93-d38e-4cca-9949-5fc533aeaad1 7 2024-09-15T21:54:59.073 INFO:tasks.ceph.mgr.y.smithi001.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-15T21:54:59.073 INFO:tasks.ceph.mgr.y.smithi001.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-15T21:54:59.073 INFO:tasks.ceph.mgr.y.smithi001.stderr: from numpy import show_config as show_numpy_config 2024-09-15T21:54:59.108 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:59.110+0000 7f3970d6a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T21:54:59.121 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:59.118+0000 7f5339589180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T21:54:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.162+0000 7f700f2b7640 1 Processor -- start 2024-09-15T21:54:59.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.162+0000 7f700f2b7640 1 -- start start 2024-09-15T21:54:59.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.162+0000 7f700f2b7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70080730b0 0x7f700809d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:59.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.162+0000 7f700f2b7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7008142f80 0x7f70080bbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:59.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.162+0000 7f700f2b7640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7008073540 con 0x7f7008068370 2024-09-15T21:54:59.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.162+0000 7f700f2b7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f70080b8c50 con 0x7f7008142f80 2024-09-15T21:54:59.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.162+0000 7f700f2b7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7008068750 con 0x7f70080730b0 2024-09-15T21:54:59.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700d854640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7008142f80 0x7f70080bbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:59.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700c852640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70080730b0 0x7f700809d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:59.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700c852640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70080730b0 0x7f700809d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:60722/0 (socket says 172.21.15.70:60722) 2024-09-15T21:54:59.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700d854640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7008142f80 0x7f70080bbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37002/0 (socket says 172.21.15.70:37002) 2024-09-15T21:54:59.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700c852640 1 -- 172.21.15.70:0/3656564225 learned_addr learned my addr 172.21.15.70:0/3656564225 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:59.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700c852640 1 -- 172.21.15.70:0/3656564225 >> v2:172.21.15.70:3300/0 conn(0x7f7008142f80 msgr2=0x7f70080bbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:59.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700c852640 1 --2- 172.21.15.70:0/3656564225 >> v2:172.21.15.70:3300/0 conn(0x7f7008142f80 0x7f70080bbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700c852640 1 -- 172.21.15.70:0/3656564225 >> v1:172.21.15.1:6789/0 conn(0x7f7008068370 legacy=0x7f7008142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:59.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700c852640 1 -- 172.21.15.70:0/3656564225 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70080b8970 con 0x7f70080730b0 2024-09-15T21:54:59.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700d854640 1 --2- 172.21.15.70:0/3656564225 >> v2:172.21.15.70:3300/0 conn(0x7f7008142f80 0x7f70080bbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:54:59.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700c852640 1 --2- 172.21.15.70:0/3656564225 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70080730b0 0x7f700809d1f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009870 tx=0x7f6ff801c2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e2e9d8a1419d756 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:59.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f6ffffff640 1 -- 172.21.15.70:0/3656564225 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80b0070 con 0x7f70080730b0 2024-09-15T21:54:59.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f6ffffff640 1 -- 172.21.15.70:0/3656564225 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff80ab600 con 0x7f70080730b0 2024-09-15T21:54:59.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f6ffffff640 1 -- 172.21.15.70:0/3656564225 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80ab9d0 con 0x7f70080730b0 2024-09-15T21:54:59.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700f2b7640 1 -- 172.21.15.70:0/3656564225 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70080730b0 msgr2=0x7f700809d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:59.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700f2b7640 1 --2- 172.21.15.70:0/3656564225 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70080730b0 0x7f700809d1f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009870 tx=0x7f6ff801c2b0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700f2b7640 1 -- 172.21.15.70:0/3656564225 shutdown_connections 2024-09-15T21:54:59.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700f2b7640 1 --2- 172.21.15.70:0/3656564225 >> v2:172.21.15.70:3300/0 conn(0x7f7008142f80 0x7f70080bbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700f2b7640 1 --2- 172.21.15.70:0/3656564225 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70080730b0 0x7f700809d1f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700f2b7640 1 -- 172.21.15.70:0/3656564225 >> 172.21.15.70:0/3656564225 conn(0x7f70080a09b0 msgr2=0x7f7008067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:59.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700f2b7640 1 -- 172.21.15.70:0/3656564225 shutdown_connections 2024-09-15T21:54:59.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.166+0000 7f700f2b7640 1 -- 172.21.15.70:0/3656564225 wait complete. 2024-09-15T21:54:59.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700f2b7640 1 Processor -- start 2024-09-15T21:54:59.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700f2b7640 1 -- start start 2024-09-15T21:54:59.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700f2b7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7008068370 0x7f700806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:59.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700f2b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f700809e7c0 0x7f70081e3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:59.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700f2b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70081e3d50 0x7f7008148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:59.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700f2b7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7008152950 con 0x7f70081e3d50 2024-09-15T21:54:59.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700f2b7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f70081527d0 con 0x7f700809e7c0 2024-09-15T21:54:59.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700f2b7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7008152ad0 con 0x7f7008068370 2024-09-15T21:54:59.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700c852640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f700809e7c0 0x7f70081e3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:59.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700c852640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f700809e7c0 0x7f70081e3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37018/0 (socket says 172.21.15.70:37018) 2024-09-15T21:54:59.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700c852640 1 -- 172.21.15.70:0/2246908772 learned_addr learned my addr 172.21.15.70:0/2246908772 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-15T21:54:59.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700d053640 1 --2- 172.21.15.70:0/2246908772 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7008068370 0x7f700806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:59.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700d854640 1 --2- 172.21.15.70:0/2246908772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70081e3d50 0x7f7008148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:59.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700c852640 1 -- 172.21.15.70:0/2246908772 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7008068370 msgr2=0x7f700806dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:59.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700c852640 1 --2- 172.21.15.70:0/2246908772 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7008068370 0x7f700806dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700c852640 1 -- 172.21.15.70:0/2246908772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70081e3d50 msgr2=0x7f7008148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:59.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700c852640 1 --2- 172.21.15.70:0/2246908772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70081e3d50 0x7f7008148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700c852640 1 -- 172.21.15.70:0/2246908772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70081e41d0 con 0x7f700809e7c0 2024-09-15T21:54:59.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700d854640 1 --2- 172.21.15.70:0/2246908772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70081e3d50 0x7f7008148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:54:59.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700c852640 1 --2- 172.21.15.70:0/2246908772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f700809e7c0 0x7f70081e3810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6ff801cb50 tx=0x7f6ff8019050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:59.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f6ffdffb640 1 -- 172.21.15.70:0/2246908772 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80b0040 con 0x7f700809e7c0 2024-09-15T21:54:59.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f6ffdffb640 1 -- 172.21.15.70:0/2246908772 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff80b4420 con 0x7f700809e7c0 2024-09-15T21:54:59.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700f2b7640 1 -- 172.21.15.70:0/2246908772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f700806e530 con 0x7f700809e7c0 2024-09-15T21:54:59.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f6ffdffb640 1 -- 172.21.15.70:0/2246908772 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80b4810 con 0x7f700809e7c0 2024-09-15T21:54:59.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700f2b7640 1 -- 172.21.15.70:0/2246908772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f700806d2e0 con 0x7f700809e7c0 2024-09-15T21:54:59.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f6ffdffb640 1 -- 172.21.15.70:0/2246908772 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ff80b49b0 con 0x7f700809e7c0 2024-09-15T21:54:59.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f6ffdffb640 1 -- 172.21.15.70:0/2246908772 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f6ff80b4ca0 con 0x7f700809e7c0 2024-09-15T21:54:59.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.170+0000 7f700f2b7640 1 -- 172.21.15.70:0/2246908772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f700809d1f0 con 0x7f700809e7c0 2024-09-15T21:54:59.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.174+0000 7f6ffdffb640 1 -- 172.21.15.70:0/2246908772 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f70081e41d0 con 0x7f700809e7c0 2024-09-15T21:54:59.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.242+0000 7f700f2b7640 1 -- 172.21.15.70:0/2246908772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f5ff9c93-d38e-4cca-9949-5fc533aeaad1", "id": 7} v 0) -- 0x7f7008140e40 con 0x7f700809e7c0 2024-09-15T21:54:59.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.250+0000 7f6ffdffb640 1 -- 172.21.15.70:0/2246908772 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f5ff9c93-d38e-4cca-9949-5fc533aeaad1", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f7008073540 con 0x7f700809e7c0 2024-09-15T21:54:59.249 INFO:teuthology.orchestra.run.smithi070.stdout:7 2024-09-15T21:54:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.250+0000 7f700f2b7640 1 -- 172.21.15.70:0/2246908772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f700809e7c0 msgr2=0x7f70081e3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.250+0000 7f700f2b7640 1 --2- 172.21.15.70:0/2246908772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f700809e7c0 0x7f70081e3810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6ff801cb50 tx=0x7f6ff8019050 comp rx=0 tx=0).stop 2024-09-15T21:54:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.250+0000 7f700f2b7640 1 -- 172.21.15.70:0/2246908772 shutdown_connections 2024-09-15T21:54:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.250+0000 7f700f2b7640 1 --2- 172.21.15.70:0/2246908772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70081e3d50 0x7f7008148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.250+0000 7f700f2b7640 1 --2- 172.21.15.70:0/2246908772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f700809e7c0 0x7f70081e3810 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.250+0000 7f700f2b7640 1 --2- 172.21.15.70:0/2246908772 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7008068370 0x7f700806dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.250+0000 7f700f2b7640 1 -- 172.21.15.70:0/2246908772 >> 172.21.15.70:0/2246908772 conn(0x7f70080a09b0 msgr2=0x7f700814eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.250+0000 7f700f2b7640 1 -- 172.21.15.70:0/2246908772 shutdown_connections 2024-09-15T21:54:59.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-15T21:54:59.250+0000 7f700f2b7640 1 -- 172.21.15.70:0/2246908772 wait complete. 2024-09-15T21:54:59.264 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-15T21:54:59.265 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-15T21:54:59.267 INFO:tasks.ceph.osd.0:Started 2024-09-15T21:54:59.267 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-15T21:54:59.267 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-15T21:54:59.270 INFO:tasks.ceph.osd.1:Started 2024-09-15T21:54:59.270 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-15T21:54:59.270 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-15T21:54:59.272 INFO:tasks.ceph.osd.2:Started 2024-09-15T21:54:59.272 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-15T21:54:59.272 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-15T21:54:59.273 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:59.270+0000 7f5339589180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T21:54:59.274 INFO:tasks.ceph.osd.3:Started 2024-09-15T21:54:59.275 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-15T21:54:59.275 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-15T21:54:59.276 INFO:tasks.ceph.osd.4:Started 2024-09-15T21:54:59.277 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-15T21:54:59.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-15T21:54:59.278 INFO:tasks.ceph.osd.5:Started 2024-09-15T21:54:59.279 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-15T21:54:59.279 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-15T21:54:59.280 INFO:tasks.ceph.osd.6:Started 2024-09-15T21:54:59.280 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-15T21:54:59.281 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-15T21:54:59.282 INFO:tasks.ceph.osd.7:Started 2024-09-15T21:54:59.283 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:54:59.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f026047a640 1 Processor -- start 2024-09-15T21:54:59.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f026047a640 1 -- start start 2024-09-15T21:54:59.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f026047a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f02580b7490 0x7f02581531d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:59.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f026047a640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f025806f960 con 0x7f025806f580 2024-09-15T21:54:59.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f026047a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02580b79e0 con 0x7f0258148050 2024-09-15T21:54:59.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f026047a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f02580b6ce0 con 0x7f02580b7490 2024-09-15T21:54:59.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025e216640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f025806f580 0x7f0258147940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:36192/0 (socket says 172.21.15.1:36192) 2024-09-15T21:54:59.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025e216640 1 -- 172.21.15.1:0/3988255570 learned_addr learned my addr 172.21.15.1:0/3988255570 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:54:59.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025ea17640 1 --2- 172.21.15.1:0/3988255570 >> v2:172.21.15.70:3300/0 conn(0x7f02580b7490 0x7f02581531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:59.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2866759018 0 0) 0x7f025806f960 con 0x7f025806f580 2024-09-15T21:54:59.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0240003530 con 0x7f025806f580 2024-09-15T21:54:59.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 407460448 0 0) 0x7f0240003530 con 0x7f025806f580 2024-09-15T21:54:59.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 >> v2:172.21.15.70:3300/0 conn(0x7f02580b7490 msgr2=0x7f02581531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:59.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 --2- 172.21.15.1:0/3988255570 >> v2:172.21.15.70:3300/0 conn(0x7f02580b7490 0x7f02581531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 >> v1:172.21.15.70:6789/0 conn(0x7f0258148050 legacy=0x7f025806e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:59.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02580b6190 con 0x7f025806f580 2024-09-15T21:54:59.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f0250001a00 con 0x7f025806f580 2024-09-15T21:54:59.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 >> v1:172.21.15.1:6789/0 conn(0x7f025806f580 legacy=0x7f0258147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:59.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 --2- 172.21.15.1:0/3988255570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02400039c0 0x7f0240003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:59.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 --2- 172.21.15.1:0/3988255570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0240004810 0x7f0240004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:59.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 --2- 172.21.15.1:0/3988255570 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f02400052f0 0x7f024000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:59.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f02580b6ce0 con 0x7f0240004810 2024-09-15T21:54:59.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f024000c1c0 con 0x7f02400039c0 2024-09-15T21:54:59.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f024000c3c0 con 0x7f02400052f0 2024-09-15T21:54:59.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025da15640 1 --2- 172.21.15.1:0/3988255570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0240004810 0x7f0240004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:59.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025ea17640 1 --2- 172.21.15.1:0/3988255570 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f02400052f0 0x7f024000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:59.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025e216640 1 --2- 172.21.15.1:0/3988255570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02400039c0 0x7f0240003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:59.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025da15640 1 -- 172.21.15.1:0/3988255570 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f02400052f0 msgr2=0x7f024000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:59.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025da15640 1 --2- 172.21.15.1:0/3988255570 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f02400052f0 0x7f024000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025da15640 1 -- 172.21.15.1:0/3988255570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02400039c0 msgr2=0x7f0240003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:54:59.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025da15640 1 --2- 172.21.15.1:0/3988255570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02400039c0 0x7f0240003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.418+0000 7f025ea17640 1 -- 172.21.15.1:0/3988255570 reap_dead start 2024-09-15T21:54:59.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f025da15640 1 -- 172.21.15.1:0/3988255570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0240003530 con 0x7f0240004810 2024-09-15T21:54:59.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f025e216640 1 --2- 172.21.15.1:0/3988255570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02400039c0 0x7f0240003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:54:59.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f025da15640 1 --2- 172.21.15.1:0/3988255570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0240004810 0x7f0240004c90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0258070a10 tx=0x7f024c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f9c716a114c9a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:59.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c0013a0 con 0x7f0240004810 2024-09-15T21:54:59.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024c0052f0 con 0x7f0240004810 2024-09-15T21:54:59.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f025d214640 1 -- 172.21.15.1:0/3988255570 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c003840 con 0x7f0240004810 2024-09-15T21:54:59.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f026047a640 1 -- 172.21.15.1:0/3988255570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0240004810 msgr2=0x7f0240004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:59.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f026047a640 1 --2- 172.21.15.1:0/3988255570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0240004810 0x7f0240004c90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0258070a10 tx=0x7f024c01c370 comp rx=0 tx=0).stop 2024-09-15T21:54:59.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f026047a640 1 -- 172.21.15.1:0/3988255570 shutdown_connections 2024-09-15T21:54:59.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f026047a640 1 --2- 172.21.15.1:0/3988255570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0240004810 0x7f0240004c90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f026047a640 1 -- 172.21.15.1:0/3988255570 >> 172.21.15.1:0/3988255570 conn(0x7f02580bb340 msgr2=0x7f02580bb750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:59.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f026047a640 1 -- 172.21.15.1:0/3988255570 shutdown_connections 2024-09-15T21:54:59.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f026047a640 1 -- 172.21.15.1:0/3988255570 wait complete. 2024-09-15T21:54:59.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f026047a640 1 Processor -- start 2024-09-15T21:54:59.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.422+0000 7f026047a640 1 -- start start 2024-09-15T21:54:59.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f026047a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0240004810 0x7f02580a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:59.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f026047a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f025809acb0 0x7f025809b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f026047a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02581425e0 0x7f0258142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f026047a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0258147ed0 con 0x7f02581425e0 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f026047a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0258147d50 con 0x7f0240004810 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f026047a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f02580b5d40 con 0x7f025809acb0 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f025ea17640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02581425e0 0x7f0258142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f025ea17640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02581425e0 0x7f0258142a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51862/0 (socket says 172.21.15.1:51862) 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f025ea17640 1 -- 172.21.15.1:0/3273397672 learned_addr learned my addr 172.21.15.1:0/3273397672 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f025da15640 1 --2- 172.21.15.1:0/3273397672 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f025809acb0 0x7f025809b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f025ea17640 1 -- 172.21.15.1:0/3273397672 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f025809acb0 msgr2=0x7f025809b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f025ea17640 1 --2- 172.21.15.1:0/3273397672 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f025809acb0 0x7f025809b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f025ea17640 1 -- 172.21.15.1:0/3273397672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0240004810 msgr2=0x7f02580a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f025ea17640 1 --2- 172.21.15.1:0/3273397672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0240004810 0x7f02580a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f025ea17640 1 -- 172.21.15.1:0/3273397672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f025809d8f0 con 0x7f02581425e0 2024-09-15T21:54:59.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f025ea17640 1 --2- 172.21.15.1:0/3273397672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02581425e0 0x7f0258142a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f025814ae60 tx=0x7f0248011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:54:59.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f0256ffd640 1 -- 172.21.15.1:0/3273397672 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248003620 con 0x7f02581425e0 2024-09-15T21:54:59.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f0256ffd640 1 -- 172.21.15.1:0/3273397672 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024801b070 con 0x7f02581425e0 2024-09-15T21:54:59.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f026047a640 1 -- 172.21.15.1:0/3273397672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f025809cb10 con 0x7f02581425e0 2024-09-15T21:54:59.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f0256ffd640 1 -- 172.21.15.1:0/3273397672 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248003a40 con 0x7f02581425e0 2024-09-15T21:54:59.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f026047a640 1 -- 172.21.15.1:0/3273397672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f025814aa60 con 0x7f02581425e0 2024-09-15T21:54:59.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f0256ffd640 1 -- 172.21.15.1:0/3273397672 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f02480059a0 con 0x7f02581425e0 2024-09-15T21:54:59.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f0256ffd640 1 -- 172.21.15.1:0/3273397672 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f02480067a0 con 0x7f02581425e0 2024-09-15T21:54:59.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.426+0000 7f026047a640 1 -- 172.21.15.1:0/3273397672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02580b5a30 con 0x7f02581425e0 2024-09-15T21:54:59.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.430+0000 7f0256ffd640 1 -- 172.21.15.1:0/3273397672 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0248006020 con 0x7f02581425e0 2024-09-15T21:54:59.466 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:59.462+0000 7f5339589180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T21:54:59.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.486+0000 7f026047a640 1 -- 172.21.15.1:0/3273397672 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02580a08d0 con 0x7f02581425e0 2024-09-15T21:54:59.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.486+0000 7f0256ffd640 1 -- 172.21.15.1:0/3273397672 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0248006200 con 0x7f02581425e0 2024-09-15T21:54:59.490 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:54:59.490 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":10,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:54:59.245298+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:54:59.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.490+0000 7f026047a640 1 -- 172.21.15.1:0/3273397672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02581425e0 msgr2=0x7f0258142a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:54:59.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.490+0000 7f026047a640 1 --2- 172.21.15.1:0/3273397672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02581425e0 0x7f0258142a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f025814ae60 tx=0x7f0248011920 comp rx=0 tx=0).stop 2024-09-15T21:54:59.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.490+0000 7f026047a640 1 -- 172.21.15.1:0/3273397672 shutdown_connections 2024-09-15T21:54:59.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.490+0000 7f026047a640 1 --2- 172.21.15.1:0/3273397672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f02581425e0 0x7f0258142a60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.490+0000 7f026047a640 1 --2- 172.21.15.1:0/3273397672 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f025809acb0 0x7f025809b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.490+0000 7f026047a640 1 --2- 172.21.15.1:0/3273397672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0240004810 0x7f02580a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:54:59.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.490+0000 7f026047a640 1 -- 172.21.15.1:0/3273397672 >> 172.21.15.1:0/3273397672 conn(0x7f02580bb340 msgr2=0x7f0258073150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:54:59.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.490+0000 7f026047a640 1 -- 172.21.15.1:0/3273397672 shutdown_connections 2024-09-15T21:54:59.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:54:59.490+0000 7f026047a640 1 -- 172.21.15.1:0/3273397672 wait complete. 2024-09-15T21:54:59.507 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-15T21:54:59.507 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-15T21:54:59.534 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:59.530+0000 7f5339589180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T21:54:59.676 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:54:59.674+0000 7f5339589180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T21:54:59.758 INFO:tasks.ceph.mgr.x.smithi070.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-15T21:54:59.758 INFO:tasks.ceph.mgr.x.smithi070.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-15T21:54:59.758 INFO:tasks.ceph.mgr.x.smithi070.stderr: from numpy import show_config as show_numpy_config 2024-09-15T21:54:59.812 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:59.810+0000 7f3970d6a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T21:54:59.974 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:54:59.974+0000 7f3970d6a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T21:55:00.137 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:55:00.138+0000 7f3970d6a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T21:55:00.206 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:55:00.206+0000 7f3970d6a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T21:55:00.307 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:55:00.302+0000 7f5339589180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T21:55:00.313 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:00.355 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:55:00.354+0000 7f3970d6a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T21:55:00.387 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:55:00.386+0000 7f5339589180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T21:55:00.412 INFO:tasks.ceph.osd.2.smithi001.stderr:2024-09-15T21:55:00.410+0000 7fe7bf5dd7c0 -1 Falling back to public interface 2024-09-15T21:55:00.422 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.418+0000 7f04ce70c640 1 Processor -- start 2024-09-15T21:55:00.422 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.418+0000 7f04ce70c640 1 -- start start 2024-09-15T21:55:00.423 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.418+0000 7f04ce70c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f04c80b5fc0 0x7f04c8148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:00.423 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.418+0000 7f04ce70c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04c80b66d0 0x7f04c80b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:00.423 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.418+0000 7f04ce70c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f04c80b6b10 0x7f04c80b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:00.423 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.418+0000 7f04ce70c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f04c806f980 con 0x7f04c80b6b10 2024-09-15T21:55:00.424 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.418+0000 7f04ce70c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f04c80b78b0 con 0x7f04c80b5fc0 2024-09-15T21:55:00.424 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.418+0000 7f04ce70c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f04c80b63a0 con 0x7f04c80b66d0 2024-09-15T21:55:00.424 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ccca9640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f04c80b6b10 0x7f04c80b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:00.424 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ccca9640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f04c80b6b10 0x7f04c80b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51868/0 (socket says 172.21.15.1:51868) 2024-09-15T21:55:00.424 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ccca9640 1 -- 172.21.15.1:0/844728326 learned_addr learned my addr 172.21.15.1:0/844728326 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:00.424 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04c77fe640 1 --2- 172.21.15.1:0/844728326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04c80b66d0 0x7f04c80b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:00.424 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04c7fff640 1 --2- 172.21.15.1:0/844728326 >> v2:172.21.15.70:3300/0 conn(0x7f04c80b5fc0 0x7f04c8148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:00.424 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ccca9640 1 -- 172.21.15.1:0/844728326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04c80b66d0 msgr2=0x7f04c80b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:00.424 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ccca9640 1 --2- 172.21.15.1:0/844728326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04c80b66d0 0x7f04c80b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:00.424 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ccca9640 1 -- 172.21.15.1:0/844728326 >> v2:172.21.15.70:3300/0 conn(0x7f04c80b5fc0 msgr2=0x7f04c8148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:00.424 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ccca9640 1 --2- 172.21.15.1:0/844728326 >> v2:172.21.15.70:3300/0 conn(0x7f04c80b5fc0 0x7f04c8148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:00.424 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ccca9640 1 -- 172.21.15.1:0/844728326 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c806f330 con 0x7f04c80b6b10 2024-09-15T21:55:00.425 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ccca9640 1 --2- 172.21.15.1:0/844728326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04c80b6b10 0x7f04c80b20c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f04c80b8e70 tx=0x7f04c001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71aff719e8517860 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:00.425 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04c6ffd640 1 -- 172.21.15.1:0/844728326 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c00a5660 con 0x7f04c80b6b10 2024-09-15T21:55:00.426 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04c6ffd640 1 -- 172.21.15.1:0/844728326 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c00a5800 con 0x7f04c80b6b10 2024-09-15T21:55:00.426 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04c6ffd640 1 -- 172.21.15.1:0/844728326 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c00a5bd0 con 0x7f04c80b6b10 2024-09-15T21:55:00.426 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ce70c640 1 -- 172.21.15.1:0/844728326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04c80b6b10 msgr2=0x7f04c80b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:00.427 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ce70c640 1 --2- 172.21.15.1:0/844728326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04c80b6b10 0x7f04c80b20c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f04c80b8e70 tx=0x7f04c001c8d0 comp rx=0 tx=0).stop 2024-09-15T21:55:00.427 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ce70c640 1 -- 172.21.15.1:0/844728326 shutdown_connections 2024-09-15T21:55:00.427 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ce70c640 1 --2- 172.21.15.1:0/844728326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04c80b6b10 0x7f04c80b20c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:00.427 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ce70c640 1 --2- 172.21.15.1:0/844728326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04c80b66d0 0x7f04c80b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:00.427 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ce70c640 1 --2- 172.21.15.1:0/844728326 >> v2:172.21.15.70:3300/0 conn(0x7f04c80b5fc0 0x7f04c8148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:00.427 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ce70c640 1 -- 172.21.15.1:0/844728326 >> 172.21.15.1:0/844728326 conn(0x7f04c806c7f0 msgr2=0x7f04c80bb360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:00.427 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ce70c640 1 -- 172.21.15.1:0/844728326 shutdown_connections 2024-09-15T21:55:00.427 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.422+0000 7f04ce70c640 1 -- 172.21.15.1:0/844728326 wait complete. 2024-09-15T21:55:00.429 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04ce70c640 1 Processor -- start 2024-09-15T21:55:00.430 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04ce70c640 1 -- start start 2024-09-15T21:55:00.430 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04ce70c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04c80b5fc0 0x7f04c809c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:00.430 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04ce70c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04c80b66d0 0x7f04c809d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:00.430 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04ce70c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04c80b6b10 0x7f04c81de320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:00.430 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04ce70c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f04c8149360 con 0x7f04c80b66d0 2024-09-15T21:55:00.430 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04ce70c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f04c81491e0 con 0x7f04c80b6b10 2024-09-15T21:55:00.430 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04ce70c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f04c8072ce0 con 0x7f04c80b5fc0 2024-09-15T21:55:00.430 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04c80b66d0 0x7f04c809d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:00.430 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04c80b66d0 0x7f04c809d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51884/0 (socket says 172.21.15.1:51884) 2024-09-15T21:55:00.430 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c77fe640 1 -- 172.21.15.1:0/3056492903 learned_addr learned my addr 172.21.15.1:0/3056492903 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:00.430 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c7fff640 1 --2- 172.21.15.1:0/3056492903 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04c80b5fc0 0x7f04c809c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:00.430 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04ccca9640 1 --2- 172.21.15.1:0/3056492903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04c80b6b10 0x7f04c81de320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:00.430 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c77fe640 1 -- 172.21.15.1:0/3056492903 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04c80b5fc0 msgr2=0x7f04c809c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:00.431 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c77fe640 1 --2- 172.21.15.1:0/3056492903 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04c80b5fc0 0x7f04c809c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:00.431 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c77fe640 1 -- 172.21.15.1:0/3056492903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04c80b6b10 msgr2=0x7f04c81de320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:00.431 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c77fe640 1 --2- 172.21.15.1:0/3056492903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04c80b6b10 0x7f04c81de320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:00.431 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c77fe640 1 -- 172.21.15.1:0/3056492903 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c80b2b80 con 0x7f04c80b66d0 2024-09-15T21:55:00.431 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04ccca9640 1 --2- 172.21.15.1:0/3056492903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04c80b6b10 0x7f04c81de320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:00.431 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c77fe640 1 --2- 172.21.15.1:0/3056492903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04c80b66d0 0x7f04c809d470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f04b800d800 tx=0x7f04b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:00.431 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c4ff9640 1 -- 172.21.15.1:0/3056492903 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b800b6c0 con 0x7f04c80b66d0 2024-09-15T21:55:00.431 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c4ff9640 1 -- 172.21.15.1:0/3056492903 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b8019070 con 0x7f04c80b66d0 2024-09-15T21:55:00.431 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04ce70c640 1 -- 172.21.15.1:0/3056492903 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c80b2e60 con 0x7f04c80b66d0 2024-09-15T21:55:00.431 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c4ff9640 1 -- 172.21.15.1:0/3056492903 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b800ba60 con 0x7f04c80b66d0 2024-09-15T21:55:00.431 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04ce70c640 1 -- 172.21.15.1:0/3056492903 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c809b4e0 con 0x7f04c80b66d0 2024-09-15T21:55:00.431 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c4ff9640 1 -- 172.21.15.1:0/3056492903 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f04b800bc00 con 0x7f04c80b66d0 2024-09-15T21:55:00.431 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04c4ff9640 1 -- 172.21.15.1:0/3056492903 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f04b8014c30 con 0x7f04c80b66d0 2024-09-15T21:55:00.432 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.426+0000 7f04ce70c640 1 -- 172.21.15.1:0/3056492903 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04c80730c0 con 0x7f04c80b66d0 2024-09-15T21:55:00.432 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.430+0000 7f04c4ff9640 1 -- 172.21.15.1:0/3056492903 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f04b8014520 con 0x7f04c80b66d0 2024-09-15T21:55:00.490 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.486+0000 7f04ce70c640 1 -- 172.21.15.1:0/3056492903 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04c80b7560 con 0x7f04c80b66d0 2024-09-15T21:55:00.490 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.486+0000 7f04c4ff9640 1 -- 172.21.15.1:0/3056492903 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f04b8014700 con 0x7f04c80b66d0 2024-09-15T21:55:00.490 INFO:teuthology.misc.health.smithi001.stdout: 2024-09-15T21:55:00.491 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":10,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:54:59.245298+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:00.492 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.490+0000 7f04ce70c640 1 -- 172.21.15.1:0/3056492903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04c80b66d0 msgr2=0x7f04c809d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:00.492 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.490+0000 7f04ce70c640 1 --2- 172.21.15.1:0/3056492903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04c80b66d0 0x7f04c809d470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f04b800d800 tx=0x7f04b800dcc0 comp rx=0 tx=0).stop 2024-09-15T21:55:00.492 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.490+0000 7f04ce70c640 1 -- 172.21.15.1:0/3056492903 shutdown_connections 2024-09-15T21:55:00.492 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.490+0000 7f04ce70c640 1 --2- 172.21.15.1:0/3056492903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04c80b6b10 0x7f04c81de320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:00.492 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.490+0000 7f04ce70c640 1 --2- 172.21.15.1:0/3056492903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04c80b66d0 0x7f04c809d470 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:00.492 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.490+0000 7f04ce70c640 1 --2- 172.21.15.1:0/3056492903 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f04c80b5fc0 0x7f04c809c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:00.492 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.490+0000 7f04ce70c640 1 -- 172.21.15.1:0/3056492903 >> 172.21.15.1:0/3056492903 conn(0x7f04c806c7f0 msgr2=0x7f04c80b7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:00.492 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.490+0000 7f04ce70c640 1 -- 172.21.15.1:0/3056492903 shutdown_connections 2024-09-15T21:55:00.492 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:00.490+0000 7f04ce70c640 1 -- 172.21.15.1:0/3056492903 wait complete. 2024-09-15T21:55:00.506 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-15T21:55:00.582 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:55:00.578+0000 7f5339589180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T21:55:00.659 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:55:00.658+0000 7f5339589180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T21:55:00.898 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-09-15T21:55:00.898+0000 7fb4155ee7c0 -1 Falling back to public interface 2024-09-15T21:55:00.930 INFO:tasks.ceph.osd.7.smithi070.stderr:2024-09-15T21:55:00.930+0000 7f2cdb4897c0 -1 Falling back to public interface 2024-09-15T21:55:00.966 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:55:00.966+0000 7f3970d6a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T21:55:00.967 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:55:00.966+0000 7f5339589180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T21:55:01.032 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:55:01.030+0000 7f5339589180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T21:55:01.041 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:55:01.042+0000 7f3970d6a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T21:55:01.125 INFO:tasks.ceph.osd.4.smithi070.stderr:2024-09-15T21:55:01.126+0000 7f2e321957c0 -1 Falling back to public interface 2024-09-15T21:55:01.230 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:55:01.230+0000 7f3970d6a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T21:55:01.303 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:55:01.302+0000 7f3970d6a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T21:55:01.387 INFO:tasks.ceph.osd.6.smithi070.stderr:2024-09-15T21:55:01.386+0000 7f2d2b0cb7c0 -1 Falling back to public interface 2024-09-15T21:55:01.441 INFO:tasks.ceph.osd.3.smithi001.stderr:2024-09-15T21:55:01.438+0000 7f49e9d357c0 -1 Falling back to public interface 2024-09-15T21:55:01.444 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-09-15T21:55:01.442+0000 7f1ee2bf07c0 -1 Falling back to public interface 2024-09-15T21:55:01.451 INFO:tasks.ceph.osd.1.smithi001.stderr:2024-09-15T21:55:01.450+0000 7f795ebbe7c0 -1 Falling back to public interface 2024-09-15T21:55:01.599 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:55:01.598+0000 7f3970d6a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T21:55:01.661 INFO:tasks.ceph.mgr.x.smithi070.stderr:2024-09-15T21:55:01.662+0000 7f3970d6a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T21:55:02.072 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:55:02.070+0000 7f52e00c0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-15T21:55:02.072 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-09-15T21:55:02.070+0000 7f52e00c0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-15T21:55:05.171 INFO:tasks.ceph.osd.7.smithi070.stderr:2024-09-15T21:55:05.170+0000 7f2cdb4897c0 -1 osd.7 0 log_to_monitors true 2024-09-15T21:55:05.216 INFO:tasks.ceph.osd.2.smithi001.stderr:2024-09-15T21:55:05.214+0000 7fe7bf5dd7c0 -1 osd.2 0 log_to_monitors true 2024-09-15T21:55:05.660 INFO:tasks.ceph.osd.4.smithi070.stderr:2024-09-15T21:55:05.657+0000 7f2e321957c0 -1 osd.4 0 log_to_monitors true 2024-09-15T21:55:05.805 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-09-15T21:55:05.802+0000 7f1ee2bf07c0 -1 osd.0 0 log_to_monitors true 2024-09-15T21:55:05.870 INFO:tasks.ceph.osd.6.smithi070.stderr:2024-09-15T21:55:05.869+0000 7f2d2b0cb7c0 -1 osd.6 0 log_to_monitors true 2024-09-15T21:55:05.935 INFO:tasks.ceph.osd.3.smithi001.stderr:2024-09-15T21:55:05.934+0000 7f49e9d357c0 -1 osd.3 0 log_to_monitors true 2024-09-15T21:55:05.952 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-09-15T21:55:05.949+0000 7fb4155ee7c0 -1 osd.5 0 log_to_monitors true 2024-09-15T21:55:05.962 INFO:tasks.ceph.osd.1.smithi001.stderr:2024-09-15T21:55:05.958+0000 7f795ebbe7c0 -1 osd.1 0 log_to_monitors true 2024-09-15T21:55:07.116 INFO:tasks.ceph.osd.7.smithi070.stderr:2024-09-15T21:55:07.113+0000 7f2cd6c0f640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T21:55:07.130 INFO:tasks.ceph.osd.7.smithi070.stderr:2024-09-15T21:55:07.129+0000 7f2ccf256640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T21:55:07.244 INFO:tasks.ceph.osd.2.smithi001.stderr:2024-09-15T21:55:07.242+0000 7fe7bad63640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T21:55:07.268 INFO:tasks.ceph.osd.2.smithi001.stderr:2024-09-15T21:55:07.266+0000 7fe7b33aa640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T21:55:07.313 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:07.451 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e6bfcf640 1 Processor -- start 2024-09-15T21:55:07.451 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e6bfcf640 1 -- start start 2024-09-15T21:55:07.452 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e6bfcf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e640734b0 0x7f3e64144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:07.452 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e6bfcf640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e640b79e0 con 0x7f3e640b7600 2024-09-15T21:55:07.452 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e6bfcf640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e640b6a50 con 0x7f3e640b6380 2024-09-15T21:55:07.452 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e6bfcf640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3e640b6810 con 0x7f3e640734b0 2024-09-15T21:55:07.452 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e69d6b640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3e640b7600 0x7f3e6409c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45982/0 (socket says 172.21.15.1:45982) 2024-09-15T21:55:07.453 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e69d6b640 1 -- 172.21.15.1:0/4064259378 learned_addr learned my addr 172.21.15.1:0/4064259378 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:07.454 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 -- 172.21.15.1:0/4064259378 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2965498650 0 0) 0x7f3e640b79e0 con 0x7f3e640b7600 2024-09-15T21:55:07.454 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 -- 172.21.15.1:0/4064259378 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e50005740 con 0x7f3e640b7600 2024-09-15T21:55:07.454 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 -- 172.21.15.1:0/4064259378 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1894637043 0 0) 0x7f3e50005740 con 0x7f3e640b7600 2024-09-15T21:55:07.454 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 -- 172.21.15.1:0/4064259378 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e640734b0 msgr2=0x7f3e64144750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T21:55:07.454 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 --2- 172.21.15.1:0/4064259378 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e640734b0 0x7f3e64144750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:07.454 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 -- 172.21.15.1:0/4064259378 >> v1:172.21.15.70:6789/0 conn(0x7f3e640b6380 legacy=0x7f3e6414ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:07.454 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 -- 172.21.15.1:0/4064259378 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e640afcd0 con 0x7f3e640b7600 2024-09-15T21:55:07.454 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 -- 172.21.15.1:0/4064259378 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f3e60001800 con 0x7f3e640b7600 2024-09-15T21:55:07.454 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 -- 172.21.15.1:0/4064259378 >> v1:172.21.15.1:6789/0 conn(0x7f3e640b7600 legacy=0x7f3e6409c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:07.455 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 --2- 172.21.15.1:0/4064259378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e50005c00 0x7f3e50006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:07.455 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 --2- 172.21.15.1:0/4064259378 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e50006a20 0x7f3e50006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:07.455 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 --2- 172.21.15.1:0/4064259378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e500075e0 0x7f3e5000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:07.455 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 -- 172.21.15.1:0/4064259378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3e640b6810 con 0x7f3e50005c00 2024-09-15T21:55:07.455 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 -- 172.21.15.1:0/4064259378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5000e470 con 0x7f3e500075e0 2024-09-15T21:55:07.455 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e68d69640 1 -- 172.21.15.1:0/4064259378 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5000e670 con 0x7f3e50006a20 2024-09-15T21:55:07.455 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e69d6b640 1 --2- 172.21.15.1:0/4064259378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e50005c00 0x7f3e50006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:07.455 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e6a56c640 1 --2- 172.21.15.1:0/4064259378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e500075e0 0x7f3e5000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:07.455 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e69d6b640 1 -- 172.21.15.1:0/4064259378 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e50006a20 msgr2=0x7f3e50006ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T21:55:07.455 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e69d6b640 1 --2- 172.21.15.1:0/4064259378 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e50006a20 0x7f3e50006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:07.455 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e69d6b640 1 -- 172.21.15.1:0/4064259378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e500075e0 msgr2=0x7f3e5000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:07.455 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e69d6b640 1 --2- 172.21.15.1:0/4064259378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e500075e0 0x7f3e5000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:07.455 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.450+0000 7f3e69d6b640 1 -- 172.21.15.1:0/4064259378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e50005740 con 0x7f3e50005c00 2024-09-15T21:55:07.456 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.454+0000 7f3e69d6b640 1 --2- 172.21.15.1:0/4064259378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e50005c00 0x7f3e50006020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000c160 tx=0x7f3e6001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e513494c1618d114 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:07.457 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.454+0000 7f3e68d69640 1 -- 172.21.15.1:0/4064259378 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e60007c70 con 0x7f3e50005c00 2024-09-15T21:55:07.457 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.454+0000 7f3e68d69640 1 -- 172.21.15.1:0/4064259378 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e600a9070 con 0x7f3e50005c00 2024-09-15T21:55:07.458 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.454+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/4064259378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e50005c00 msgr2=0x7f3e50006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:07.458 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.454+0000 7f3e6bfcf640 1 --2- 172.21.15.1:0/4064259378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e50005c00 0x7f3e50006020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000c160 tx=0x7f3e6001cba0 comp rx=0 tx=0).stop 2024-09-15T21:55:07.458 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.454+0000 7f3e6a56c640 1 -- 172.21.15.1:0/4064259378 reap_dead start 2024-09-15T21:55:07.458 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.454+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/4064259378 shutdown_connections 2024-09-15T21:55:07.458 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.454+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/4064259378 >> 172.21.15.1:0/4064259378 conn(0x7f3e640ba790 msgr2=0x7f3e640b6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:07.458 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.454+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/4064259378 shutdown_connections 2024-09-15T21:55:07.459 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.454+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/4064259378 wait complete. 2024-09-15T21:55:07.459 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6bfcf640 1 Processor -- start 2024-09-15T21:55:07.460 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6bfcf640 1 -- start start 2024-09-15T21:55:07.461 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6bfcf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e64071350 0x7f3e64140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:07.461 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6bfcf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64072fb0 0x7f3e64140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:07.461 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6bfcf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e6413b4f0 0x7f3e641e4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:07.461 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6bfcf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6406c490 con 0x7f3e6413b4f0 2024-09-15T21:55:07.461 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6bfcf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6409cf90 con 0x7f3e64072fb0 2024-09-15T21:55:07.461 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6bfcf640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3e6406c610 con 0x7f3e64071350 2024-09-15T21:55:07.461 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6a56c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e6413b4f0 0x7f3e641e4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:07.461 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6a56c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e6413b4f0 0x7f3e641e4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46092/0 (socket says 172.21.15.1:46092) 2024-09-15T21:55:07.461 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6a56c640 1 -- 172.21.15.1:0/1665274906 learned_addr learned my addr 172.21.15.1:0/1665274906 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:07.461 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e69d6b640 1 --2- 172.21.15.1:0/1665274906 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e64071350 0x7f3e64140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:07.462 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6a56c640 1 -- 172.21.15.1:0/1665274906 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e64071350 msgr2=0x7f3e64140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:07.463 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6a56c640 1 --2- 172.21.15.1:0/1665274906 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e64071350 0x7f3e64140a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:07.463 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6a56c640 1 -- 172.21.15.1:0/1665274906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64072fb0 msgr2=0x7f3e64140fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T21:55:07.463 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6a56c640 1 --2- 172.21.15.1:0/1665274906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64072fb0 0x7f3e64140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:07.463 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6a56c640 1 -- 172.21.15.1:0/1665274906 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6413c050 con 0x7f3e6413b4f0 2024-09-15T21:55:07.463 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6a56c640 1 --2- 172.21.15.1:0/1665274906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e6413b4f0 0x7f3e641e4d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3e64071300 tx=0x7f3e5c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:07.463 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e5a7fc640 1 -- 172.21.15.1:0/1665274906 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c00ee90 con 0x7f3e6413b4f0 2024-09-15T21:55:07.463 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e5a7fc640 1 -- 172.21.15.1:0/1665274906 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5c018070 con 0x7f3e6413b4f0 2024-09-15T21:55:07.463 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/1665274906 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6413d4b0 con 0x7f3e6413b4f0 2024-09-15T21:55:07.463 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e5a7fc640 1 -- 172.21.15.1:0/1665274906 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c003ba0 con 0x7f3e6413b4f0 2024-09-15T21:55:07.463 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.458+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/1665274906 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e6413d160 con 0x7f3e6413b4f0 2024-09-15T21:55:07.464 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.462+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/1665274906 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e6409c670 con 0x7f3e6413b4f0 2024-09-15T21:55:07.464 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.462+0000 7f3e5a7fc640 1 -- 172.21.15.1:0/1665274906 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f3e5c0050d0 con 0x7f3e6413b4f0 2024-09-15T21:55:07.464 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.462+0000 7f3e5a7fc640 1 --2- 172.21.15.1:0/1665274906 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3e480679d0 0x7f3e48069e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:07.465 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.462+0000 7f3e5a7fc640 1 -- 172.21.15.1:0/1665274906 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2791+0+0 (secure 0 0 0) 0x7f3e5c084d60 con 0x7f3e6413b4f0 2024-09-15T21:55:07.467 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.462+0000 7f3e69d6b640 1 --2- 172.21.15.1:0/1665274906 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3e480679d0 0x7f3e48069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:07.467 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.466+0000 7f3e69d6b640 1 --2- 172.21.15.1:0/1665274906 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3e480679d0 0x7f3e48069e90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3e600ab000 tx=0x7f3e600a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:07.474 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.470+0000 7f3e5a7fc640 1 -- 172.21.15.1:0/1665274906 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3e5c0564e0 con 0x7f3e6413b4f0 2024-09-15T21:55:07.717 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.714+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/1665274906 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e64144070 con 0x7f3e6413b4f0 2024-09-15T21:55:07.718 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.714+0000 7f3e5a7fc640 1 -- 172.21.15.1:0/1665274906 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8017 (secure 0 0 0) 0x7f3e5c055de0 con 0x7f3e6413b4f0 2024-09-15T21:55:07.718 INFO:teuthology.misc.health.smithi001.stdout: 2024-09-15T21:55:07.718 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":13,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:07.344675+0000","last_up_change":"2024-09-15T21:55:07.344675+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:07.723 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.722+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/1665274906 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3e480679d0 msgr2=0x7f3e48069e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:07.723 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.722+0000 7f3e6bfcf640 1 --2- 172.21.15.1:0/1665274906 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3e480679d0 0x7f3e48069e90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3e600ab000 tx=0x7f3e600a7070 comp rx=0 tx=0).stop 2024-09-15T21:55:07.724 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.722+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/1665274906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e6413b4f0 msgr2=0x7f3e641e4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:07.724 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.722+0000 7f3e6bfcf640 1 --2- 172.21.15.1:0/1665274906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e6413b4f0 0x7f3e641e4d10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3e64071300 tx=0x7f3e5c00eb50 comp rx=0 tx=0).stop 2024-09-15T21:55:07.724 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.722+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/1665274906 shutdown_connections 2024-09-15T21:55:07.724 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.722+0000 7f3e6bfcf640 1 --2- 172.21.15.1:0/1665274906 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e6413b4f0 0x7f3e641e4d10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:07.724 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.722+0000 7f3e6bfcf640 1 --2- 172.21.15.1:0/1665274906 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3e480679d0 0x7f3e48069e90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:07.724 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.722+0000 7f3e6bfcf640 1 --2- 172.21.15.1:0/1665274906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e64072fb0 0x7f3e64140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:07.724 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.722+0000 7f3e6bfcf640 1 --2- 172.21.15.1:0/1665274906 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e64071350 0x7f3e64140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:07.724 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.722+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/1665274906 >> 172.21.15.1:0/1665274906 conn(0x7f3e640ba790 msgr2=0x7f3e64143170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:07.724 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.722+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/1665274906 shutdown_connections 2024-09-15T21:55:07.724 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:07.722+0000 7f3e6bfcf640 1 -- 172.21.15.1:0/1665274906 wait complete. 2024-09-15T21:55:07.742 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-09-15T21:55:08.591 INFO:tasks.ceph.osd.3.smithi001.stderr:2024-09-15T21:55:08.586+0000 7f49e64f0640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T21:55:08.595 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-09-15T21:55:08.594+0000 7f1ede376640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T21:55:08.596 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-09-15T21:55:08.593+0000 7fb410d74640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T21:55:08.604 INFO:tasks.ceph.osd.1.smithi001.stderr:2024-09-15T21:55:08.602+0000 7f795a344640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T21:55:08.611 INFO:tasks.ceph.osd.3.smithi001.stderr:2024-09-15T21:55:08.610+0000 7f49ddb02640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T21:55:08.618 INFO:tasks.ceph.osd.4.smithi070.stderr:2024-09-15T21:55:08.617+0000 7f2e2e950640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T21:55:08.625 INFO:tasks.ceph.osd.5.smithi070.stderr:2024-09-15T21:55:08.625+0000 7fb4093bb640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T21:55:08.627 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-09-15T21:55:08.626+0000 7f1ed69bd640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T21:55:08.632 INFO:tasks.ceph.osd.6.smithi070.stderr:2024-09-15T21:55:08.629+0000 7f2d26851640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T21:55:08.635 INFO:tasks.ceph.osd.1.smithi001.stderr:2024-09-15T21:55:08.634+0000 7f795298b640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T21:55:08.642 INFO:tasks.ceph.osd.4.smithi070.stderr:2024-09-15T21:55:08.641+0000 7f2e25f62640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T21:55:08.653 INFO:tasks.ceph.osd.6.smithi070.stderr:2024-09-15T21:55:08.653+0000 7f2d1ee98640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T21:55:14.549 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:14.675 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdcc758640 1 Processor -- start 2024-09-15T21:55:14.676 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdcc758640 1 -- start start 2024-09-15T21:55:14.677 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdcc758640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbdc40af0a0 0x7fbdc40ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:14.677 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdcc758640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbdc40afc70 0x7fbdc4073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:14.677 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdcc758640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc40af480 con 0x7fbdc4073d60 2024-09-15T21:55:14.678 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdcc758640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc414ad70 con 0x7fbdc40af0a0 2024-09-15T21:55:14.678 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdcc758640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc40adef0 con 0x7fbdc40afc70 2024-09-15T21:55:14.678 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdca4f4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbdc40af0a0 0x7fbdc40ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:14.678 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdcacf5640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbdc4073d60 0x7fbdc414b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:45992/0 (socket says 172.21.15.1:45992) 2024-09-15T21:55:14.678 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdcacf5640 1 -- 172.21.15.1:0/3492627634 learned_addr learned my addr 172.21.15.1:0/3492627634 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:14.678 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdc9cf3640 1 --2- 172.21.15.1:0/3492627634 >> v2:172.21.15.70:3300/0 conn(0x7fbdc40afc70 0x7fbdc4073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:14.678 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdca4f4640 1 -- 172.21.15.1:0/3492627634 >> v2:172.21.15.70:3300/0 conn(0x7fbdc40afc70 msgr2=0x7fbdc4073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:14.678 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdca4f4640 1 --2- 172.21.15.1:0/3492627634 >> v2:172.21.15.70:3300/0 conn(0x7fbdc40afc70 0x7fbdc4073820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:14.678 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdca4f4640 1 -- 172.21.15.1:0/3492627634 >> v1:172.21.15.1:6789/0 conn(0x7fbdc4073d60 legacy=0x7fbdc414b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:14.678 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdc94f2640 1 -- 172.21.15.1:0/3492627634 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676277640 0 0) 0x7fbdc40af480 con 0x7fbdc4073d60 2024-09-15T21:55:14.678 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdca4f4640 1 -- 172.21.15.1:0/3492627634 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc40ae1d0 con 0x7fbdc40af0a0 2024-09-15T21:55:14.678 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.674+0000 7fbdc9cf3640 1 --2- 172.21.15.1:0/3492627634 >> v2:172.21.15.70:3300/0 conn(0x7fbdc40afc70 0x7fbdc4073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:14.680 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdca4f4640 1 --2- 172.21.15.1:0/3492627634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbdc40af0a0 0x7fbdc40ad8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40ae9f0 tx=0x7fbdbc01c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c613d10766fb95 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:14.680 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdc94f2640 1 -- 172.21.15.1:0/3492627634 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0b2070 con 0x7fbdc40af0a0 2024-09-15T21:55:14.680 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdc94f2640 1 -- 172.21.15.1:0/3492627634 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdbc0a57e0 con 0x7fbdc40af0a0 2024-09-15T21:55:14.681 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdc94f2640 1 -- 172.21.15.1:0/3492627634 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0a5bb0 con 0x7fbdc40af0a0 2024-09-15T21:55:14.681 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 -- 172.21.15.1:0/3492627634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbdc40af0a0 msgr2=0x7fbdc40ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:14.681 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 --2- 172.21.15.1:0/3492627634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbdc40af0a0 0x7fbdc40ad8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40ae9f0 tx=0x7fbdbc01c810 comp rx=0 tx=0).stop 2024-09-15T21:55:14.681 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 -- 172.21.15.1:0/3492627634 shutdown_connections 2024-09-15T21:55:14.681 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 --2- 172.21.15.1:0/3492627634 >> v2:172.21.15.70:3300/0 conn(0x7fbdc40afc70 0x7fbdc4073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:14.681 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 --2- 172.21.15.1:0/3492627634 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbdc40af0a0 0x7fbdc40ad8f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:14.681 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 -- 172.21.15.1:0/3492627634 >> 172.21.15.1:0/3492627634 conn(0x7fbdc40b9170 msgr2=0x7fbdc40b9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:14.681 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 -- 172.21.15.1:0/3492627634 shutdown_connections 2024-09-15T21:55:14.681 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 -- 172.21.15.1:0/3492627634 wait complete. 2024-09-15T21:55:14.683 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 Processor -- start 2024-09-15T21:55:14.684 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 -- start start 2024-09-15T21:55:14.684 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdc4073d60 0x7fbdc4145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:14.684 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbdc40af0a0 0x7fbdc4146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:14.684 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbdc40afc70 0x7fbdc4139130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:14.684 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4154cb0 con 0x7fbdc40af0a0 2024-09-15T21:55:14.684 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4154b30 con 0x7fbdc4073d60 2024-09-15T21:55:14.684 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcc758640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc4154e30 con 0x7fbdc40afc70 2024-09-15T21:55:14.684 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdc9cf3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbdc40af0a0 0x7fbdc4146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:14.684 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdc9cf3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbdc40af0a0 0x7fbdc4146230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46148/0 (socket says 172.21.15.1:46148) 2024-09-15T21:55:14.684 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdc9cf3640 1 -- 172.21.15.1:0/3449205425 learned_addr learned my addr 172.21.15.1:0/3449205425 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:14.685 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdca4f4640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdc4073d60 0x7fbdc4145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:14.685 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdcacf5640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbdc40afc70 0x7fbdc4139130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:14.685 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdc9cf3640 1 -- 172.21.15.1:0/3449205425 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbdc40afc70 msgr2=0x7fbdc4139130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:14.685 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdc9cf3640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbdc40afc70 0x7fbdc4139130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:14.685 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdc9cf3640 1 -- 172.21.15.1:0/3449205425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdc4073d60 msgr2=0x7fbdc4145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:14.685 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdc9cf3640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdc4073d60 0x7fbdc4145cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:14.685 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdc9cf3640 1 -- 172.21.15.1:0/3449205425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc4145810 con 0x7fbdc40af0a0 2024-09-15T21:55:14.685 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdc9cf3640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbdc40af0a0 0x7fbdc4146230 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400d800 tx=0x7fbdb400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:14.685 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.678+0000 7fbdbaffd640 1 -- 172.21.15.1:0/3449205425 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400b6c0 con 0x7fbdc40af0a0 2024-09-15T21:55:14.685 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.682+0000 7fbdbaffd640 1 -- 172.21.15.1:0/3449205425 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb4019070 con 0x7fbdc40af0a0 2024-09-15T21:55:14.685 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.682+0000 7fbdcc758640 1 -- 172.21.15.1:0/3449205425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc41446d0 con 0x7fbdc40af0a0 2024-09-15T21:55:14.685 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.682+0000 7fbdbaffd640 1 -- 172.21.15.1:0/3449205425 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400baa0 con 0x7fbdc40af0a0 2024-09-15T21:55:14.686 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.682+0000 7fbdcc758640 1 -- 172.21.15.1:0/3449205425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc41481e0 con 0x7fbdc40af0a0 2024-09-15T21:55:14.686 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.682+0000 7fbdcc758640 1 -- 172.21.15.1:0/3449205425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc40ad8f0 con 0x7fbdc40af0a0 2024-09-15T21:55:14.687 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.682+0000 7fbdbaffd640 1 -- 172.21.15.1:0/3449205425 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbdb400bc40 con 0x7fbdc40af0a0 2024-09-15T21:55:14.687 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.682+0000 7fbdbaffd640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fbda80678c0 0x7fbda8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:14.687 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.682+0000 7fbdbaffd640 1 -- 172.21.15.1:0/3449205425 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fbdb4085c30 con 0x7fbdc40af0a0 2024-09-15T21:55:14.687 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.682+0000 7fbdca4f4640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fbda80678c0 0x7fbda8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:14.687 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.682+0000 7fbdca4f4640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fbda80678c0 0x7fbda8069d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0af000 tx=0x7fbdbc004ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:14.690 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.686+0000 7fbdbaffd640 1 -- 172.21.15.1:0/3449205425 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbdb4056b50 con 0x7fbdc40af0a0 2024-09-15T21:55:14.858 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.850+0000 7fbdcc758640 1 -- 172.21.15.1:0/3449205425 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbdc40691b0 con 0x7fbdc40af0a0 2024-09-15T21:55:14.858 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.854+0000 7fbdbaffd640 1 -- 172.21.15.1:0/3449205425 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12824 (secure 0 0 0) 0x7fbdb4056450 con 0x7fbdc40af0a0 2024-09-15T21:55:14.859 INFO:teuthology.misc.health.smithi001.stdout: 2024-09-15T21:55:14.859 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":17,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:11.657130+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:14.860 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.854+0000 7fbdcc758640 1 -- 172.21.15.1:0/3449205425 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fbda80678c0 msgr2=0x7fbda8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:14.860 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.854+0000 7fbdcc758640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fbda80678c0 0x7fbda8069d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0af000 tx=0x7fbdbc004ac0 comp rx=0 tx=0).stop 2024-09-15T21:55:14.860 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.854+0000 7fbdcc758640 1 -- 172.21.15.1:0/3449205425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbdc40af0a0 msgr2=0x7fbdc4146230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:14.860 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.854+0000 7fbdcc758640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbdc40af0a0 0x7fbdc4146230 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400d800 tx=0x7fbdb400dcc0 comp rx=0 tx=0).stop 2024-09-15T21:55:14.861 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.854+0000 7fbdcc758640 1 -- 172.21.15.1:0/3449205425 shutdown_connections 2024-09-15T21:55:14.861 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.854+0000 7fbdcc758640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbdc40afc70 0x7fbdc4139130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:14.861 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.854+0000 7fbdcc758640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbdc40af0a0 0x7fbdc4146230 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:14.861 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.854+0000 7fbdcc758640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fbda80678c0 0x7fbda8069d80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:14.861 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.854+0000 7fbdcc758640 1 --2- 172.21.15.1:0/3449205425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbdc4073d60 0x7fbdc4145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:14.861 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.854+0000 7fbdcc758640 1 -- 172.21.15.1:0/3449205425 >> 172.21.15.1:0/3449205425 conn(0x7fbdc40b9170 msgr2=0x7fbdc40b9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:14.861 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.854+0000 7fbdcc758640 1 -- 172.21.15.1:0/3449205425 shutdown_connections 2024-09-15T21:55:14.861 INFO:teuthology.misc.health.smithi001.stderr:2024-09-15T21:55:14.854+0000 7fbdcc758640 1 -- 172.21.15.1:0/3449205425 wait complete. 2024-09-15T21:55:14.874 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-15T21:55:14.874 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-15T21:55:14.874 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T21:55:14.875 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T21:55:14.877 INFO:tasks.ceph.mds.a:Started 2024-09-15T21:55:14.877 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T21:55:14.877 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T21:55:14.880 INFO:tasks.ceph.mds.b:Started 2024-09-15T21:55:14.880 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-15T21:55:14.880 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:55:14.954 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2024-09-15T21:55:15.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb39d4640 1 Processor -- start 2024-09-15T21:55:15.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb39d4640 1 -- start start 2024-09-15T21:55:15.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb39d4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3fac0af5b0 0x7f3fac144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb39d4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3fac0b0610 0x7f3fac13e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb39d4640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fac0af990 con 0x7f3fac13e610 2024-09-15T21:55:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb39d4640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f3fac09add0 con 0x7f3fac0b0610 2024-09-15T21:55:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb39d4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f3fac09b0b0 con 0x7f3fac0af5b0 2024-09-15T21:55:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb0f6f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3fac0b0610 0x7f3fac13e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:15.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb1f71640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f3fac13e610 0x7f3fac147a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46008/0 (socket says 172.21.15.1:46008) 2024-09-15T21:55:15.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb1f71640 1 -- 172.21.15.1:0/1141537969 learned_addr learned my addr 172.21.15.1:0/1141537969 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:15.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb1770640 1 --2- 172.21.15.1:0/1141537969 >> v2:172.21.15.70:3300/0 conn(0x7f3fac0af5b0 0x7f3fac144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:15.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb0f6f640 1 -- 172.21.15.1:0/1141537969 >> v2:172.21.15.70:3300/0 conn(0x7f3fac0af5b0 msgr2=0x7f3fac144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:15.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb0f6f640 1 --2- 172.21.15.1:0/1141537969 >> v2:172.21.15.70:3300/0 conn(0x7f3fac0af5b0 0x7f3fac144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:15.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb0f6f640 1 -- 172.21.15.1:0/1141537969 >> v1:172.21.15.1:6789/0 conn(0x7f3fac13e610 legacy=0x7f3fac147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:15.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fb0f6f640 1 -- 172.21.15.1:0/1141537969 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fac0b0b30 con 0x7f3fac0b0610 2024-09-15T21:55:15.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.014+0000 7f3fa3fff640 1 -- 172.21.15.1:0/1141537969 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217375956 0 0) 0x7f3fac0af990 con 0x7f3fac13e610 2024-09-15T21:55:15.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fb0f6f640 1 --2- 172.21.15.1:0/1141537969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac0b0610 0x7f3fac13e0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3fac06f910 tx=0x7f3f9c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b37860e47c23b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:15.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fa3fff640 1 -- 172.21.15.1:0/1141537969 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0b0070 con 0x7f3fac0b0610 2024-09-15T21:55:15.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fa3fff640 1 -- 172.21.15.1:0/1141537969 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9c0ab600 con 0x7f3fac0b0610 2024-09-15T21:55:15.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fa3fff640 1 -- 172.21.15.1:0/1141537969 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0ab9d0 con 0x7f3fac0b0610 2024-09-15T21:55:15.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fb39d4640 1 -- 172.21.15.1:0/1141537969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac0b0610 msgr2=0x7f3fac13e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:15.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fb39d4640 1 --2- 172.21.15.1:0/1141537969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac0b0610 0x7f3fac13e0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3fac06f910 tx=0x7f3f9c01c3f0 comp rx=0 tx=0).stop 2024-09-15T21:55:15.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fb39d4640 1 -- 172.21.15.1:0/1141537969 shutdown_connections 2024-09-15T21:55:15.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fb39d4640 1 --2- 172.21.15.1:0/1141537969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac0b0610 0x7f3fac13e0d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:15.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fb39d4640 1 --2- 172.21.15.1:0/1141537969 >> v2:172.21.15.70:3300/0 conn(0x7f3fac0af5b0 0x7f3fac144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:15.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fb39d4640 1 -- 172.21.15.1:0/1141537969 >> 172.21.15.1:0/1141537969 conn(0x7f3fac0b6e30 msgr2=0x7f3fac0b7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:15.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fb39d4640 1 -- 172.21.15.1:0/1141537969 shutdown_connections 2024-09-15T21:55:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fb39d4640 1 -- 172.21.15.1:0/1141537969 wait complete. 2024-09-15T21:55:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fb39d4640 1 Processor -- start 2024-09-15T21:55:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.018+0000 7f3fb39d4640 1 -- start start 2024-09-15T21:55:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb39d4640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fac0af5b0 0x7f3fac14d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb39d4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac0b0610 0x7f3fac1467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb39d4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fac13e610 0x7f3fac14ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb39d4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3fac0b1580 con 0x7f3fac0b0610 2024-09-15T21:55:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb39d4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3fac0b1400 con 0x7f3fac13e610 2024-09-15T21:55:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb39d4640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3fac1451f0 con 0x7f3fac0af5b0 2024-09-15T21:55:15.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb0f6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac0b0610 0x7f3fac1467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb0f6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac0b0610 0x7f3fac1467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46176/0 (socket says 172.21.15.1:46176) 2024-09-15T21:55:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb0f6f640 1 -- 172.21.15.1:0/893047852 learned_addr learned my addr 172.21.15.1:0/893047852 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb1770640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fac0af5b0 0x7f3fac14d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb1f71640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fac13e610 0x7f3fac14ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb0f6f640 1 -- 172.21.15.1:0/893047852 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fac0af5b0 msgr2=0x7f3fac14d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb0f6f640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fac0af5b0 0x7f3fac14d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb0f6f640 1 -- 172.21.15.1:0/893047852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fac13e610 msgr2=0x7f3fac14ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb0f6f640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fac13e610 0x7f3fac14ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb0f6f640 1 -- 172.21.15.1:0/893047852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fac147f70 con 0x7f3fac0b0610 2024-09-15T21:55:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb1f71640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fac13e610 0x7f3fac14ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb0f6f640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac0b0610 0x7f3fac1467f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c01a020 tx=0x7f3f9c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:15.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fa1ffb640 1 -- 172.21.15.1:0/893047852 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0bc070 con 0x7f3fac0b0610 2024-09-15T21:55:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fa1ffb640 1 -- 172.21.15.1:0/893047852 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9c0b1040 con 0x7f3fac0b0610 2024-09-15T21:55:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb39d4640 1 -- 172.21.15.1:0/893047852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fac13b2d0 con 0x7f3fac0b0610 2024-09-15T21:55:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fa1ffb640 1 -- 172.21.15.1:0/893047852 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0b0050 con 0x7f3fac0b0610 2024-09-15T21:55:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb39d4640 1 -- 172.21.15.1:0/893047852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fac14e580 con 0x7f3fac0b0610 2024-09-15T21:55:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb39d4640 1 -- 172.21.15.1:0/893047852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fac13b4a0 con 0x7f3fac0b0610 2024-09-15T21:55:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fa1ffb640 1 -- 172.21.15.1:0/893047852 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3f9c0bf070 con 0x7f3fac0b0610 2024-09-15T21:55:15.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fa1ffb640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3f900678c0 0x7f3f90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:15.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fb1770640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3f900678c0 0x7f3f90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:15.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.022+0000 7f3fa1ffb640 1 -- 172.21.15.1:0/893047852 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f3f9c11f390 con 0x7f3fac0b0610 2024-09-15T21:55:15.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.026+0000 7f3fb1770640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3f900678c0 0x7f3f90069d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800b930 tx=0x7f3fa8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:15.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.030+0000 7f3fa1ffb640 1 -- 172.21.15.1:0/893047852 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3f9c016070 con 0x7f3fac0b0610 2024-09-15T21:55:15.036 INFO:tasks.ceph.mds.b.smithi070.stdout:starting mds.b at 2024-09-15T21:55:15.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.221+0000 7f3fb39d4640 1 -- 172.21.15.1:0/893047852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fac144cb0 con 0x7f3fac0b0610 2024-09-15T21:55:15.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.221+0000 7f3fa1ffb640 1 -- 172.21.15.1:0/893047852 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1431 (secure 0 0 0) 0x7f3f9c0f0210 con 0x7f3fac0b0610 2024-09-15T21:55:15.227 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:15.227 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":2,"btime":"2024-09-15T21:55:14:986074+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3288963990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3288963990},{"type":"v1","addr":"172.21.15.1:6835","nonce":3288963990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T21:55:15.227 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 2 2024-09-15T21:55:15.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.225+0000 7f3fb39d4640 1 -- 172.21.15.1:0/893047852 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3f900678c0 msgr2=0x7f3f90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:15.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.225+0000 7f3fb39d4640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3f900678c0 0x7f3f90069d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fa800b930 tx=0x7f3fa8008040 comp rx=0 tx=0).stop 2024-09-15T21:55:15.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.225+0000 7f3fb39d4640 1 -- 172.21.15.1:0/893047852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac0b0610 msgr2=0x7f3fac1467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:15.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.225+0000 7f3fb39d4640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac0b0610 0x7f3fac1467f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c01a020 tx=0x7f3f9c01ac30 comp rx=0 tx=0).stop 2024-09-15T21:55:15.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.225+0000 7f3fb39d4640 1 -- 172.21.15.1:0/893047852 shutdown_connections 2024-09-15T21:55:15.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.225+0000 7f3fb39d4640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3f900678c0 0x7f3f90069d80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:15.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.225+0000 7f3fb39d4640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fac13e610 0x7f3fac14ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:15.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.225+0000 7f3fb39d4640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac0b0610 0x7f3fac1467f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:15.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.225+0000 7f3fb39d4640 1 --2- 172.21.15.1:0/893047852 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3fac0af5b0 0x7f3fac14d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:15.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.225+0000 7f3fb39d4640 1 -- 172.21.15.1:0/893047852 >> 172.21.15.1:0/893047852 conn(0x7f3fac0b6e30 msgr2=0x7f3fac0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:15.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.225+0000 7f3fb39d4640 1 -- 172.21.15.1:0/893047852 shutdown_connections 2024-09-15T21:55:15.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:15.225+0000 7f3fb39d4640 1 -- 172.21.15.1:0/893047852 wait complete. 2024-09-15T21:55:17.246 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:55:17.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.373+0000 7fb8dbe49640 1 Processor -- start 2024-09-15T21:55:17.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.373+0000 7fb8dbe49640 1 -- start start 2024-09-15T21:55:17.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8dbe49640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb8d40b5220 0x7fb8d409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8dbe49640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb8d4148f20 0x7fb8d4149370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8dbe49640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d409f520 con 0x7fb8d40b5600 2024-09-15T21:55:17.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8dbe49640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d409b800 con 0x7fb8d4148f20 2024-09-15T21:55:17.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8dbe49640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d40b4dd0 con 0x7fb8d40b5220 2024-09-15T21:55:17.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8da3e6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb8d4148f20 0x7fb8d4149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8da3e6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb8d4148f20 0x7fb8d4149370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34388/0 (socket says 172.21.15.1:34388) 2024-09-15T21:55:17.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8da3e6640 1 -- 172.21.15.1:0/3293540394 learned_addr learned my addr 172.21.15.1:0/3293540394 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:17.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8d9be5640 1 --2- 172.21.15.1:0/3293540394 >> v2:172.21.15.70:3300/0 conn(0x7fb8d40b5220 0x7fb8d409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8da3e6640 1 -- 172.21.15.1:0/3293540394 >> v2:172.21.15.70:3300/0 conn(0x7fb8d40b5220 msgr2=0x7fb8d409aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:17.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8da3e6640 1 --2- 172.21.15.1:0/3293540394 >> v2:172.21.15.70:3300/0 conn(0x7fb8d40b5220 0x7fb8d409aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8da3e6640 1 -- 172.21.15.1:0/3293540394 >> v1:172.21.15.70:6789/0 conn(0x7fb8d40b5600 legacy=0x7fb8d409ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:17.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8da3e6640 1 -- 172.21.15.1:0/3293540394 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d40b6a50 con 0x7fb8d4148f20 2024-09-15T21:55:17.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8da3e6640 1 --2- 172.21.15.1:0/3293540394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8d4148f20 0x7fb8d4149370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40b0400 tx=0x7fb8c401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db975b7ded97eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:17.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8d8be3640 1 -- 172.21.15.1:0/3293540394 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40b1070 con 0x7fb8d4148f20 2024-09-15T21:55:17.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8d8be3640 1 -- 172.21.15.1:0/3293540394 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c40a8050 con 0x7fb8d4148f20 2024-09-15T21:55:17.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.377+0000 7fb8d8be3640 1 -- 172.21.15.1:0/3293540394 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40ac860 con 0x7fb8d4148f20 2024-09-15T21:55:17.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3293540394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8d4148f20 msgr2=0x7fb8d4149370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:17.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 --2- 172.21.15.1:0/3293540394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8d4148f20 0x7fb8d4149370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40b0400 tx=0x7fb8c401c3c0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3293540394 shutdown_connections 2024-09-15T21:55:17.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 --2- 172.21.15.1:0/3293540394 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8d4148f20 0x7fb8d4149370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 --2- 172.21.15.1:0/3293540394 >> v2:172.21.15.70:3300/0 conn(0x7fb8d40b5220 0x7fb8d409aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3293540394 >> 172.21.15.1:0/3293540394 conn(0x7fb8d40b5c40 msgr2=0x7fb8d40b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:17.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3293540394 shutdown_connections 2024-09-15T21:55:17.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3293540394 wait complete. 2024-09-15T21:55:17.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 Processor -- start 2024-09-15T21:55:17.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 -- start start 2024-09-15T21:55:17.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8d40b5220 0x7fb8d4071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d40b5600 0x7fb8d40ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8d4148f20 0x7fb8d40aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d4152700 con 0x7fb8d4148f20 2024-09-15T21:55:17.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d409b520 con 0x7fb8d40b5220 2024-09-15T21:55:17.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d4152880 con 0x7fb8d40b5600 2024-09-15T21:55:17.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8da3e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8d4148f20 0x7fb8d40aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8da3e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8d4148f20 0x7fb8d40aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34394/0 (socket says 172.21.15.1:34394) 2024-09-15T21:55:17.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8da3e6640 1 -- 172.21.15.1:0/3228661813 learned_addr learned my addr 172.21.15.1:0/3228661813 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:17.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8d9be5640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8d40b5220 0x7fb8d4071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8d93e4640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d40b5600 0x7fb8d40ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8da3e6640 1 -- 172.21.15.1:0/3228661813 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d40b5600 msgr2=0x7fb8d40ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:17.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8da3e6640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d40b5600 0x7fb8d40ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8da3e6640 1 -- 172.21.15.1:0/3228661813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8d40b5220 msgr2=0x7fb8d4071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:17.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8da3e6640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8d40b5220 0x7fb8d4071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8da3e6640 1 -- 172.21.15.1:0/3228661813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d40b0a30 con 0x7fb8d4148f20 2024-09-15T21:55:17.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8d93e4640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d40b5600 0x7fb8d40ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:17.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8da3e6640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8d4148f20 0x7fb8d40aea80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40af040 tx=0x7fb8c4019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:17.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8d27fc640 1 -- 172.21.15.1:0/3228661813 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40bc070 con 0x7fb8d4148f20 2024-09-15T21:55:17.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8d27fc640 1 -- 172.21.15.1:0/3228661813 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c40acdc0 con 0x7fb8d4148f20 2024-09-15T21:55:17.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3228661813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d40b0d10 con 0x7fb8d4148f20 2024-09-15T21:55:17.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8d27fc640 1 -- 172.21.15.1:0/3228661813 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40b1040 con 0x7fb8d4148f20 2024-09-15T21:55:17.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3228661813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d4072a70 con 0x7fb8d4148f20 2024-09-15T21:55:17.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.381+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3228661813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d409aa50 con 0x7fb8d4148f20 2024-09-15T21:55:17.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.385+0000 7fb8d27fc640 1 -- 172.21.15.1:0/3228661813 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb8c40bf070 con 0x7fb8d4148f20 2024-09-15T21:55:17.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.385+0000 7fb8d27fc640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb8c00678f0 0x7fb8c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.385+0000 7fb8d27fc640 1 -- 172.21.15.1:0/3228661813 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fb8c411f240 con 0x7fb8d4148f20 2024-09-15T21:55:17.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.385+0000 7fb8d9be5640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb8c00678f0 0x7fb8c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.385+0000 7fb8d9be5640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb8c00678f0 0x7fb8c0069db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4071270 tx=0x7fb8cc00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:17.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.389+0000 7fb8d27fc640 1 -- 172.21.15.1:0/3228661813 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb8c40160d0 con 0x7fb8d4148f20 2024-09-15T21:55:17.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.585+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3228661813 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8d40b83f0 con 0x7fb8d4148f20 2024-09-15T21:55:17.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.585+0000 7fb8d27fc640 1 -- 172.21.15.1:0/3228661813 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2255 (secure 0 0 0) 0x7fb8c40f0160 con 0x7fb8d4148f20 2024-09-15T21:55:17.589 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:17.589 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":3,"btime":"2024-09-15T21:55:15:988622+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/2650682187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2650682187},{"type":"v1","addr":"172.21.15.70:6833","nonce":2650682187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/3288963990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3288963990},{"type":"v1","addr":"172.21.15.1:6835","nonce":3288963990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T21:55:17.589 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 3 2024-09-15T21:55:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.585+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3228661813 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb8c00678f0 msgr2=0x7fb8c0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:17.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.585+0000 7fb8dbe49640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb8c00678f0 0x7fb8c0069db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4071270 tx=0x7fb8cc00b040 comp rx=0 tx=0).stop 2024-09-15T21:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.585+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3228661813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8d4148f20 msgr2=0x7fb8d40aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.585+0000 7fb8dbe49640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8d4148f20 0x7fb8d40aea80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40af040 tx=0x7fb8c4019160 comp rx=0 tx=0).stop 2024-09-15T21:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.585+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3228661813 shutdown_connections 2024-09-15T21:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.585+0000 7fb8dbe49640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb8d4148f20 0x7fb8d40aea80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.585+0000 7fb8dbe49640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d40b5600 0x7fb8d40ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.585+0000 7fb8dbe49640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb8c00678f0 0x7fb8c0069db0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.585+0000 7fb8dbe49640 1 --2- 172.21.15.1:0/3228661813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8d40b5220 0x7fb8d4071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.585+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3228661813 >> 172.21.15.1:0/3228661813 conn(0x7fb8d40b5c40 msgr2=0x7fb8d406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.589+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3228661813 shutdown_connections 2024-09-15T21:55:17.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.589+0000 7fb8dbe49640 1 -- 172.21.15.1:0/3228661813 wait complete. 2024-09-15T21:55:17.606 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T21:55:17.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.725+0000 7fba23cc4640 1 Processor -- start 2024-09-15T21:55:17.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.725+0000 7fba23cc4640 1 -- start start 2024-09-15T21:55:17.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.725+0000 7fba23cc4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fba1c0b6120 0x7fba1c14b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.725+0000 7fba23cc4640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1c0b6500 con 0x7fba1c141ac0 2024-09-15T21:55:17.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.725+0000 7fba23cc4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1c14bc60 con 0x7fba1c1480c0 2024-09-15T21:55:17.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.725+0000 7fba23cc4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fba1c147ba0 con 0x7fba1c0b6120 2024-09-15T21:55:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.725+0000 7fba22261640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fba1c141ac0 0x7fba1c1521d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46010/0 (socket says 172.21.15.1:46010) 2024-09-15T21:55:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.725+0000 7fba22261640 1 -- 172.21.15.1:0/1085576752 learned_addr learned my addr 172.21.15.1:0/1085576752 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.725+0000 7fba21a60640 1 --2- 172.21.15.1:0/1085576752 >> v2:172.21.15.70:3300/0 conn(0x7fba1c0b6120 0x7fba1c14b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.725+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2696001975 0 0) 0x7fba1c0b6500 con 0x7fba1c141ac0 2024-09-15T21:55:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.725+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba08003530 con 0x7fba1c141ac0 2024-09-15T21:55:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1447260765 0 0) 0x7fba08003530 con 0x7fba1c141ac0 2024-09-15T21:55:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 >> v2:172.21.15.70:3300/0 conn(0x7fba1c0b6120 msgr2=0x7fba1c14b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 --2- 172.21.15.1:0/1085576752 >> v2:172.21.15.70:3300/0 conn(0x7fba1c0b6120 0x7fba1c14b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 >> v1:172.21.15.70:6789/0 conn(0x7fba1c1480c0 legacy=0x7fba1c1413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1c0b76c0 con 0x7fba1c141ac0 2024-09-15T21:55:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7fba14001a00 con 0x7fba1c141ac0 2024-09-15T21:55:17.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 >> v1:172.21.15.1:6789/0 conn(0x7fba1c141ac0 legacy=0x7fba1c1521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 --2- 172.21.15.1:0/1085576752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba080039c0 0x7fba08003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 --2- 172.21.15.1:0/1085576752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba08004810 0x7fba08004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 --2- 172.21.15.1:0/1085576752 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba080051d0 0x7fba0800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c147ba0 con 0x7fba08004810 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fba0800c170 con 0x7fba080039c0 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fba0800c370 con 0x7fba080051d0 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba2125f640 1 --2- 172.21.15.1:0/1085576752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba08004810 0x7fba08004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba21a60640 1 --2- 172.21.15.1:0/1085576752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba080039c0 0x7fba08003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba22261640 1 --2- 172.21.15.1:0/1085576752 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba080051d0 0x7fba0800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba2125f640 1 -- 172.21.15.1:0/1085576752 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba080051d0 msgr2=0x7fba0800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba2125f640 1 --2- 172.21.15.1:0/1085576752 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba080051d0 0x7fba0800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba2125f640 1 -- 172.21.15.1:0/1085576752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba080039c0 msgr2=0x7fba08003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba2125f640 1 --2- 172.21.15.1:0/1085576752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba080039c0 0x7fba08003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba2125f640 1 -- 172.21.15.1:0/1085576752 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba08003530 con 0x7fba08004810 2024-09-15T21:55:17.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba22261640 1 -- 172.21.15.1:0/1085576752 reap_dead start 2024-09-15T21:55:17.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba21a60640 1 --2- 172.21.15.1:0/1085576752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba080039c0 0x7fba08003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:17.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba2125f640 1 --2- 172.21.15.1:0/1085576752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba08004810 0x7fba08004c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001780 tx=0x7fba0c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7981f71aa13da97 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0013a0 con 0x7fba08004810 2024-09-15T21:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0c0052f0 con 0x7fba08004810 2024-09-15T21:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba20a5e640 1 -- 172.21.15.1:0/1085576752 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c003840 con 0x7fba08004810 2024-09-15T21:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba23cc4640 1 -- 172.21.15.1:0/1085576752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba08004810 msgr2=0x7fba08004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba23cc4640 1 --2- 172.21.15.1:0/1085576752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba08004810 0x7fba08004c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001780 tx=0x7fba0c01c420 comp rx=0 tx=0).stop 2024-09-15T21:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba23cc4640 1 -- 172.21.15.1:0/1085576752 shutdown_connections 2024-09-15T21:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba23cc4640 1 --2- 172.21.15.1:0/1085576752 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba08004810 0x7fba08004c90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba23cc4640 1 -- 172.21.15.1:0/1085576752 >> 172.21.15.1:0/1085576752 conn(0x7fba1c0bd2f0 msgr2=0x7fba1c0bd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba23cc4640 1 -- 172.21.15.1:0/1085576752 shutdown_connections 2024-09-15T21:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.729+0000 7fba23cc4640 1 -- 172.21.15.1:0/1085576752 wait complete. 2024-09-15T21:55:17.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba23cc4640 1 Processor -- start 2024-09-15T21:55:17.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba23cc4640 1 -- start start 2024-09-15T21:55:17.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba23cc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba08004810 0x7fba1c1d5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba23cc4640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba1c144050 0x7fba1c1e4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba23cc4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1c1404c0 0x7fba1c140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba23cc4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c0b4c50 con 0x7fba08004810 2024-09-15T21:55:17.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba23cc4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c0b4ad0 con 0x7fba1c1404c0 2024-09-15T21:55:17.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba23cc4640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fba1c0b4dd0 con 0x7fba1c144050 2024-09-15T21:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba21a60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba08004810 0x7fba1c1d5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba21a60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba08004810 0x7fba1c1d5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34398/0 (socket says 172.21.15.1:34398) 2024-09-15T21:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba21a60640 1 -- 172.21.15.1:0/2519342844 learned_addr learned my addr 172.21.15.1:0/2519342844 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba2125f640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba1c144050 0x7fba1c1e4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba22261640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1c1404c0 0x7fba1c140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba21a60640 1 -- 172.21.15.1:0/2519342844 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba1c144050 msgr2=0x7fba1c1e4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba21a60640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba1c144050 0x7fba1c1e4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba21a60640 1 -- 172.21.15.1:0/2519342844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1c1404c0 msgr2=0x7fba1c140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba21a60640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1c1404c0 0x7fba1c140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba21a60640 1 -- 172.21.15.1:0/2519342844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1c0aa590 con 0x7fba08004810 2024-09-15T21:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba21a60640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba08004810 0x7fba1c1d5410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fba18011570 tx=0x7fba18011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:17.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba127fc640 1 -- 172.21.15.1:0/2519342844 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18004220 con 0x7fba08004810 2024-09-15T21:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba127fc640 1 -- 172.21.15.1:0/2519342844 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba180043c0 con 0x7fba08004810 2024-09-15T21:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba23cc4640 1 -- 172.21.15.1:0/2519342844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba1c1438c0 con 0x7fba08004810 2024-09-15T21:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba127fc640 1 -- 172.21.15.1:0/2519342844 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18015890 con 0x7fba08004810 2024-09-15T21:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba23cc4640 1 -- 172.21.15.1:0/2519342844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba1c1e4540 con 0x7fba08004810 2024-09-15T21:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.733+0000 7fba23cc4640 1 -- 172.21.15.1:0/2519342844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba1c0691c0 con 0x7fba08004810 2024-09-15T21:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.737+0000 7fba127fc640 1 -- 172.21.15.1:0/2519342844 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba18015a30 con 0x7fba08004810 2024-09-15T21:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.737+0000 7fba127fc640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fba000678c0 0x7fba00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.737+0000 7fba2125f640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fba000678c0 0x7fba00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.737+0000 7fba127fc640 1 -- 172.21.15.1:0/2519342844 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fba18085eb0 con 0x7fba08004810 2024-09-15T21:55:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.737+0000 7fba2125f640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fba000678c0 0x7fba00069d80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001750 tx=0x7fba0c0011a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:17.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.741+0000 7fba127fc640 1 -- 172.21.15.1:0/2519342844 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fba18019030 con 0x7fba08004810 2024-09-15T21:55:17.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.905+0000 7fba23cc4640 1 -- 172.21.15.1:0/2519342844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fba1c0b6500 con 0x7fba08004810 2024-09-15T21:55:17.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.905+0000 7fba127fc640 1 -- 172.21.15.1:0/2519342844 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fba18056dd0 con 0x7fba08004810 2024-09-15T21:55:17.911 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:17.911 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2024-09-15T21:55:17.911 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:17.911 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2024-09-15T21:55:17.911 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": ".mgr" 2024-09-15T21:55:17.911 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:17.911 INFO:teuthology.orchestra.run.smithi001.stdout:] 2024-09-15T21:55:17.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.909+0000 7fba23cc4640 1 -- 172.21.15.1:0/2519342844 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fba000678c0 msgr2=0x7fba00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:17.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.909+0000 7fba23cc4640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fba000678c0 0x7fba00069d80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001750 tx=0x7fba0c0011a0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.909+0000 7fba23cc4640 1 -- 172.21.15.1:0/2519342844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba08004810 msgr2=0x7fba1c1d5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:17.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.909+0000 7fba23cc4640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba08004810 0x7fba1c1d5410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fba18011570 tx=0x7fba18011a30 comp rx=0 tx=0).stop 2024-09-15T21:55:17.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.909+0000 7fba23cc4640 1 -- 172.21.15.1:0/2519342844 shutdown_connections 2024-09-15T21:55:17.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.909+0000 7fba23cc4640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fba000678c0 0x7fba00069d80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.909+0000 7fba23cc4640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1c1404c0 0x7fba1c140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.909+0000 7fba23cc4640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba1c144050 0x7fba1c1e4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.909+0000 7fba23cc4640 1 --2- 172.21.15.1:0/2519342844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba08004810 0x7fba1c1d5410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:17.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.909+0000 7fba23cc4640 1 -- 172.21.15.1:0/2519342844 >> 172.21.15.1:0/2519342844 conn(0x7fba1c0bd2f0 msgr2=0x7fba1c0bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:17.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.909+0000 7fba23cc4640 1 -- 172.21.15.1:0/2519342844 shutdown_connections 2024-09-15T21:55:17.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:17.909+0000 7fba23cc4640 1 -- 172.21.15.1:0/2519342844 wait complete. 2024-09-15T21:55:17.930 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T21:55:17.930 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T21:55:18.013 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T21:55:18.015 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T21:55:18.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e828bf640 1 Processor -- start 2024-09-15T21:55:18.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e828bf640 1 -- start start 2024-09-15T21:55:18.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e828bf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7c0b5c60 0x7f0e7c0af930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:18.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e828bf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0e7c09b5d0 0x7f0e7c148450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:18.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e828bf640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e7c09ba80 con 0x7f0e7c0b03b0 2024-09-15T21:55:18.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e828bf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f0e7c0b6140 con 0x7f0e7c09b5d0 2024-09-15T21:55:18.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e828bf640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0e7c0af410 con 0x7f0e7c0b5c60 2024-09-15T21:55:18.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e7b7fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7c0b5c60 0x7f0e7c0af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:18.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e80e5c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0e7c09b5d0 0x7f0e7c148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:18.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e7b7fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7c0b5c60 0x7f0e7c0af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:42352/0 (socket says 172.21.15.1:42352) 2024-09-15T21:55:18.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e7b7fe640 1 -- 172.21.15.1:0/2178990060 learned_addr learned my addr 172.21.15.1:0/2178990060 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:18.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e80e5c640 1 -- 172.21.15.1:0/2178990060 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7c0b5c60 msgr2=0x7f0e7c0af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:18.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e80e5c640 1 --2- 172.21.15.1:0/2178990060 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7c0b5c60 0x7f0e7c0af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:18.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e80e5c640 1 -- 172.21.15.1:0/2178990060 >> v1:172.21.15.70:6789/0 conn(0x7f0e7c0b03b0 legacy=0x7f0e7c0b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:18.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.049+0000 7f0e80e5c640 1 -- 172.21.15.1:0/2178990060 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e7c0b67b0 con 0x7f0e7c09b5d0 2024-09-15T21:55:18.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e80e5c640 1 --2- 172.21.15.1:0/2178990060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e7c09b5d0 0x7f0e7c148450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009d90 tx=0x7f0e7401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcadeb7409c53a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:18.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e7affd640 1 -- 172.21.15.1:0/2178990060 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e740b2070 con 0x7f0e7c09b5d0 2024-09-15T21:55:18.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e7affd640 1 -- 172.21.15.1:0/2178990060 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e740a5830 con 0x7f0e7c09b5d0 2024-09-15T21:55:18.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e7affd640 1 -- 172.21.15.1:0/2178990060 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e740a5c00 con 0x7f0e7c09b5d0 2024-09-15T21:55:18.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 -- 172.21.15.1:0/2178990060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e7c09b5d0 msgr2=0x7f0e7c148450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:18.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 --2- 172.21.15.1:0/2178990060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e7c09b5d0 0x7f0e7c148450 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009d90 tx=0x7f0e7401c970 comp rx=0 tx=0).stop 2024-09-15T21:55:18.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 -- 172.21.15.1:0/2178990060 shutdown_connections 2024-09-15T21:55:18.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 --2- 172.21.15.1:0/2178990060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e7c09b5d0 0x7f0e7c148450 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:18.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 --2- 172.21.15.1:0/2178990060 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7c0b5c60 0x7f0e7c0af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:18.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 -- 172.21.15.1:0/2178990060 >> 172.21.15.1:0/2178990060 conn(0x7f0e7c0b6d50 msgr2=0x7f0e7c0b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:18.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 -- 172.21.15.1:0/2178990060 shutdown_connections 2024-09-15T21:55:18.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 -- 172.21.15.1:0/2178990060 wait complete. 2024-09-15T21:55:18.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 Processor -- start 2024-09-15T21:55:18.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 -- start start 2024-09-15T21:55:18.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e7c09b5d0 0x7f0e7c09e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7c0b03b0 0x7f0e7c09f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e7c0b5c60 0x7f0e7c09f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c151e90 con 0x7f0e7c0b5c60 2024-09-15T21:55:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c151d10 con 0x7f0e7c09b5d0 2024-09-15T21:55:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e828bf640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0e7c152010 con 0x7f0e7c0b03b0 2024-09-15T21:55:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e80e5c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e7c0b5c60 0x7f0e7c09f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e7b7fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7c0b03b0 0x7f0e7c09f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e80e5c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e7c0b5c60 0x7f0e7c09f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34404/0 (socket says 172.21.15.1:34404) 2024-09-15T21:55:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e80e5c640 1 -- 172.21.15.1:0/898020609 learned_addr learned my addr 172.21.15.1:0/898020609 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e7bfff640 1 --2- 172.21.15.1:0/898020609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e7c09b5d0 0x7f0e7c09e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:18.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e80e5c640 1 -- 172.21.15.1:0/898020609 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7c0b03b0 msgr2=0x7f0e7c09f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e80e5c640 1 --2- 172.21.15.1:0/898020609 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7c0b03b0 0x7f0e7c09f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e80e5c640 1 -- 172.21.15.1:0/898020609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e7c09b5d0 msgr2=0x7f0e7c09e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e80e5c640 1 --2- 172.21.15.1:0/898020609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e7c09b5d0 0x7f0e7c09e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e80e5c640 1 -- 172.21.15.1:0/898020609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e7c09dd10 con 0x7f0e7c0b5c60 2024-09-15T21:55:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.053+0000 7f0e80e5c640 1 --2- 172.21.15.1:0/898020609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e7c0b5c60 0x7f0e7c09f6a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e740b0040 tx=0x7f0e74019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.057+0000 7f0e78ff9640 1 -- 172.21.15.1:0/898020609 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e740b2050 con 0x7f0e7c0b5c60 2024-09-15T21:55:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.057+0000 7f0e78ff9640 1 -- 172.21.15.1:0/898020609 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e740be070 con 0x7f0e7c0b5c60 2024-09-15T21:55:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.057+0000 7f0e828bf640 1 -- 172.21.15.1:0/898020609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e7c09ecf0 con 0x7f0e7c0b5c60 2024-09-15T21:55:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.057+0000 7f0e78ff9640 1 -- 172.21.15.1:0/898020609 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e74009450 con 0x7f0e7c0b5c60 2024-09-15T21:55:18.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.057+0000 7f0e828bf640 1 -- 172.21.15.1:0/898020609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e7c09dfb0 con 0x7f0e7c0b5c60 2024-09-15T21:55:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.057+0000 7f0e828bf640 1 -- 172.21.15.1:0/898020609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e7c09e490 con 0x7f0e7c0b5c60 2024-09-15T21:55:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.057+0000 7f0e78ff9640 1 -- 172.21.15.1:0/898020609 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e740c3460 con 0x7f0e7c0b5c60 2024-09-15T21:55:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.057+0000 7f0e78ff9640 1 --2- 172.21.15.1:0/898020609 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0e680678c0 0x7f0e68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:18.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.057+0000 7f0e78ff9640 1 -- 172.21.15.1:0/898020609 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f0e74120c00 con 0x7f0e7c0b5c60 2024-09-15T21:55:18.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.057+0000 7f0e7bfff640 1 --2- 172.21.15.1:0/898020609 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0e680678c0 0x7f0e68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:18.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.057+0000 7f0e7bfff640 1 --2- 172.21.15.1:0/898020609 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0e680678c0 0x7f0e68069d80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c001810 tx=0x7f0e6c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:18.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.061+0000 7f0e78ff9640 1 -- 172.21.15.1:0/898020609 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0e7c09e490 con 0x7f0e7c0b5c60 2024-09-15T21:55:18.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:18.225+0000 7f0e828bf640 1 -- 172.21.15.1:0/898020609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0e7c148450 con 0x7f0e7c0b5c60 2024-09-15T21:55:19.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.009+0000 7f0e78ff9640 1 -- 172.21.15.1:0/898020609 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f0e74127080 con 0x7f0e7c0b5c60 2024-09-15T21:55:19.015 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2024-09-15T21:55:19.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.013+0000 7f0e828bf640 1 -- 172.21.15.1:0/898020609 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0e680678c0 msgr2=0x7f0e68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:19.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.013+0000 7f0e828bf640 1 --2- 172.21.15.1:0/898020609 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0e680678c0 0x7f0e68069d80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c001810 tx=0x7f0e6c009040 comp rx=0 tx=0).stop 2024-09-15T21:55:19.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.013+0000 7f0e828bf640 1 -- 172.21.15.1:0/898020609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e7c0b5c60 msgr2=0x7f0e7c09f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:19.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.013+0000 7f0e828bf640 1 --2- 172.21.15.1:0/898020609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e7c0b5c60 0x7f0e7c09f6a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e740b0040 tx=0x7f0e74019710 comp rx=0 tx=0).stop 2024-09-15T21:55:19.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.013+0000 7f0e828bf640 1 -- 172.21.15.1:0/898020609 shutdown_connections 2024-09-15T21:55:19.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.013+0000 7f0e828bf640 1 --2- 172.21.15.1:0/898020609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e7c0b5c60 0x7f0e7c09f6a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:19.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.013+0000 7f0e828bf640 1 --2- 172.21.15.1:0/898020609 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e7c0b03b0 0x7f0e7c09f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:19.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.013+0000 7f0e828bf640 1 --2- 172.21.15.1:0/898020609 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0e680678c0 0x7f0e68069d80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:19.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.013+0000 7f0e828bf640 1 --2- 172.21.15.1:0/898020609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e7c09b5d0 0x7f0e7c09e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:19.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.013+0000 7f0e828bf640 1 -- 172.21.15.1:0/898020609 >> 172.21.15.1:0/898020609 conn(0x7f0e7c0b6d50 msgr2=0x7f0e7c06c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:19.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.013+0000 7f0e828bf640 1 -- 172.21.15.1:0/898020609 shutdown_connections 2024-09-15T21:55:19.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.013+0000 7f0e828bf640 1 -- 172.21.15.1:0/898020609 wait complete. 2024-09-15T21:55:19.044 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T21:55:19.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa407043640 1 Processor -- start 2024-09-15T21:55:19.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa407043640 1 -- start start 2024-09-15T21:55:19.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa407043640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa400072580 0x7fa4001426d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:19.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa407043640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4000738d0 con 0x7fa400142c10 2024-09-15T21:55:19.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa407043640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4000b8d40 con 0x7fa400073d40 2024-09-15T21:55:19.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa407043640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa4000b69d0 con 0x7fa400072580 2024-09-15T21:55:19.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa4055e0640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa400142c10 0x7fa40014ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46022/0 (socket says 172.21.15.1:46022) 2024-09-15T21:55:19.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa4055e0640 1 -- 172.21.15.1:0/2805275463 learned_addr learned my addr 172.21.15.1:0/2805275463 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3fffff640 1 --2- 172.21.15.1:0/2805275463 >> v2:172.21.15.70:3300/0 conn(0x7fa400072580 0x7fa4001426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2032211175 0 0) 0x7fa4000738d0 con 0x7fa400142c10 2024-09-15T21:55:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3e8003530 con 0x7fa400142c10 2024-09-15T21:55:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4024252146 0 0) 0x7fa3e8003530 con 0x7fa400142c10 2024-09-15T21:55:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 >> v2:172.21.15.70:3300/0 conn(0x7fa400072580 msgr2=0x7fa4001426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 --2- 172.21.15.1:0/2805275463 >> v2:172.21.15.70:3300/0 conn(0x7fa400072580 0x7fa4001426d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 >> v1:172.21.15.70:6789/0 conn(0x7fa400073d40 legacy=0x7fa400149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:19.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa400148d90 con 0x7fa400142c10 2024-09-15T21:55:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7fa3f8001a00 con 0x7fa400142c10 2024-09-15T21:55:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 >> v1:172.21.15.1:6789/0 conn(0x7fa400142c10 legacy=0x7fa40014ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 --2- 172.21.15.1:0/2805275463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3e80039c0 0x7fa3e8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 --2- 172.21.15.1:0/2805275463 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3e8004810 0x7fa3e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 --2- 172.21.15.1:0/2805275463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3e80052f0 0x7fa3e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa4000b69d0 con 0x7fa3e80039c0 2024-09-15T21:55:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e800c1c0 con 0x7fa3e80052f0 2024-09-15T21:55:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e800c3c0 con 0x7fa3e8004810 2024-09-15T21:55:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.217+0000 7fa404ddf640 1 --2- 172.21.15.1:0/2805275463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3e80039c0 0x7fa3e8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa4055e0640 1 --2- 172.21.15.1:0/2805275463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3e80052f0 0x7fa3e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa404ddf640 1 -- 172.21.15.1:0/2805275463 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3e8004810 msgr2=0x7fa3e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:19.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa3fffff640 1 --2- 172.21.15.1:0/2805275463 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3e8004810 0x7fa3e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa404ddf640 1 --2- 172.21.15.1:0/2805275463 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3e8004810 0x7fa3e8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa404ddf640 1 -- 172.21.15.1:0/2805275463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3e80052f0 msgr2=0x7fa3e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa404ddf640 1 --2- 172.21.15.1:0/2805275463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3e80052f0 0x7fa3e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa404ddf640 1 -- 172.21.15.1:0/2805275463 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e8003530 con 0x7fa3e80039c0 2024-09-15T21:55:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa4055e0640 1 --2- 172.21.15.1:0/2805275463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3e80052f0 0x7fa3e800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa4055e0640 1 -- 172.21.15.1:0/2805275463 reap_dead start 2024-09-15T21:55:19.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa3fffff640 1 --2- 172.21.15.1:0/2805275463 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3e8004810 0x7fa3e8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:19.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa404ddf640 1 --2- 172.21.15.1:0/2805275463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3e80039c0 0x7fa3e8003e00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0001780 tx=0x7fa3f001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6744e0fe190c740 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:19.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f00013a0 con 0x7fa3e80039c0 2024-09-15T21:55:19.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3f00052f0 con 0x7fa3e80039c0 2024-09-15T21:55:19.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa3ff7fe640 1 -- 172.21.15.1:0/2805275463 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0003840 con 0x7fa3e80039c0 2024-09-15T21:55:19.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa407043640 1 -- 172.21.15.1:0/2805275463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3e80039c0 msgr2=0x7fa3e8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:19.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa407043640 1 --2- 172.21.15.1:0/2805275463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3e80039c0 0x7fa3e8003e00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0001780 tx=0x7fa3f001c400 comp rx=0 tx=0).stop 2024-09-15T21:55:19.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa407043640 1 -- 172.21.15.1:0/2805275463 shutdown_connections 2024-09-15T21:55:19.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa407043640 1 --2- 172.21.15.1:0/2805275463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3e80039c0 0x7fa3e8003e00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:19.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa407043640 1 -- 172.21.15.1:0/2805275463 >> 172.21.15.1:0/2805275463 conn(0x7fa4000bb3b0 msgr2=0x7fa4000bb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:19.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa407043640 1 -- 172.21.15.1:0/2805275463 shutdown_connections 2024-09-15T21:55:19.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.221+0000 7fa407043640 1 -- 172.21.15.1:0/2805275463 wait complete. 2024-09-15T21:55:19.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa407043640 1 Processor -- start 2024-09-15T21:55:19.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa407043640 1 -- start start 2024-09-15T21:55:19.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa407043640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3e80039c0 0x7fa40009b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:19.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa407043640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4001d1c00 0x7fa4001deae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:19.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa407043640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4001df020 0x7fa40013f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:19.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa407043640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa4001431a0 con 0x7fa4001d1c00 2024-09-15T21:55:19.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa407043640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa400143020 con 0x7fa4001df020 2024-09-15T21:55:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa407043640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa40006f340 con 0x7fa3e80039c0 2024-09-15T21:55:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa3fffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4001d1c00 0x7fa4001deae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa3fffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4001d1c00 0x7fa4001deae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34420/0 (socket says 172.21.15.1:34420) 2024-09-15T21:55:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa3fffff640 1 -- 172.21.15.1:0/2584362492 learned_addr learned my addr 172.21.15.1:0/2584362492 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa4055e0640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4001df020 0x7fa40013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa404ddf640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3e80039c0 0x7fa40009b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa3fffff640 1 -- 172.21.15.1:0/2584362492 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3e80039c0 msgr2=0x7fa40009b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa3fffff640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3e80039c0 0x7fa40009b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa3fffff640 1 -- 172.21.15.1:0/2584362492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4001df020 msgr2=0x7fa40013f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa3fffff640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4001df020 0x7fa40013f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa3fffff640 1 -- 172.21.15.1:0/2584362492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4001df4a0 con 0x7fa4001d1c00 2024-09-15T21:55:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa3fffff640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4001d1c00 0x7fa4001deae0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4010790 tx=0x7fa3f4010c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:19.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa3fd7fa640 1 -- 172.21.15.1:0/2584362492 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400f040 con 0x7fa4001d1c00 2024-09-15T21:55:19.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa3fd7fa640 1 -- 172.21.15.1:0/2584362492 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3f400e960 con 0x7fa4001d1c00 2024-09-15T21:55:19.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa3fd7fa640 1 -- 172.21.15.1:0/2584362492 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400ed30 con 0x7fa4001d1c00 2024-09-15T21:55:19.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa407043640 1 -- 172.21.15.1:0/2584362492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4000a03a0 con 0x7fa4001d1c00 2024-09-15T21:55:19.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa407043640 1 -- 172.21.15.1:0/2584362492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa40009c8d0 con 0x7fa4001d1c00 2024-09-15T21:55:19.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa407043640 1 -- 172.21.15.1:0/2584362492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa40006f640 con 0x7fa4001d1c00 2024-09-15T21:55:19.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.225+0000 7fa3fd7fa640 1 -- 172.21.15.1:0/2584362492 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3f401c400 con 0x7fa4001d1c00 2024-09-15T21:55:19.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.229+0000 7fa3fd7fa640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa3ec0678c0 0x7fa3ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:19.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.229+0000 7fa404ddf640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa3ec0678c0 0x7fa3ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:19.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.229+0000 7fa3fd7fa640 1 -- 172.21.15.1:0/2584362492 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fa3f4085ee0 con 0x7fa4001d1c00 2024-09-15T21:55:19.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.229+0000 7fa404ddf640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa3ec0678c0 0x7fa3ec069d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0001750 tx=0x7fa3f00011a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:19.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.233+0000 7fa3fd7fa640 1 -- 172.21.15.1:0/2584362492 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa4001df4a0 con 0x7fa4001d1c00 2024-09-15T21:55:19.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:19.401+0000 7fa407043640 1 -- 172.21.15.1:0/2584362492 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa4000b6410 con 0x7fa4001d1c00 2024-09-15T21:55:20.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.021+0000 7fa3fd7fa640 1 -- 172.21.15.1:0/2584362492 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7fa3f4018030 con 0x7fa4001d1c00 2024-09-15T21:55:20.025 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2024-09-15T21:55:20.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.025+0000 7fa407043640 1 -- 172.21.15.1:0/2584362492 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa3ec0678c0 msgr2=0x7fa3ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:20.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.025+0000 7fa407043640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa3ec0678c0 0x7fa3ec069d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0001750 tx=0x7fa3f00011a0 comp rx=0 tx=0).stop 2024-09-15T21:55:20.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.025+0000 7fa407043640 1 -- 172.21.15.1:0/2584362492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4001d1c00 msgr2=0x7fa4001deae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:20.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.025+0000 7fa407043640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4001d1c00 0x7fa4001deae0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4010790 tx=0x7fa3f4010c50 comp rx=0 tx=0).stop 2024-09-15T21:55:20.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.025+0000 7fa407043640 1 -- 172.21.15.1:0/2584362492 shutdown_connections 2024-09-15T21:55:20.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.025+0000 7fa407043640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa3ec0678c0 0x7fa3ec069d80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:20.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.025+0000 7fa407043640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4001df020 0x7fa40013f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:20.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.025+0000 7fa407043640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa4001d1c00 0x7fa4001deae0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:20.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.025+0000 7fa407043640 1 --2- 172.21.15.1:0/2584362492 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3e80039c0 0x7fa40009b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:20.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.025+0000 7fa407043640 1 -- 172.21.15.1:0/2584362492 >> 172.21.15.1:0/2584362492 conn(0x7fa4000bb3b0 msgr2=0x7fa4000bb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:20.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.025+0000 7fa407043640 1 -- 172.21.15.1:0/2584362492 shutdown_connections 2024-09-15T21:55:20.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.025+0000 7fa407043640 1 -- 172.21.15.1:0/2584362492 wait complete. 2024-09-15T21:55:20.061 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T21:55:20.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44bb270640 1 Processor -- start 2024-09-15T21:55:20.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44bb270640 1 -- start start 2024-09-15T21:55:20.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44bb270640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f44b40b4560 0x7f44b40b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:20.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44bb270640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f44b406d0d0 0x7f44b4148d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:20.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44bb270640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b41496c0 con 0x7f44b4149280 2024-09-15T21:55:20.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44bb270640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f44b406dc00 con 0x7f44b40b4560 2024-09-15T21:55:20.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44bb270640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f44b406d5b0 con 0x7f44b406d0d0 2024-09-15T21:55:20.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44b880b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f44b406d0d0 0x7f44b4148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:20.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44b900c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f44b40b4560 0x7f44b40b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:20.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44b980d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f44b4149280 0x7f44b409dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.1:59828/0 (socket says 172.21.15.1:59828) 2024-09-15T21:55:20.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44b980d640 1 -- 172.21.15.1:0/3874854786 learned_addr learned my addr 172.21.15.1:0/3874854786 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:20.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44b900c640 1 -- 172.21.15.1:0/3874854786 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f44b406d0d0 msgr2=0x7f44b4148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:20.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44b900c640 1 --2- 172.21.15.1:0/3874854786 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f44b406d0d0 0x7f44b4148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:20.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44b900c640 1 -- 172.21.15.1:0/3874854786 >> v1:172.21.15.70:6789/0 conn(0x7f44b4149280 legacy=0x7f44b409dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:20.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44b900c640 1 -- 172.21.15.1:0/3874854786 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b406d890 con 0x7f44b40b4560 2024-09-15T21:55:20.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.181+0000 7f44abfff640 1 -- 172.21.15.1:0/3874854786 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1851563989 0 0) 0x7f44b41496c0 con 0x7f44b4149280 2024-09-15T21:55:20.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44b900c640 1 --2- 172.21.15.1:0/3874854786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b40b4560 0x7f44b40b4940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f44b406dd80 tx=0x7f44b001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=635036eac14b8d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:20.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44abfff640 1 -- 172.21.15.1:0/3874854786 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b00b0070 con 0x7f44b40b4560 2024-09-15T21:55:20.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44abfff640 1 -- 172.21.15.1:0/3874854786 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b00ab600 con 0x7f44b40b4560 2024-09-15T21:55:20.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44abfff640 1 -- 172.21.15.1:0/3874854786 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b00ab9d0 con 0x7f44b40b4560 2024-09-15T21:55:20.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 -- 172.21.15.1:0/3874854786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b40b4560 msgr2=0x7f44b40b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:20.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 --2- 172.21.15.1:0/3874854786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b40b4560 0x7f44b40b4940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f44b406dd80 tx=0x7f44b001c410 comp rx=0 tx=0).stop 2024-09-15T21:55:20.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 -- 172.21.15.1:0/3874854786 shutdown_connections 2024-09-15T21:55:20.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 --2- 172.21.15.1:0/3874854786 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f44b406d0d0 0x7f44b4148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:20.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 --2- 172.21.15.1:0/3874854786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b40b4560 0x7f44b40b4940 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:20.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 -- 172.21.15.1:0/3874854786 >> 172.21.15.1:0/3874854786 conn(0x7f44b406c730 msgr2=0x7f44b40b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:20.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 -- 172.21.15.1:0/3874854786 shutdown_connections 2024-09-15T21:55:20.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 -- 172.21.15.1:0/3874854786 wait complete. 2024-09-15T21:55:20.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 Processor -- start 2024-09-15T21:55:20.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 -- start start 2024-09-15T21:55:20.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b406d0d0 0x7f44b40b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44b40b4560 0x7f44b40b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f44b4149280 0x7f44b4072580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f44b4152b20 con 0x7f44b40b4560 2024-09-15T21:55:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f44b41529a0 con 0x7f44b406d0d0 2024-09-15T21:55:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44bb270640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f44b4152ca0 con 0x7f44b4149280 2024-09-15T21:55:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44b880b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44b40b4560 0x7f44b40b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44b880b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44b40b4560 0x7f44b40b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34430/0 (socket says 172.21.15.1:34430) 2024-09-15T21:55:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.185+0000 7f44b880b640 1 -- 172.21.15.1:0/3651617048 learned_addr learned my addr 172.21.15.1:0/3651617048 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44b900c640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b406d0d0 0x7f44b40b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:20.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44b980d640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f44b4149280 0x7f44b4072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44b880b640 1 -- 172.21.15.1:0/3651617048 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f44b4149280 msgr2=0x7f44b4072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44b880b640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f44b4149280 0x7f44b4072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44b880b640 1 -- 172.21.15.1:0/3651617048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b406d0d0 msgr2=0x7f44b40b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44b880b640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b406d0d0 0x7f44b40b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44b880b640 1 -- 172.21.15.1:0/3651617048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b40b1730 con 0x7f44b40b4560 2024-09-15T21:55:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44b900c640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b406d0d0 0x7f44b40b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44b880b640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44b40b4560 0x7f44b40b11f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f44a400e930 tx=0x7f44a400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44a9ffb640 1 -- 172.21.15.1:0/3651617048 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a4017070 con 0x7f44b40b4560 2024-09-15T21:55:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44a9ffb640 1 -- 172.21.15.1:0/3651617048 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44a400ca00 con 0x7f44b40b4560 2024-09-15T21:55:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44bb270640 1 -- 172.21.15.1:0/3651617048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b40b19b0 con 0x7f44b40b4560 2024-09-15T21:55:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44a9ffb640 1 -- 172.21.15.1:0/3651617048 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a400cdb0 con 0x7f44b40b4560 2024-09-15T21:55:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44bb270640 1 -- 172.21.15.1:0/3651617048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b4142be0 con 0x7f44b40b4560 2024-09-15T21:55:20.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44bb270640 1 -- 172.21.15.1:0/3651617048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b4072be0 con 0x7f44b40b4560 2024-09-15T21:55:20.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44a9ffb640 1 -- 172.21.15.1:0/3651617048 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f44a401a070 con 0x7f44b40b4560 2024-09-15T21:55:20.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44a9ffb640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f44980678c0 0x7f4498069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:20.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44b900c640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f44980678c0 0x7f4498069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:20.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44a9ffb640 1 -- 172.21.15.1:0/3651617048 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f44a4085bc0 con 0x7f44b40b4560 2024-09-15T21:55:20.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.189+0000 7f44b900c640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f44980678c0 0x7f4498069d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44b00ad000 tx=0x7f44b00a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:20.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.193+0000 7f44a9ffb640 1 -- 172.21.15.1:0/3651617048 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f44b4072be0 con 0x7f44b40b4560 2024-09-15T21:55:20.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:20.393+0000 7f44bb270640 1 -- 172.21.15.1:0/3651617048 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f44b40b5510 con 0x7f44b40b4560 2024-09-15T21:55:21.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.025+0000 7f44a9ffb640 1 -- 172.21.15.1:0/3651617048 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f44b40b1730 con 0x7f44b40b4560 2024-09-15T21:55:21.028 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T21:55:21.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.025+0000 7f44bb270640 1 -- 172.21.15.1:0/3651617048 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f44980678c0 msgr2=0x7f4498069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.025+0000 7f44bb270640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f44980678c0 0x7f4498069d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f44b00ad000 tx=0x7f44b00a6000 comp rx=0 tx=0).stop 2024-09-15T21:55:21.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.025+0000 7f44bb270640 1 -- 172.21.15.1:0/3651617048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44b40b4560 msgr2=0x7f44b40b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.025+0000 7f44bb270640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44b40b4560 0x7f44b40b11f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f44a400e930 tx=0x7f44a400edf0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.029+0000 7f44bb270640 1 -- 172.21.15.1:0/3651617048 shutdown_connections 2024-09-15T21:55:21.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.029+0000 7f44bb270640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f44b4149280 0x7f44b4072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.029+0000 7f44bb270640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f44b40b4560 0x7f44b40b11f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.029+0000 7f44bb270640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f44980678c0 0x7f4498069d80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.029+0000 7f44bb270640 1 --2- 172.21.15.1:0/3651617048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b406d0d0 0x7f44b40b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.029+0000 7f44bb270640 1 -- 172.21.15.1:0/3651617048 >> 172.21.15.1:0/3651617048 conn(0x7f44b406c730 msgr2=0x7f44b4144e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:21.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.029+0000 7f44bb270640 1 -- 172.21.15.1:0/3651617048 shutdown_connections 2024-09-15T21:55:21.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.029+0000 7f44bb270640 1 -- 172.21.15.1:0/3651617048 wait complete. 2024-09-15T21:55:21.074 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:21.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.189+0000 7f19b57f3640 1 Processor -- start 2024-09-15T21:55:21.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.189+0000 7f19b57f3640 1 -- start start 2024-09-15T21:55:21.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19b57f3640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f19b00b5600 0x7f19b009ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19b57f3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f19b0148f20 0x7f19b0149390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19b57f3640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19b01498d0 con 0x7f19b00b5220 2024-09-15T21:55:21.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19b57f3640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f19b009b800 con 0x7f19b00b5600 2024-09-15T21:55:21.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19b57f3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f19b00b4dd0 con 0x7f19b0148f20 2024-09-15T21:55:21.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19ae7fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f19b00b5600 0x7f19b009ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19aeffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f19b00b5220 0x7f19b009aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46028/0 (socket says 172.21.15.1:46028) 2024-09-15T21:55:21.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19ae7fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f19b00b5600 0x7f19b009ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34434/0 (socket says 172.21.15.1:34434) 2024-09-15T21:55:21.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19aeffd640 1 -- 172.21.15.1:0/3814771700 learned_addr learned my addr 172.21.15.1:0/3814771700 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:21.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19ae7fc640 1 -- 172.21.15.1:0/3814771700 >> v2:172.21.15.70:3300/0 conn(0x7f19b0148f20 msgr2=0x7f19b0149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:21.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19ae7fc640 1 --2- 172.21.15.1:0/3814771700 >> v2:172.21.15.70:3300/0 conn(0x7f19b0148f20 0x7f19b0149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19ae7fc640 1 -- 172.21.15.1:0/3814771700 >> v1:172.21.15.1:6789/0 conn(0x7f19b00b5220 legacy=0x7f19b009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19ae7fc640 1 -- 172.21.15.1:0/3814771700 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b00b6a50 con 0x7f19b00b5600 2024-09-15T21:55:21.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19adffb640 1 -- 172.21.15.1:0/3814771700 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 156832185 0 0) 0x7f19b01498d0 con 0x7f19b00b5220 2024-09-15T21:55:21.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19ae7fc640 1 --2- 172.21.15.1:0/3814771700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19b00b5600 0x7f19b009ee10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19b006edb0 tx=0x7f19a401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa320cf96f1f3f65 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:21.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19adffb640 1 -- 172.21.15.1:0/3814771700 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a40b0070 con 0x7f19b00b5600 2024-09-15T21:55:21.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19adffb640 1 -- 172.21.15.1:0/3814771700 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a40ab600 con 0x7f19b00b5600 2024-09-15T21:55:21.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19adffb640 1 -- 172.21.15.1:0/3814771700 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a40ab9d0 con 0x7f19b00b5600 2024-09-15T21:55:21.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19b57f3640 1 -- 172.21.15.1:0/3814771700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19b00b5600 msgr2=0x7f19b009ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19b57f3640 1 --2- 172.21.15.1:0/3814771700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19b00b5600 0x7f19b009ee10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19b006edb0 tx=0x7f19a401c330 comp rx=0 tx=0).stop 2024-09-15T21:55:21.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19b57f3640 1 -- 172.21.15.1:0/3814771700 shutdown_connections 2024-09-15T21:55:21.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19b57f3640 1 --2- 172.21.15.1:0/3814771700 >> v2:172.21.15.70:3300/0 conn(0x7f19b0148f20 0x7f19b0149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19b57f3640 1 --2- 172.21.15.1:0/3814771700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19b00b5600 0x7f19b009ee10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19b57f3640 1 -- 172.21.15.1:0/3814771700 >> 172.21.15.1:0/3814771700 conn(0x7f19b00b5c40 msgr2=0x7f19b00b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:21.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19b57f3640 1 -- 172.21.15.1:0/3814771700 shutdown_connections 2024-09-15T21:55:21.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.193+0000 7f19b57f3640 1 -- 172.21.15.1:0/3814771700 wait complete. 2024-09-15T21:55:21.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19b57f3640 1 Processor -- start 2024-09-15T21:55:21.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19b57f3640 1 -- start start 2024-09-15T21:55:21.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19b57f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19b00b5220 0x7f19b00ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19b57f3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19b00b5600 0x7f19b01e0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19b57f3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b0148f20 0x7f19b01e06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19b57f3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f19b0152700 con 0x7f19b00b5600 2024-09-15T21:55:21.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19b57f3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f19b0152880 con 0x7f19b00b5220 2024-09-15T21:55:21.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19b57f3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f19b0152a00 con 0x7f19b0148f20 2024-09-15T21:55:21.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19ae7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19b00b5600 0x7f19b01e0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19ae7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19b00b5600 0x7f19b01e0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34442/0 (socket says 172.21.15.1:34442) 2024-09-15T21:55:21.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19ae7fc640 1 -- 172.21.15.1:0/1513946945 learned_addr learned my addr 172.21.15.1:0/1513946945 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:21.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19ae7fc640 1 -- 172.21.15.1:0/1513946945 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b0148f20 msgr2=0x7f19b01e06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19ae7fc640 1 --2- 172.21.15.1:0/1513946945 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b0148f20 0x7f19b01e06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19ae7fc640 1 -- 172.21.15.1:0/1513946945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19b00b5220 msgr2=0x7f19b00ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19ae7fc640 1 --2- 172.21.15.1:0/1513946945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19b00b5220 0x7f19b00ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19ae7fc640 1 -- 172.21.15.1:0/1513946945 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19b014f270 con 0x7f19b00b5600 2024-09-15T21:55:21.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19ae7fc640 1 --2- 172.21.15.1:0/1513946945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19b00b5600 0x7f19b01e0170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f19a4018f40 tx=0x7f19a40190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:21.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19977fe640 1 -- 172.21.15.1:0/1513946945 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a40b8020 con 0x7f19b00b5600 2024-09-15T21:55:21.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19977fe640 1 -- 172.21.15.1:0/1513946945 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a40b4610 con 0x7f19b00b5600 2024-09-15T21:55:21.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19b57f3640 1 -- 172.21.15.1:0/1513946945 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19b00afc80 con 0x7f19b00b5600 2024-09-15T21:55:21.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19977fe640 1 -- 172.21.15.1:0/1513946945 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a40b0040 con 0x7f19b00b5600 2024-09-15T21:55:21.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19b57f3640 1 -- 172.21.15.1:0/1513946945 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19b00aea60 con 0x7f19b00b5600 2024-09-15T21:55:21.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19b57f3640 1 -- 172.21.15.1:0/1513946945 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19b009ee10 con 0x7f19b00b5600 2024-09-15T21:55:21.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.197+0000 7f19977fe640 1 -- 172.21.15.1:0/1513946945 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f19a40bb020 con 0x7f19b00b5600 2024-09-15T21:55:21.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.201+0000 7f19977fe640 1 --2- 172.21.15.1:0/1513946945 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f199c0678c0 0x7f199c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.201+0000 7f19aeffd640 1 --2- 172.21.15.1:0/1513946945 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f199c0678c0 0x7f199c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.201+0000 7f19977fe640 1 -- 172.21.15.1:0/1513946945 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f19a411f940 con 0x7f19b00b5600 2024-09-15T21:55:21.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.201+0000 7f19aeffd640 1 --2- 172.21.15.1:0/1513946945 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f199c0678c0 0x7f199c069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19a00015a0 tx=0x7f19a0007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:21.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.205+0000 7f19977fe640 1 -- 172.21.15.1:0/1513946945 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f19a40c2030 con 0x7f19b00b5600 2024-09-15T21:55:21.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.369+0000 7f19b57f3640 1 -- 172.21.15.1:0/1513946945 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19b00b7c30 con 0x7f19b00b5600 2024-09-15T21:55:21.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.373+0000 7f19977fe640 1 -- 172.21.15.1:0/1513946945 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16606 (secure 0 0 0) 0x7f19a4016070 con 0x7f19b00b5600 2024-09-15T21:55:21.376 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:21.376 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:20.399361+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:18.271646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:19.444906+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:21.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.373+0000 7f19b57f3640 1 -- 172.21.15.1:0/1513946945 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f199c0678c0 msgr2=0x7f199c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.373+0000 7f19b57f3640 1 --2- 172.21.15.1:0/1513946945 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f199c0678c0 0x7f199c069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f19a00015a0 tx=0x7f19a0007970 comp rx=0 tx=0).stop 2024-09-15T21:55:21.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.373+0000 7f19b57f3640 1 -- 172.21.15.1:0/1513946945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19b00b5600 msgr2=0x7f19b01e0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.373+0000 7f19b57f3640 1 --2- 172.21.15.1:0/1513946945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19b00b5600 0x7f19b01e0170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f19a4018f40 tx=0x7f19a40190d0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.373+0000 7f19b57f3640 1 -- 172.21.15.1:0/1513946945 shutdown_connections 2024-09-15T21:55:21.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.373+0000 7f19b57f3640 1 --2- 172.21.15.1:0/1513946945 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b0148f20 0x7f19b01e06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.373+0000 7f19b57f3640 1 --2- 172.21.15.1:0/1513946945 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19b00b5600 0x7f19b01e0170 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.373+0000 7f19b57f3640 1 --2- 172.21.15.1:0/1513946945 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f199c0678c0 0x7f199c069d80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.373+0000 7f19b57f3640 1 --2- 172.21.15.1:0/1513946945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19b00b5220 0x7f19b00ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.373+0000 7f19b57f3640 1 -- 172.21.15.1:0/1513946945 >> 172.21.15.1:0/1513946945 conn(0x7f19b00b5c40 msgr2=0x7f19b00b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:21.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.373+0000 7f19b57f3640 1 -- 172.21.15.1:0/1513946945 shutdown_connections 2024-09-15T21:55:21.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.373+0000 7f19b57f3640 1 -- 172.21.15.1:0/1513946945 wait complete. 2024-09-15T21:55:21.395 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:21.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.517+0000 7f4010d85640 1 Processor -- start 2024-09-15T21:55:21.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.517+0000 7f4010d85640 1 -- start start 2024-09-15T21:55:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f4010d85640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f400c0b5220 0x7f400c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f4010d85640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f400c09f520 con 0x7f400c148f20 2024-09-15T21:55:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f4010d85640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f400c0b6a50 con 0x7f400c0b5600 2024-09-15T21:55:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f4010d85640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f400c09b800 con 0x7f400c0b5220 2024-09-15T21:55:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400ad9d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f400c148f20 0x7f400c149370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46034/0 (socket says 172.21.15.1:46034) 2024-09-15T21:55:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400ad9d640 1 -- 172.21.15.1:0/790935513 learned_addr learned my addr 172.21.15.1:0/790935513 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400a59c640 1 --2- 172.21.15.1:0/790935513 >> v2:172.21.15.70:3300/0 conn(0x7f400c0b5220 0x7f400c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3406190597 0 0) 0x7f400c09f520 con 0x7f400c148f20 2024-09-15T21:55:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ff8003530 con 0x7f400c148f20 2024-09-15T21:55:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2149363746 0 0) 0x7f3ff8003530 con 0x7f400c148f20 2024-09-15T21:55:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 >> v2:172.21.15.70:3300/0 conn(0x7f400c0b5220 msgr2=0x7f400c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 --2- 172.21.15.1:0/790935513 >> v2:172.21.15.70:3300/0 conn(0x7f400c0b5220 0x7f400c09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 >> v1:172.21.15.70:6789/0 conn(0x7f400c0b5600 legacy=0x7f400c09ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400c09af90 con 0x7f400c148f20 2024-09-15T21:55:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f3ffc001680 con 0x7f400c148f20 2024-09-15T21:55:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 >> v1:172.21.15.1:6789/0 conn(0x7f400c148f20 legacy=0x7f400c149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 --2- 172.21.15.1:0/790935513 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3ff80039c0 0x7f3ff8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 --2- 172.21.15.1:0/790935513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8004810 0x7f3ff8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 --2- 172.21.15.1:0/790935513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ff80052f0 0x7f3ff800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f400c09b800 con 0x7f3ff80052f0 2024-09-15T21:55:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff800c1c0 con 0x7f3ff8004810 2024-09-15T21:55:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff800c3c0 con 0x7f3ff80039c0 2024-09-15T21:55:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400ad9d640 1 --2- 172.21.15.1:0/790935513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ff80052f0 0x7f3ff800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400a59c640 1 --2- 172.21.15.1:0/790935513 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3ff80039c0 0x7f3ff8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f4009d9b640 1 --2- 172.21.15.1:0/790935513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8004810 0x7f3ff8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400ad9d640 1 -- 172.21.15.1:0/790935513 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3ff80039c0 msgr2=0x7f3ff8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:21.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400ad9d640 1 --2- 172.21.15.1:0/790935513 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3ff80039c0 0x7f3ff8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400ad9d640 1 -- 172.21.15.1:0/790935513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8004810 msgr2=0x7f3ff8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:21.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400ad9d640 1 --2- 172.21.15.1:0/790935513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8004810 0x7f3ff8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f400ad9d640 1 -- 172.21.15.1:0/790935513 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff8003530 con 0x7f3ff80052f0 2024-09-15T21:55:21.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.521+0000 7f4009d9b640 1 --2- 172.21.15.1:0/790935513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff8004810 0x7f3ff8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:21.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400ad9d640 1 -- 172.21.15.1:0/790935513 reap_dead start 2024-09-15T21:55:21.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400ad9d640 1 --2- 172.21.15.1:0/790935513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ff80052f0 0x7f3ff800b9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00c190 tx=0x7f3ffc01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4541d01cb3166c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:21.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc007d00 con 0x7f3ff80052f0 2024-09-15T21:55:21.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ffc0a9070 con 0x7f3ff80052f0 2024-09-15T21:55:21.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400959a640 1 -- 172.21.15.1:0/790935513 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc005d20 con 0x7f3ff80052f0 2024-09-15T21:55:21.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 -- 172.21.15.1:0/790935513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ff80052f0 msgr2=0x7f3ff800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 --2- 172.21.15.1:0/790935513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ff80052f0 0x7f3ff800b9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00c190 tx=0x7f3ffc01cc40 comp rx=0 tx=0).stop 2024-09-15T21:55:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 -- 172.21.15.1:0/790935513 shutdown_connections 2024-09-15T21:55:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 --2- 172.21.15.1:0/790935513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ff80052f0 0x7f3ff800b9d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 -- 172.21.15.1:0/790935513 >> 172.21.15.1:0/790935513 conn(0x7f400c0b5c40 msgr2=0x7f400c0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 -- 172.21.15.1:0/790935513 shutdown_connections 2024-09-15T21:55:21.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 -- 172.21.15.1:0/790935513 wait complete. 2024-09-15T21:55:21.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 Processor -- start 2024-09-15T21:55:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 -- start start 2024-09-15T21:55:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff80052f0 0x7f400c14e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f400c1dfb70 0x7f400c1e30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f400c1dfff0 0x7f400c1e3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f400c09ade0 con 0x7f400c1dfff0 2024-09-15T21:55:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f400c09ac60 con 0x7f3ff80052f0 2024-09-15T21:55:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f400c0af100 con 0x7f400c1dfb70 2024-09-15T21:55:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f400c1dfff0 0x7f400c1e3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f400c1dfff0 0x7f400c1e3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34456/0 (socket says 172.21.15.1:34456) 2024-09-15T21:55:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400ad9d640 1 -- 172.21.15.1:0/3344457493 learned_addr learned my addr 172.21.15.1:0/3344457493 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400a59c640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff80052f0 0x7f400c14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400ad9d640 1 -- 172.21.15.1:0/3344457493 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f400c1dfb70 msgr2=0x7f400c1e30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400ad9d640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f400c1dfb70 0x7f400c1e30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400ad9d640 1 -- 172.21.15.1:0/3344457493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff80052f0 msgr2=0x7f400c14e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400ad9d640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff80052f0 0x7f400c14e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400ad9d640 1 -- 172.21.15.1:0/3344457493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400c0afda0 con 0x7f400c1dfff0 2024-09-15T21:55:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400a59c640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff80052f0 0x7f400c14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f400ad9d640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f400c1dfff0 0x7f400c1e3620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc007040 tx=0x7f3ff8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4002ffd640 1 -- 172.21.15.1:0/3344457493 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc001c40 con 0x7f400c1dfff0 2024-09-15T21:55:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4002ffd640 1 -- 172.21.15.1:0/3344457493 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ffc0a5810 con 0x7f400c1dfff0 2024-09-15T21:55:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.525+0000 7f4010d85640 1 -- 172.21.15.1:0/3344457493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f400c14f780 con 0x7f400c1dfff0 2024-09-15T21:55:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.529+0000 7f4002ffd640 1 -- 172.21.15.1:0/3344457493 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc0a5c00 con 0x7f400c1dfff0 2024-09-15T21:55:21.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.529+0000 7f4010d85640 1 -- 172.21.15.1:0/3344457493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f400c0aed90 con 0x7f400c1dfff0 2024-09-15T21:55:21.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.529+0000 7f4010d85640 1 -- 172.21.15.1:0/3344457493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f400c0af280 con 0x7f400c1dfff0 2024-09-15T21:55:21.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.529+0000 7f4002ffd640 1 -- 172.21.15.1:0/3344457493 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ffc0b6030 con 0x7f400c1dfff0 2024-09-15T21:55:21.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.529+0000 7f4002ffd640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3fec0678c0 0x7f3fec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.529+0000 7f400a59c640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3fec0678c0 0x7f3fec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.529+0000 7f4002ffd640 1 -- 172.21.15.1:0/3344457493 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3ffc11e0b0 con 0x7f400c1dfff0 2024-09-15T21:55:21.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.529+0000 7f400a59c640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3fec0678c0 0x7f3fec069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f400c0ae8a0 tx=0x7f400400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:21.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.533+0000 7f4002ffd640 1 -- 172.21.15.1:0/3344457493 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3ffc016950 con 0x7f400c1dfff0 2024-09-15T21:55:21.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.697+0000 7f4010d85640 1 -- 172.21.15.1:0/3344457493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f400c09eea0 con 0x7f400c1dfff0 2024-09-15T21:55:21.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.697+0000 7f4002ffd640 1 -- 172.21.15.1:0/3344457493 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16606 (secure 0 0 0) 0x7f3ffc0eec00 con 0x7f400c1dfff0 2024-09-15T21:55:21.703 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:21.703 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":20,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:20.399361+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:18.271646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:19.444906+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.701+0000 7f4010d85640 1 -- 172.21.15.1:0/3344457493 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3fec0678c0 msgr2=0x7f3fec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.701+0000 7f4010d85640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3fec0678c0 0x7f3fec069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f400c0ae8a0 tx=0x7f400400b040 comp rx=0 tx=0).stop 2024-09-15T21:55:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.701+0000 7f4010d85640 1 -- 172.21.15.1:0/3344457493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f400c1dfff0 msgr2=0x7f400c1e3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.701+0000 7f4010d85640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f400c1dfff0 0x7f400c1e3620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc007040 tx=0x7f3ff8005840 comp rx=0 tx=0).stop 2024-09-15T21:55:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.701+0000 7f4010d85640 1 -- 172.21.15.1:0/3344457493 shutdown_connections 2024-09-15T21:55:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.701+0000 7f4010d85640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f400c1dfff0 0x7f400c1e3620 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.701+0000 7f4010d85640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f400c1dfb70 0x7f400c1e30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.701+0000 7f4010d85640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3fec0678c0 0x7f3fec069d80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.701+0000 7f4010d85640 1 --2- 172.21.15.1:0/3344457493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ff80052f0 0x7f400c14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.701+0000 7f4010d85640 1 -- 172.21.15.1:0/3344457493 >> 172.21.15.1:0/3344457493 conn(0x7f400c0b5c40 msgr2=0x7f400c142570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:21.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.701+0000 7f4010d85640 1 -- 172.21.15.1:0/3344457493 shutdown_connections 2024-09-15T21:55:21.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.701+0000 7f4010d85640 1 -- 172.21.15.1:0/3344457493 wait complete. 2024-09-15T21:55:21.722 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T21:55:21.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.837+0000 7fb6e789d640 1 Processor -- start 2024-09-15T21:55:21.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.837+0000 7fb6e789d640 1 -- start start 2024-09-15T21:55:21.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e789d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6e00b4560 0x7fb6e00b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e789d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb6e006d0d0 0x7fb6e0148d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e789d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6e01496c0 con 0x7fb6e0149280 2024-09-15T21:55:21.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e789d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fb6e006dc00 con 0x7fb6e006d0d0 2024-09-15T21:55:21.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e789d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e006d5b0 con 0x7fb6e00b4560 2024-09-15T21:55:21.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e5e3a640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb6e0149280 0x7fb6e009dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46038/0 (socket says 172.21.15.1:46038) 2024-09-15T21:55:21.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e5e3a640 1 -- 172.21.15.1:0/2019084687 learned_addr learned my addr 172.21.15.1:0/2019084687 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:21.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e4e38640 1 --2- 172.21.15.1:0/2019084687 >> v2:172.21.15.1:3300/0 conn(0x7fb6e006d0d0 0x7fb6e0148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e5639640 1 --2- 172.21.15.1:0/2019084687 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6e00b4560 0x7fb6e00b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6d7fff640 1 -- 172.21.15.1:0/2019084687 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051105291 0 0) 0x7fb6e01496c0 con 0x7fb6e0149280 2024-09-15T21:55:21.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6d7fff640 1 -- 172.21.15.1:0/2019084687 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6cc003530 con 0x7fb6e0149280 2024-09-15T21:55:21.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e4e38640 1 -- 172.21.15.1:0/2019084687 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6e00b4560 msgr2=0x7fb6e00b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:21.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e4e38640 1 --2- 172.21.15.1:0/2019084687 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6e00b4560 0x7fb6e00b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e4e38640 1 -- 172.21.15.1:0/2019084687 >> v1:172.21.15.1:6789/0 conn(0x7fb6e0149280 legacy=0x7fb6e009dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e4e38640 1 -- 172.21.15.1:0/2019084687 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e006d890 con 0x7fb6e006d0d0 2024-09-15T21:55:21.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e4e38640 1 --2- 172.21.15.1:0/2019084687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e006d0d0 0x7fb6e0148d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6e006dd80 tx=0x7fb6d001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c0a14f663e1eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:21.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6d7fff640 1 -- 172.21.15.1:0/2019084687 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00b0070 con 0x7fb6e006d0d0 2024-09-15T21:55:21.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6d7fff640 1 -- 172.21.15.1:0/2019084687 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d00ab600 con 0x7fb6e006d0d0 2024-09-15T21:55:21.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6d7fff640 1 -- 172.21.15.1:0/2019084687 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00ab9d0 con 0x7fb6e006d0d0 2024-09-15T21:55:21.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e789d640 1 -- 172.21.15.1:0/2019084687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e006d0d0 msgr2=0x7fb6e0148d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e789d640 1 --2- 172.21.15.1:0/2019084687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e006d0d0 0x7fb6e0148d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6e006dd80 tx=0x7fb6d001c410 comp rx=0 tx=0).stop 2024-09-15T21:55:21.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e789d640 1 -- 172.21.15.1:0/2019084687 shutdown_connections 2024-09-15T21:55:21.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e789d640 1 --2- 172.21.15.1:0/2019084687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e006d0d0 0x7fb6e0148d40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e789d640 1 --2- 172.21.15.1:0/2019084687 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6e00b4560 0x7fb6e00b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e789d640 1 -- 172.21.15.1:0/2019084687 >> 172.21.15.1:0/2019084687 conn(0x7fb6e006c730 msgr2=0x7fb6e00b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:21.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e789d640 1 -- 172.21.15.1:0/2019084687 shutdown_connections 2024-09-15T21:55:21.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.841+0000 7fb6e789d640 1 -- 172.21.15.1:0/2019084687 wait complete. 2024-09-15T21:55:21.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e789d640 1 Processor -- start 2024-09-15T21:55:21.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e789d640 1 -- start start 2024-09-15T21:55:21.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e789d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e006d0d0 0x7fb6e01e15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e789d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e00b4560 0x7fb6e0142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e789d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6e0149280 0x7fb6e0072500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e789d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e0152b20 con 0x7fb6e006d0d0 2024-09-15T21:55:21.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e789d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e01529a0 con 0x7fb6e00b4560 2024-09-15T21:55:21.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e789d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e0152ca0 con 0x7fb6e0149280 2024-09-15T21:55:21.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e5639640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e006d0d0 0x7fb6e01e15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e5639640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e006d0d0 0x7fb6e01e15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34476/0 (socket says 172.21.15.1:34476) 2024-09-15T21:55:21.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e5639640 1 -- 172.21.15.1:0/1892401908 learned_addr learned my addr 172.21.15.1:0/1892401908 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:21.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e5e3a640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6e0149280 0x7fb6e0072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e5639640 1 -- 172.21.15.1:0/1892401908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6e0149280 msgr2=0x7fb6e0072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e4e38640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e00b4560 0x7fb6e0142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e5639640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6e0149280 0x7fb6e0072500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e5639640 1 -- 172.21.15.1:0/1892401908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e00b4560 msgr2=0x7fb6e0142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:21.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e5639640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e00b4560 0x7fb6e0142b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:21.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e5639640 1 -- 172.21.15.1:0/1892401908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e00b1830 con 0x7fb6e006d0d0 2024-09-15T21:55:21.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e4e38640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e00b4560 0x7fb6e0142b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:21.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e5639640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e006d0d0 0x7fb6e01e15f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00d830 tx=0x7fb6dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:21.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6d5ffb640 1 -- 172.21.15.1:0/1892401908 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc00b6c0 con 0x7fb6e006d0d0 2024-09-15T21:55:21.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6d5ffb640 1 -- 172.21.15.1:0/1892401908 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6dc019070 con 0x7fb6e006d0d0 2024-09-15T21:55:21.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6d5ffb640 1 -- 172.21.15.1:0/1892401908 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc00ba60 con 0x7fb6e006d0d0 2024-09-15T21:55:21.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e789d640 1 -- 172.21.15.1:0/1892401908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e00b1b10 con 0x7fb6e006d0d0 2024-09-15T21:55:21.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e789d640 1 -- 172.21.15.1:0/1892401908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e00731b0 con 0x7fb6e006d0d0 2024-09-15T21:55:21.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.845+0000 7fb6e789d640 1 -- 172.21.15.1:0/1892401908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e0148d40 con 0x7fb6e006d0d0 2024-09-15T21:55:21.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.849+0000 7fb6d5ffb640 1 -- 172.21.15.1:0/1892401908 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb6dc01e460 con 0x7fb6e006d0d0 2024-09-15T21:55:21.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.849+0000 7fb6d5ffb640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb6c40678f0 0x7fb6c4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:21.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.849+0000 7fb6d5ffb640 1 -- 172.21.15.1:0/1892401908 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb6dc0862a0 con 0x7fb6e006d0d0 2024-09-15T21:55:21.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.849+0000 7fb6e4e38640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb6c40678f0 0x7fb6c4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:21.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.849+0000 7fb6e4e38640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb6c40678f0 0x7fb6c4069db0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00ad000 tx=0x7fb6d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:21.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:21.853+0000 7fb6d5ffb640 1 -- 172.21.15.1:0/1892401908 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb6dc056e70 con 0x7fb6e006d0d0 2024-09-15T21:55:22.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:22.049+0000 7fb6e789d640 1 -- 172.21.15.1:0/1892401908 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb6e00b5510 con 0x7fb6e006d0d0 2024-09-15T21:55:23.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.057+0000 7fb6d5ffb640 1 -- 172.21.15.1:0/1892401908 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fb6dc056770 con 0x7fb6e006d0d0 2024-09-15T21:55:23.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.057+0000 7fb6e789d640 1 -- 172.21.15.1:0/1892401908 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb6c40678f0 msgr2=0x7fb6c4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:23.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.057+0000 7fb6e789d640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb6c40678f0 0x7fb6c4069db0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00ad000 tx=0x7fb6d0008040 comp rx=0 tx=0).stop 2024-09-15T21:55:23.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.057+0000 7fb6e789d640 1 -- 172.21.15.1:0/1892401908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e006d0d0 msgr2=0x7fb6e01e15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:23.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.057+0000 7fb6e789d640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e006d0d0 0x7fb6e01e15f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00d830 tx=0x7fb6dc00dcf0 comp rx=0 tx=0).stop 2024-09-15T21:55:23.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.057+0000 7fb6e789d640 1 -- 172.21.15.1:0/1892401908 shutdown_connections 2024-09-15T21:55:23.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.057+0000 7fb6e789d640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb6e0149280 0x7fb6e0072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:23.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.057+0000 7fb6e789d640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb6c40678f0 0x7fb6c4069db0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:23.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.057+0000 7fb6e789d640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e00b4560 0x7fb6e0142b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:23.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.057+0000 7fb6e789d640 1 --2- 172.21.15.1:0/1892401908 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6e006d0d0 0x7fb6e01e15f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:23.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.057+0000 7fb6e789d640 1 -- 172.21.15.1:0/1892401908 >> 172.21.15.1:0/1892401908 conn(0x7fb6e006c730 msgr2=0x7fb6e009dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:23.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.061+0000 7fb6e789d640 1 -- 172.21.15.1:0/1892401908 shutdown_connections 2024-09-15T21:55:23.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.061+0000 7fb6e789d640 1 -- 172.21.15.1:0/1892401908 wait complete. 2024-09-15T21:55:23.083 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T21:55:23.083 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T21:55:23.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.205+0000 7efd97334640 1 Processor -- start 2024-09-15T21:55:23.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd97334640 1 -- start start 2024-09-15T21:55:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd97334640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd900b64d0 0x7efd90148210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd97334640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd900b74c0 con 0x7efd90141660 2024-09-15T21:55:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd97334640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd90147a50 con 0x7efd900b4df0 2024-09-15T21:55:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd97334640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7efd900b7730 con 0x7efd900b64d0 2024-09-15T21:55:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd958d1640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7efd90141660 0x7efd901522c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46048/0 (socket says 172.21.15.1:46048) 2024-09-15T21:55:23.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd958d1640 1 -- 172.21.15.1:0/3570456303 learned_addr learned my addr 172.21.15.1:0/3570456303 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd948cf640 1 --2- 172.21.15.1:0/3570456303 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd900b64d0 0x7efd90148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 819693420 0 0) 0x7efd900b74c0 con 0x7efd90141660 2024-09-15T21:55:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd7c003530 con 0x7efd90141660 2024-09-15T21:55:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1771718766 0 0) 0x7efd7c003530 con 0x7efd90141660 2024-09-15T21:55:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd900b64d0 msgr2=0x7efd90148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 --2- 172.21.15.1:0/3570456303 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd900b64d0 0x7efd90148210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 >> v1:172.21.15.70:6789/0 conn(0x7efd900b4df0 legacy=0x7efd900b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd90147cf0 con 0x7efd90141660 2024-09-15T21:55:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7efd88001a00 con 0x7efd90141660 2024-09-15T21:55:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 >> v1:172.21.15.1:6789/0 conn(0x7efd90141660 legacy=0x7efd901522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 --2- 172.21.15.1:0/3570456303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd7c0039f0 0x7efd7c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 --2- 172.21.15.1:0/3570456303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c004810 0x7efd7c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:23.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 --2- 172.21.15.1:0/3570456303 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd900b64d0 0x7efd7c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efd900b7730 con 0x7efd7c004810 2024-09-15T21:55:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c00bb30 con 0x7efd7c0039f0 2024-09-15T21:55:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7efd7c00bd30 con 0x7efd900b64d0 2024-09-15T21:55:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd948cf640 1 --2- 172.21.15.1:0/3570456303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c004810 0x7efd7c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd950d0640 1 --2- 172.21.15.1:0/3570456303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd7c0039f0 0x7efd7c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd958d1640 1 --2- 172.21.15.1:0/3570456303 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd900b64d0 0x7efd7c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd948cf640 1 -- 172.21.15.1:0/3570456303 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd900b64d0 msgr2=0x7efd7c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd948cf640 1 --2- 172.21.15.1:0/3570456303 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd900b64d0 0x7efd7c005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd948cf640 1 -- 172.21.15.1:0/3570456303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd7c0039f0 msgr2=0x7efd7c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd948cf640 1 --2- 172.21.15.1:0/3570456303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd7c0039f0 0x7efd7c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:23.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.209+0000 7efd948cf640 1 -- 172.21.15.1:0/3570456303 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c003530 con 0x7efd7c004810 2024-09-15T21:55:23.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd948cf640 1 --2- 172.21.15.1:0/3570456303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c004810 0x7efd7c004c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd900b6d40 tx=0x7efd8001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5faa7913e59bde server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80009690 con 0x7efd7c004810 2024-09-15T21:55:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd800a6490 con 0x7efd7c004810 2024-09-15T21:55:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd87fff640 1 -- 172.21.15.1:0/3570456303 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd800a6860 con 0x7efd7c004810 2024-09-15T21:55:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 -- 172.21.15.1:0/3570456303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c004810 msgr2=0x7efd7c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 --2- 172.21.15.1:0/3570456303 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd7c004810 0x7efd7c004c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd900b6d40 tx=0x7efd8001c9a0 comp rx=0 tx=0).stop 2024-09-15T21:55:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd958d1640 1 -- 172.21.15.1:0/3570456303 reap_dead start 2024-09-15T21:55:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 -- 172.21.15.1:0/3570456303 shutdown_connections 2024-09-15T21:55:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 -- 172.21.15.1:0/3570456303 >> 172.21.15.1:0/3570456303 conn(0x7efd900bd380 msgr2=0x7efd900bd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 -- 172.21.15.1:0/3570456303 shutdown_connections 2024-09-15T21:55:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 -- 172.21.15.1:0/3570456303 wait complete. 2024-09-15T21:55:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 Processor -- start 2024-09-15T21:55:23.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 -- start start 2024-09-15T21:55:23.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd901514d0 0x7efd901e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:23.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd90150af0 0x7efd901e0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:23.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd9014b090 0x7efd9014b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:23.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efd90153d70 con 0x7efd90150af0 2024-09-15T21:55:23.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd90153bf0 con 0x7efd9014b090 2024-09-15T21:55:23.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd97334640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7efd90153ef0 con 0x7efd901514d0 2024-09-15T21:55:23.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd948cf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd90150af0 0x7efd901e0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:23.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd948cf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd90150af0 0x7efd901e0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34502/0 (socket says 172.21.15.1:34502) 2024-09-15T21:55:23.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd948cf640 1 -- 172.21.15.1:0/358113527 learned_addr learned my addr 172.21.15.1:0/358113527 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:23.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd950d0640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd901514d0 0x7efd901e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:23.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd958d1640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd9014b090 0x7efd9014b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:23.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd948cf640 1 -- 172.21.15.1:0/358113527 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd901514d0 msgr2=0x7efd901e0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:23.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd948cf640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd901514d0 0x7efd901e0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:23.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd948cf640 1 -- 172.21.15.1:0/358113527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd9014b090 msgr2=0x7efd9014b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:23.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd948cf640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd9014b090 0x7efd9014b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:23.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd948cf640 1 -- 172.21.15.1:0/358113527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9014be50 con 0x7efd90150af0 2024-09-15T21:55:23.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.213+0000 7efd948cf640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd90150af0 0x7efd901e0960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd8001b0a0 tx=0x7efd80019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:23.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.217+0000 7efd85ffb640 1 -- 172.21.15.1:0/358113527 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd800a6d40 con 0x7efd90150af0 2024-09-15T21:55:23.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.217+0000 7efd85ffb640 1 -- 172.21.15.1:0/358113527 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd800a7470 con 0x7efd90150af0 2024-09-15T21:55:23.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.217+0000 7efd97334640 1 -- 172.21.15.1:0/358113527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9014ba50 con 0x7efd90150af0 2024-09-15T21:55:23.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.217+0000 7efd85ffb640 1 -- 172.21.15.1:0/358113527 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd800a7840 con 0x7efd90150af0 2024-09-15T21:55:23.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.217+0000 7efd97334640 1 -- 172.21.15.1:0/358113527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd90152ea0 con 0x7efd90150af0 2024-09-15T21:55:23.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.217+0000 7efd97334640 1 -- 172.21.15.1:0/358113527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd900b51d0 con 0x7efd90150af0 2024-09-15T21:55:23.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.217+0000 7efd85ffb640 1 -- 172.21.15.1:0/358113527 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efd800a79e0 con 0x7efd90150af0 2024-09-15T21:55:23.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.217+0000 7efd85ffb640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efd740678f0 0x7efd74069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:23.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.217+0000 7efd85ffb640 1 -- 172.21.15.1:0/358113527 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efd8011fde0 con 0x7efd90150af0 2024-09-15T21:55:23.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.217+0000 7efd950d0640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efd740678f0 0x7efd74069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:23.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.217+0000 7efd950d0640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efd740678f0 0x7efd74069db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efd90151b40 tx=0x7efd8c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:23.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.221+0000 7efd85ffb640 1 -- 172.21.15.1:0/358113527 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efd800ac020 con 0x7efd90150af0 2024-09-15T21:55:23.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:23.421+0000 7efd97334640 1 -- 172.21.15.1:0/358113527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7efd901408a0 con 0x7efd90150af0 2024-09-15T21:55:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.065+0000 7efd85ffb640 1 -- 172.21.15.1:0/358113527 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7efd80016700 con 0x7efd90150af0 2024-09-15T21:55:24.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.069+0000 7efd97334640 1 -- 172.21.15.1:0/358113527 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efd740678f0 msgr2=0x7efd74069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.069+0000 7efd97334640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efd740678f0 0x7efd74069db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efd90151b40 tx=0x7efd8c009040 comp rx=0 tx=0).stop 2024-09-15T21:55:24.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.069+0000 7efd97334640 1 -- 172.21.15.1:0/358113527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd90150af0 msgr2=0x7efd901e0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.069+0000 7efd97334640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd90150af0 0x7efd901e0960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd8001b0a0 tx=0x7efd80019790 comp rx=0 tx=0).stop 2024-09-15T21:55:24.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.069+0000 7efd97334640 1 -- 172.21.15.1:0/358113527 shutdown_connections 2024-09-15T21:55:24.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.069+0000 7efd97334640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efd740678f0 0x7efd74069db0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.069+0000 7efd97334640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd9014b090 0x7efd9014b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.069+0000 7efd97334640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd90150af0 0x7efd901e0960 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.069+0000 7efd97334640 1 --2- 172.21.15.1:0/358113527 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd901514d0 0x7efd901e0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.069+0000 7efd97334640 1 -- 172.21.15.1:0/358113527 >> 172.21.15.1:0/358113527 conn(0x7efd900bd380 msgr2=0x7efd90145ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:24.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.069+0000 7efd97334640 1 -- 172.21.15.1:0/358113527 shutdown_connections 2024-09-15T21:55:24.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.069+0000 7efd97334640 1 -- 172.21.15.1:0/358113527 wait complete. 2024-09-15T21:55:24.096 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T21:55:24.096 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:55:24.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb644b5640 1 Processor -- start 2024-09-15T21:55:24.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb644b5640 1 -- start start 2024-09-15T21:55:24.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb644b5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb5c0ae3a0 0x7fdb5c09eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb644b5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdb5c0b4c50 0x7fdb5c147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb644b5640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb5c0b00f0 con 0x7fdb5c0af160 2024-09-15T21:55:24.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb644b5640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fdb5c0afe10 con 0x7fdb5c0b4c50 2024-09-15T21:55:24.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb644b5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5c0b50e0 con 0x7fdb5c0ae3a0 2024-09-15T21:55:24.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb61a50640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdb5c0b4c50 0x7fdb5c147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb62a52640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fdb5c0af160 0x7fdb5c09aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46054/0 (socket says 172.21.15.1:46054) 2024-09-15T21:55:24.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb62a52640 1 -- 172.21.15.1:0/51563177 learned_addr learned my addr 172.21.15.1:0/51563177 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:24.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb62251640 1 --2- 172.21.15.1:0/51563177 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb5c0ae3a0 0x7fdb5c09eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb6124f640 1 -- 172.21.15.1:0/51563177 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231893477 0 0) 0x7fdb5c0b00f0 con 0x7fdb5c0af160 2024-09-15T21:55:24.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb6124f640 1 -- 172.21.15.1:0/51563177 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb48003530 con 0x7fdb5c0af160 2024-09-15T21:55:24.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb61a50640 1 -- 172.21.15.1:0/51563177 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb5c0ae3a0 msgr2=0x7fdb5c09eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:24.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb61a50640 1 --2- 172.21.15.1:0/51563177 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb5c0ae3a0 0x7fdb5c09eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb61a50640 1 -- 172.21.15.1:0/51563177 >> v1:172.21.15.1:6789/0 conn(0x7fdb5c0af160 legacy=0x7fdb5c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.217+0000 7fdb61a50640 1 -- 172.21.15.1:0/51563177 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c0b53c0 con 0x7fdb5c0b4c50 2024-09-15T21:55:24.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb61a50640 1 --2- 172.21.15.1:0/51563177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb5c0b4c50 0x7fdb5c147ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0097c0 tx=0x7fdb4c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c98ade965222793 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:24.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb6124f640 1 -- 172.21.15.1:0/51563177 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c0ab600 con 0x7fdb5c0b4c50 2024-09-15T21:55:24.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb6124f640 1 -- 172.21.15.1:0/51563177 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4c0b0070 con 0x7fdb5c0b4c50 2024-09-15T21:55:24.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb6124f640 1 -- 172.21.15.1:0/51563177 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c0ab9c0 con 0x7fdb5c0b4c50 2024-09-15T21:55:24.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 -- 172.21.15.1:0/51563177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb5c0b4c50 msgr2=0x7fdb5c147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 --2- 172.21.15.1:0/51563177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb5c0b4c50 0x7fdb5c147ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0097c0 tx=0x7fdb4c01c3e0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 -- 172.21.15.1:0/51563177 shutdown_connections 2024-09-15T21:55:24.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 --2- 172.21.15.1:0/51563177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb5c0b4c50 0x7fdb5c147ba0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 --2- 172.21.15.1:0/51563177 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb5c0ae3a0 0x7fdb5c09eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 -- 172.21.15.1:0/51563177 >> 172.21.15.1:0/51563177 conn(0x7fdb5c0b5c40 msgr2=0x7fdb5c0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:24.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 -- 172.21.15.1:0/51563177 shutdown_connections 2024-09-15T21:55:24.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 -- 172.21.15.1:0/51563177 wait complete. 2024-09-15T21:55:24.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 Processor -- start 2024-09-15T21:55:24.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 -- start start 2024-09-15T21:55:24.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb5c0ae3a0 0x7fdb5c0b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb5c0af160 0x7fdb5c071600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb5c071b40 0x7fdb5c0703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c150060 con 0x7fdb5c071b40 2024-09-15T21:55:24.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c14fee0 con 0x7fdb5c0af160 2024-09-15T21:55:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb644b5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5c1501e0 con 0x7fdb5c0ae3a0 2024-09-15T21:55:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb62a52640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb5c071b40 0x7fdb5c0703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb62a52640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb5c071b40 0x7fdb5c0703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34520/0 (socket says 172.21.15.1:34520) 2024-09-15T21:55:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb62a52640 1 -- 172.21.15.1:0/2503710988 learned_addr learned my addr 172.21.15.1:0/2503710988 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb61a50640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb5c0af160 0x7fdb5c071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.221+0000 7fdb62251640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb5c0ae3a0 0x7fdb5c0b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb62a52640 1 -- 172.21.15.1:0/2503710988 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb5c0ae3a0 msgr2=0x7fdb5c0b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb62a52640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb5c0ae3a0 0x7fdb5c0b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb62a52640 1 -- 172.21.15.1:0/2503710988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb5c0af160 msgr2=0x7fdb5c071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb62a52640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb5c0af160 0x7fdb5c071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb62a52640 1 -- 172.21.15.1:0/2503710988 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c072ec0 con 0x7fdb5c071b40 2024-09-15T21:55:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb61a50640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb5c0af160 0x7fdb5c071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:24.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb62a52640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb5c071b40 0x7fdb5c0703a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400cbe0 tx=0x7fdb5400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:24.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb52ffd640 1 -- 172.21.15.1:0/2503710988 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54017070 con 0x7fdb5c071b40 2024-09-15T21:55:24.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb52ffd640 1 -- 172.21.15.1:0/2503710988 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5400ad40 con 0x7fdb5c071b40 2024-09-15T21:55:24.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb644b5640 1 -- 172.21.15.1:0/2503710988 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5c072110 con 0x7fdb5c071b40 2024-09-15T21:55:24.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb52ffd640 1 -- 172.21.15.1:0/2503710988 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54012600 con 0x7fdb5c071b40 2024-09-15T21:55:24.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb644b5640 1 -- 172.21.15.1:0/2503710988 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb5c0708e0 con 0x7fdb5c071b40 2024-09-15T21:55:24.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb644b5640 1 -- 172.21.15.1:0/2503710988 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5c072450 con 0x7fdb5c071b40 2024-09-15T21:55:24.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb52ffd640 1 -- 172.21.15.1:0/2503710988 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdb5401a070 con 0x7fdb5c071b40 2024-09-15T21:55:24.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb52ffd640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdb400678c0 0x7fdb40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb52ffd640 1 -- 172.21.15.1:0/2503710988 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdb54085dd0 con 0x7fdb5c071b40 2024-09-15T21:55:24.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb62251640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdb400678c0 0x7fdb40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.225+0000 7fdb62251640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdb400678c0 0x7fdb40069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c145210 tx=0x7fdb58008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:24.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.237+0000 7fdb52ffd640 1 -- 172.21.15.1:0/2503710988 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdb5c072450 con 0x7fdb5c071b40 2024-09-15T21:55:24.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.429+0000 7fdb644b5640 1 -- 172.21.15.1:0/2503710988 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb5c147cf0 con 0x7fdb5c071b40 2024-09-15T21:55:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.429+0000 7fdb52ffd640 1 -- 172.21.15.1:0/2503710988 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3566 (secure 0 0 0) 0x7fdb54056330 con 0x7fdb5c071b40 2024-09-15T21:55:24.434 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:24.434 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-09-15T21:55:24:061270+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/2650682187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2650682187},{"type":"v1","addr":"172.21.15.70:6833","nonce":2650682187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:20.400358+0000","modified":"2024-09-15T21:55:23.425841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3288963990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3288963990},{"type":"v1","addr":"172.21.15.1:6835","nonce":3288963990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4245,"qdb_cluster":[4245]},"id":1}]} 2024-09-15T21:55:24.434 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-09-15T21:55:24.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.433+0000 7fdb644b5640 1 -- 172.21.15.1:0/2503710988 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdb400678c0 msgr2=0x7fdb40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.433+0000 7fdb644b5640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdb400678c0 0x7fdb40069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c145210 tx=0x7fdb58008040 comp rx=0 tx=0).stop 2024-09-15T21:55:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.433+0000 7fdb644b5640 1 -- 172.21.15.1:0/2503710988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb5c071b40 msgr2=0x7fdb5c0703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.433+0000 7fdb644b5640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb5c071b40 0x7fdb5c0703a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400cbe0 tx=0x7fdb5400a430 comp rx=0 tx=0).stop 2024-09-15T21:55:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.433+0000 7fdb644b5640 1 -- 172.21.15.1:0/2503710988 shutdown_connections 2024-09-15T21:55:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.433+0000 7fdb644b5640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdb5c071b40 0x7fdb5c0703a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.433+0000 7fdb644b5640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdb400678c0 0x7fdb40069d80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.433+0000 7fdb644b5640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb5c0af160 0x7fdb5c071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.433+0000 7fdb644b5640 1 --2- 172.21.15.1:0/2503710988 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb5c0ae3a0 0x7fdb5c0b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.433+0000 7fdb644b5640 1 -- 172.21.15.1:0/2503710988 >> 172.21.15.1:0/2503710988 conn(0x7fdb5c0b5c40 msgr2=0x7fdb5c09aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:24.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.433+0000 7fdb644b5640 1 -- 172.21.15.1:0/2503710988 shutdown_connections 2024-09-15T21:55:24.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.433+0000 7fdb644b5640 1 -- 172.21.15.1:0/2503710988 wait complete. 2024-09-15T21:55:24.452 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:24.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.569+0000 7f52b9ef4640 1 Processor -- start 2024-09-15T21:55:24.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.569+0000 7f52b9ef4640 1 -- start start 2024-09-15T21:55:24.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b9ef4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f52b40b5220 0x7f52b409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b9ef4640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52b4148f20 0x7f52b41493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b9ef4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52b409f520 con 0x7f52b40b5600 2024-09-15T21:55:24.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b9ef4640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f52b409b800 con 0x7f52b40b5220 2024-09-15T21:55:24.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b9ef4640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f52b40b4dd0 con 0x7f52b4148f20 2024-09-15T21:55:24.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b37fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f52b40b5220 0x7f52b409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b37fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f52b40b5220 0x7f52b409aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34536/0 (socket says 172.21.15.1:34536) 2024-09-15T21:55:24.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b37fe640 1 -- 172.21.15.1:0/3251594095 learned_addr learned my addr 172.21.15.1:0/3251594095 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:24.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b3fff640 1 --2- 172.21.15.1:0/3251594095 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52b4148f20 0x7f52b41493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b37fe640 1 -- 172.21.15.1:0/3251594095 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52b4148f20 msgr2=0x7f52b41493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:24.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b37fe640 1 --2- 172.21.15.1:0/3251594095 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52b4148f20 0x7f52b41493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b37fe640 1 -- 172.21.15.1:0/3251594095 >> v1:172.21.15.70:6789/0 conn(0x7f52b40b5600 legacy=0x7f52b409ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:24.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b37fe640 1 -- 172.21.15.1:0/3251594095 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b41498f0 con 0x7f52b40b5220 2024-09-15T21:55:24.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b37fe640 1 --2- 172.21.15.1:0/3251594095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52b40b5220 0x7f52b409aa50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009e50 tx=0x7f52a401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a82d751be1624e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:24.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b27fc640 1 -- 172.21.15.1:0/3251594095 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a40a5640 con 0x7f52b40b5220 2024-09-15T21:55:24.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b27fc640 1 -- 172.21.15.1:0/3251594095 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a40a57e0 con 0x7f52b40b5220 2024-09-15T21:55:24.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b27fc640 1 -- 172.21.15.1:0/3251594095 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a40a5bb0 con 0x7f52b40b5220 2024-09-15T21:55:24.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3251594095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52b40b5220 msgr2=0x7f52b409aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b9ef4640 1 --2- 172.21.15.1:0/3251594095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52b40b5220 0x7f52b409aa50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009e50 tx=0x7f52a401c8d0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3251594095 shutdown_connections 2024-09-15T21:55:24.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b9ef4640 1 --2- 172.21.15.1:0/3251594095 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52b4148f20 0x7f52b41493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b9ef4640 1 --2- 172.21.15.1:0/3251594095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52b40b5220 0x7f52b409aa50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3251594095 >> 172.21.15.1:0/3251594095 conn(0x7f52b40b5c40 msgr2=0x7f52b40b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:24.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3251594095 shutdown_connections 2024-09-15T21:55:24.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.573+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3251594095 wait complete. 2024-09-15T21:55:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b9ef4640 1 Processor -- start 2024-09-15T21:55:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b9ef4640 1 -- start start 2024-09-15T21:55:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b9ef4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52b40b5220 0x7f52b4072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b9ef4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52b40b5600 0x7f52b41e0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b9ef4640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52b4148f20 0x7f52b413d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b9ef4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4152880 con 0x7f52b40b5600 2024-09-15T21:55:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b9ef4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4152700 con 0x7f52b40b5220 2024-09-15T21:55:24.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b9ef4640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f52b4152a00 con 0x7f52b4148f20 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52b40b5600 0x7f52b41e0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52b40b5600 0x7f52b41e0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34542/0 (socket says 172.21.15.1:34542) 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b2ffd640 1 -- 172.21.15.1:0/3693953627 learned_addr learned my addr 172.21.15.1:0/3693953627 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b3fff640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52b4148f20 0x7f52b413d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b37fe640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52b40b5220 0x7f52b4072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b2ffd640 1 -- 172.21.15.1:0/3693953627 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52b4148f20 msgr2=0x7f52b413d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b2ffd640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52b4148f20 0x7f52b413d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b2ffd640 1 -- 172.21.15.1:0/3693953627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52b40b5220 msgr2=0x7f52b4072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b2ffd640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52b40b5220 0x7f52b4072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b2ffd640 1 -- 172.21.15.1:0/3693953627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b409b9b0 con 0x7f52b40b5600 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b2ffd640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52b40b5600 0x7f52b41e0060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f52a800c480 tx=0x7f52a800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f529bfff640 1 -- 172.21.15.1:0/3693953627 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8012830 con 0x7f52b40b5600 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f529bfff640 1 -- 172.21.15.1:0/3693953627 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a8017070 con 0x7f52b40b5600 2024-09-15T21:55:24.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3693953627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b4144b60 con 0x7f52b40b5600 2024-09-15T21:55:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3693953627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b4145cb0 con 0x7f52b40b5600 2024-09-15T21:55:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f529bfff640 1 -- 172.21.15.1:0/3693953627 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8012c30 con 0x7f52b40b5600 2024-09-15T21:55:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.577+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3693953627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52940052a0 con 0x7f52b40b5600 2024-09-15T21:55:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.581+0000 7f529bfff640 1 -- 172.21.15.1:0/3693953627 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f52a801c460 con 0x7f52b40b5600 2024-09-15T21:55:24.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.581+0000 7f529bfff640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f52a00678c0 0x7f52a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.581+0000 7f529bfff640 1 -- 172.21.15.1:0/3693953627 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f52a80859e0 con 0x7f52b40b5600 2024-09-15T21:55:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.581+0000 7f52b37fe640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f52a00678c0 0x7f52a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.581+0000 7f52b37fe640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f52a00678c0 0x7f52a0069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f52a40ae000 tx=0x7f52a40a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:24.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.585+0000 7f529bfff640 1 -- 172.21.15.1:0/3693953627 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f52a80565b0 con 0x7f52b40b5600 2024-09-15T21:55:24.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.741+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3693953627 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5294005860 con 0x7f52b40b5600 2024-09-15T21:55:24.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.745+0000 7f529bfff640 1 -- 172.21.15.1:0/3693953627 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16593 (secure 0 0 0) 0x7f52a8055eb0 con 0x7f52b40b5600 2024-09-15T21:55:24.749 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:24.749 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:22.028149+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:18.271646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:19.444906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:24.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.745+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3693953627 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f52a00678c0 msgr2=0x7f52a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.745+0000 7f52b9ef4640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f52a00678c0 0x7f52a0069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f52a40ae000 tx=0x7f52a40a7070 comp rx=0 tx=0).stop 2024-09-15T21:55:24.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.745+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3693953627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52b40b5600 msgr2=0x7f52b41e0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.745+0000 7f52b9ef4640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52b40b5600 0x7f52b41e0060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f52a800c480 tx=0x7f52a800c940 comp rx=0 tx=0).stop 2024-09-15T21:55:24.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.745+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3693953627 shutdown_connections 2024-09-15T21:55:24.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.745+0000 7f52b9ef4640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52b4148f20 0x7f52b413d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.745+0000 7f52b9ef4640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52b40b5600 0x7f52b41e0060 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.745+0000 7f52b9ef4640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f52a00678c0 0x7f52a0069d80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.745+0000 7f52b9ef4640 1 --2- 172.21.15.1:0/3693953627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52b40b5220 0x7f52b4072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.745+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3693953627 >> 172.21.15.1:0/3693953627 conn(0x7f52b40b5c40 msgr2=0x7f52b40b7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:24.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.745+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3693953627 shutdown_connections 2024-09-15T21:55:24.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.745+0000 7f52b9ef4640 1 -- 172.21.15.1:0/3693953627 wait complete. 2024-09-15T21:55:24.768 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T21:55:24.768 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:55:24.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.885+0000 7f3dd06f6640 1 Processor -- start 2024-09-15T21:55:24.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.885+0000 7f3dd06f6640 1 -- start start 2024-09-15T21:55:24.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dd06f6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3dc80b5220 0x7f3dc809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dd06f6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3dc80b5600 0x7f3dc809ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dd06f6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dc80b6a50 con 0x7f3dc8148f20 2024-09-15T21:55:24.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dd06f6640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f3dc809b800 con 0x7f3dc80b5220 2024-09-15T21:55:24.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dd06f6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc80b4dd0 con 0x7f3dc80b5600 2024-09-15T21:55:24.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dce492640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3dc80b5220 0x7f3dc809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dce492640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3dc80b5220 0x7f3dc809aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34550/0 (socket says 172.21.15.1:34550) 2024-09-15T21:55:24.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dce492640 1 -- 172.21.15.1:0/3284584442 learned_addr learned my addr 172.21.15.1:0/3284584442 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:24.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dcdc91640 1 --2- 172.21.15.1:0/3284584442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3dc80b5600 0x7f3dc809ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dce492640 1 -- 172.21.15.1:0/3284584442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3dc80b5600 msgr2=0x7f3dc809ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:24.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dce492640 1 --2- 172.21.15.1:0/3284584442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3dc80b5600 0x7f3dc809ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dce492640 1 -- 172.21.15.1:0/3284584442 >> v1:172.21.15.70:6789/0 conn(0x7f3dc8148f20 legacy=0x7f3dc81493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dce492640 1 -- 172.21.15.1:0/3284584442 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc809af90 con 0x7f3dc80b5220 2024-09-15T21:55:24.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dcdc91640 1 --2- 172.21.15.1:0/3284584442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3dc80b5600 0x7f3dc809ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:24.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dce492640 1 --2- 172.21.15.1:0/3284584442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc80b5220 0x7f3dc809aa50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009870 tx=0x7f3dc401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef672e5f00a4014 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:24.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dcd490640 1 -- 172.21.15.1:0/3284584442 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc40ab610 con 0x7f3dc80b5220 2024-09-15T21:55:24.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dcd490640 1 -- 172.21.15.1:0/3284584442 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc40b0070 con 0x7f3dc80b5220 2024-09-15T21:55:24.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dcd490640 1 -- 172.21.15.1:0/3284584442 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc40ab9d0 con 0x7f3dc80b5220 2024-09-15T21:55:24.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dd06f6640 1 -- 172.21.15.1:0/3284584442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc80b5220 msgr2=0x7f3dc809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dd06f6640 1 --2- 172.21.15.1:0/3284584442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc80b5220 0x7f3dc809aa50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009870 tx=0x7f3dc401c410 comp rx=0 tx=0).stop 2024-09-15T21:55:24.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dd06f6640 1 -- 172.21.15.1:0/3284584442 shutdown_connections 2024-09-15T21:55:24.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dd06f6640 1 --2- 172.21.15.1:0/3284584442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3dc80b5600 0x7f3dc809ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dd06f6640 1 --2- 172.21.15.1:0/3284584442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc80b5220 0x7f3dc809aa50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.889+0000 7f3dd06f6640 1 -- 172.21.15.1:0/3284584442 >> 172.21.15.1:0/3284584442 conn(0x7f3dc80b5c40 msgr2=0x7f3dc80b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:24.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dd06f6640 1 -- 172.21.15.1:0/3284584442 shutdown_connections 2024-09-15T21:55:24.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dd06f6640 1 -- 172.21.15.1:0/3284584442 wait complete. 2024-09-15T21:55:24.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dd06f6640 1 Processor -- start 2024-09-15T21:55:24.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dd06f6640 1 -- start start 2024-09-15T21:55:24.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dd06f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3dc80b5220 0x7f3dc8147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dd06f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc80b5600 0x7f3dc81e00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dd06f6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3dc8148f20 0x7f3dc813e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dd06f6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc8152700 con 0x7f3dc80b5600 2024-09-15T21:55:24.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dd06f6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc8152880 con 0x7f3dc80b5220 2024-09-15T21:55:24.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dd06f6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc8152a00 con 0x7f3dc8148f20 2024-09-15T21:55:24.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dcdc91640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc80b5600 0x7f3dc81e00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dcdc91640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc80b5600 0x7f3dc81e00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34556/0 (socket says 172.21.15.1:34556) 2024-09-15T21:55:24.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dcdc91640 1 -- 172.21.15.1:0/660109560 learned_addr learned my addr 172.21.15.1:0/660109560 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:24.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dce492640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3dc80b5220 0x7f3dc8147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dcec93640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3dc8148f20 0x7f3dc813e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dcdc91640 1 -- 172.21.15.1:0/660109560 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3dc8148f20 msgr2=0x7f3dc813e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dcdc91640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3dc8148f20 0x7f3dc813e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dcdc91640 1 -- 172.21.15.1:0/660109560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3dc80b5220 msgr2=0x7f3dc8147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:24.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dcdc91640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3dc80b5220 0x7f3dc8147a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:24.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dcdc91640 1 -- 172.21.15.1:0/660109560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc813cb60 con 0x7f3dc80b5600 2024-09-15T21:55:24.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dcec93640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3dc8148f20 0x7f3dc813e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:24.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dce492640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3dc80b5220 0x7f3dc8147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:24.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dcdc91640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc80b5600 0x7f3dc81e00f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00cf60 tx=0x7f3dbc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:24.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dbaffd640 1 -- 172.21.15.1:0/660109560 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc01a070 con 0x7f3dc80b5600 2024-09-15T21:55:24.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dbaffd640 1 -- 172.21.15.1:0/660109560 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dbc00d840 con 0x7f3dc80b5600 2024-09-15T21:55:24.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dd06f6640 1 -- 172.21.15.1:0/660109560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc80af9d0 con 0x7f3dc80b5600 2024-09-15T21:55:24.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dbaffd640 1 -- 172.21.15.1:0/660109560 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc00dc10 con 0x7f3dc80b5600 2024-09-15T21:55:24.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dd06f6640 1 -- 172.21.15.1:0/660109560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc80aeef0 con 0x7f3dc80b5600 2024-09-15T21:55:24.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.893+0000 7f3dd06f6640 1 -- 172.21.15.1:0/660109560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc80aeb90 con 0x7f3dc80b5600 2024-09-15T21:55:24.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.897+0000 7f3dbaffd640 1 -- 172.21.15.1:0/660109560 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3dbc01d070 con 0x7f3dc80b5600 2024-09-15T21:55:24.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.897+0000 7f3dbaffd640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3dac0678c0 0x7f3dac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:24.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.897+0000 7f3dbaffd640 1 -- 172.21.15.1:0/660109560 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3dbc086370 con 0x7f3dc80b5600 2024-09-15T21:55:24.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.897+0000 7f3dce492640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3dac0678c0 0x7f3dac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:24.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.897+0000 7f3dce492640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3dac0678c0 0x7f3dac069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40af000 tx=0x7f3dc40a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:24.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:24.901+0000 7f3dbaffd640 1 -- 172.21.15.1:0/660109560 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3dbc0568f0 con 0x7f3dc80b5600 2024-09-15T21:55:24.994 INFO:tasks.ceph.mds.a.smithi001.stderr:2024-09-15T21:55:24.989+0000 7f1a11406640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T21:55:25.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.061+0000 7f3dd06f6640 1 -- 172.21.15.1:0/660109560 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3dc809aa50 con 0x7f3dac0678c0 2024-09-15T21:55:25.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.077+0000 7f3dbaffd640 1 -- 172.21.15.1:0/660109560 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244122 (secure 0 0 0) 0x7f3dc809aa50 con 0x7f3dac0678c0 2024-09-15T21:55:25.081 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:25.084 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:55:25.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.077+0000 7f3dd06f6640 1 -- 172.21.15.1:0/660109560 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3dac0678c0 msgr2=0x7f3dac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.077+0000 7f3dd06f6640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3dac0678c0 0x7f3dac069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40af000 tx=0x7f3dc40a7000 comp rx=0 tx=0).stop 2024-09-15T21:55:25.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.077+0000 7f3dd06f6640 1 -- 172.21.15.1:0/660109560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc80b5600 msgr2=0x7f3dc81e00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.077+0000 7f3dd06f6640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc80b5600 0x7f3dc81e00f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00cf60 tx=0x7f3dbc00cf90 comp rx=0 tx=0).stop 2024-09-15T21:55:25.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.081+0000 7f3dd06f6640 1 -- 172.21.15.1:0/660109560 shutdown_connections 2024-09-15T21:55:25.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.081+0000 7f3dd06f6640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3dc8148f20 0x7f3dc813e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.081+0000 7f3dd06f6640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dc80b5600 0x7f3dc81e00f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.081+0000 7f3dd06f6640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3dac0678c0 0x7f3dac069d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.081+0000 7f3dd06f6640 1 --2- 172.21.15.1:0/660109560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3dc80b5220 0x7f3dc8147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.081+0000 7f3dd06f6640 1 -- 172.21.15.1:0/660109560 >> 172.21.15.1:0/660109560 conn(0x7f3dc80b5c40 msgr2=0x7f3dc8074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:25.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.081+0000 7f3dd06f6640 1 -- 172.21.15.1:0/660109560 shutdown_connections 2024-09-15T21:55:25.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.081+0000 7f3dd06f6640 1 -- 172.21.15.1:0/660109560 wait complete. 2024-09-15T21:55:25.101 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-15T21:55:23.064084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":148,"acting":148,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":256268,"kb_used_data":2480,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754718452,"statfs":{"total":773094113280,"available":772831694848,"internally_reserved":0,"allocated":2539520,"data_stored":1596278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.047501"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:20.015969+0000","last_change":"2024-09-15T21:55:20.015969+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.015969+0000","last_undegraded":"2024-09-15T21:55:20.015969+0000","last_fullsized":"2024-09-15T21:55:20.015969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.037857+0000","last_change":"2024-09-15T21:55:20.037857+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.037857+0000","last_undegraded":"2024-09-15T21:55:20.037857+0000","last_fullsized":"2024-09-15T21:55:20.037857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045680+0000","last_change":"2024-09-15T21:55:20.045680+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045680+0000","last_undegraded":"2024-09-15T21:55:20.045680+0000","last_fullsized":"2024-09-15T21:55:20.045680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.041645+0000","last_change":"2024-09-15T21:55:20.041645+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.041645+0000","last_undegraded":"2024-09-15T21:55:20.041645+0000","last_fullsized":"2024-09-15T21:55:20.041645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:20.015969+0000","last_change":"2024-09-15T21:55:20.015969+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.015969+0000","last_undegraded":"2024-09-15T21:55:20.015969+0000","last_fullsized":"2024-09-15T21:55:20.015969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.048263+0000","last_change":"2024-09-15T21:55:20.048263+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.048263+0000","last_undegraded":"2024-09-15T21:55:20.048263+0000","last_fullsized":"2024-09-15T21:55:20.048263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:20.015969+0000","last_change":"2024-09-15T21:55:20.015969+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.015969+0000","last_undegraded":"2024-09-15T21:55:20.015969+0000","last_fullsized":"2024-09-15T21:55:20.015969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.049532+0000","last_change":"2024-09-15T21:55:20.049532+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.049532+0000","last_undegraded":"2024-09-15T21:55:20.049532+0000","last_fullsized":"2024-09-15T21:55:20.049532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:20.015969+0000","last_change":"2024-09-15T21:55:20.015969+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.015969+0000","last_undegraded":"2024-09-15T21:55:20.015969+0000","last_fullsized":"2024-09-15T21:55:20.015969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036035+0000","last_change":"2024-09-15T21:55:20.036035+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036035+0000","last_undegraded":"2024-09-15T21:55:20.036035+0000","last_fullsized":"2024-09-15T21:55:20.036035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033278+0000","last_change":"2024-09-15T21:55:20.033278+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033278+0000","last_undegraded":"2024-09-15T21:55:20.033278+0000","last_fullsized":"2024-09-15T21:55:20.033278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.037108+0000","last_change":"2024-09-15T21:55:20.037108+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.037108+0000","last_undegraded":"2024-09-15T21:55:20.037108+0000","last_fullsized":"2024-09-15T21:55:20.037108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.041091+0000","last_change":"2024-09-15T21:55:20.041091+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.041091+0000","last_undegraded":"2024-09-15T21:55:20.041091+0000","last_fullsized":"2024-09-15T21:55:20.041091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045050+0000","last_change":"2024-09-15T21:55:20.045050+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045050+0000","last_undegraded":"2024-09-15T21:55:20.045050+0000","last_fullsized":"2024-09-15T21:55:20.045050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038764+0000","last_change":"2024-09-15T21:55:20.038764+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038764+0000","last_undegraded":"2024-09-15T21:55:20.038764+0000","last_fullsized":"2024-09-15T21:55:20.038764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045788+0000","last_change":"2024-09-15T21:55:20.045788+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045788+0000","last_undegraded":"2024-09-15T21:55:20.045788+0000","last_fullsized":"2024-09-15T21:55:20.045788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044531+0000","last_change":"2024-09-15T21:55:20.044531+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044531+0000","last_undegraded":"2024-09-15T21:55:20.044531+0000","last_fullsized":"2024-09-15T21:55:20.044531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:20.015969+0000","last_change":"2024-09-15T21:55:20.015969+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.015969+0000","last_undegraded":"2024-09-15T21:55:20.015969+0000","last_fullsized":"2024-09-15T21:55:20.015969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:20.015969+0000","last_change":"2024-09-15T21:55:20.015969+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.015969+0000","last_undegraded":"2024-09-15T21:55:20.015969+0000","last_fullsized":"2024-09-15T21:55:20.015969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033749+0000","last_change":"2024-09-15T21:55:20.033749+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033749+0000","last_undegraded":"2024-09-15T21:55:20.033749+0000","last_fullsized":"2024-09-15T21:55:20.033749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.047119+0000","last_change":"2024-09-15T21:55:20.047119+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.047119+0000","last_undegraded":"2024-09-15T21:55:20.047119+0000","last_fullsized":"2024-09-15T21:55:20.047119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.046658+0000","last_change":"2024-09-15T21:55:20.046658+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.046658+0000","last_undegraded":"2024-09-15T21:55:20.046658+0000","last_fullsized":"2024-09-15T21:55:20.046658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040720+0000","last_change":"2024-09-15T21:55:20.040720+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040720+0000","last_undegraded":"2024-09-15T21:55:20.040720+0000","last_fullsized":"2024-09-15T21:55:20.040720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.042262+0000","last_change":"2024-09-15T21:55:20.042262+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.042262+0000","last_undegraded":"2024-09-15T21:55:20.042262+0000","last_fullsized":"2024-09-15T21:55:20.042262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038892+0000","last_change":"2024-09-15T21:55:20.038892+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038892+0000","last_undegraded":"2024-09-15T21:55:20.038892+0000","last_fullsized":"2024-09-15T21:55:20.038892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033476+0000","last_change":"2024-09-15T21:55:20.033476+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033476+0000","last_undegraded":"2024-09-15T21:55:20.033476+0000","last_fullsized":"2024-09-15T21:55:20.033476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038591+0000","last_change":"2024-09-15T21:55:20.038591+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038591+0000","last_undegraded":"2024-09-15T21:55:20.038591+0000","last_fullsized":"2024-09-15T21:55:20.038591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.041805+0000","last_change":"2024-09-15T21:55:20.041805+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.041805+0000","last_undegraded":"2024-09-15T21:55:20.041805+0000","last_fullsized":"2024-09-15T21:55:20.041805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040398+0000","last_change":"2024-09-15T21:55:20.040398+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040398+0000","last_undegraded":"2024-09-15T21:55:20.040398+0000","last_fullsized":"2024-09-15T21:55:20.040398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044672+0000","last_change":"2024-09-15T21:55:20.044672+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044672+0000","last_undegraded":"2024-09-15T21:55:20.044672+0000","last_fullsized":"2024-09-15T21:55:20.044672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:20.015969+0000","last_change":"2024-09-15T21:55:20.015969+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.015969+0000","last_undegraded":"2024-09-15T21:55:20.015969+0000","last_fullsized":"2024-09-15T21:55:20.015969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035371+0000","last_change":"2024-09-15T21:55:20.035371+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035371+0000","last_undegraded":"2024-09-15T21:55:20.035371+0000","last_fullsized":"2024-09-15T21:55:20.035371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036019+0000","last_change":"2024-09-15T21:55:20.036019+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036019+0000","last_undegraded":"2024-09-15T21:55:20.036019+0000","last_fullsized":"2024-09-15T21:55:20.036019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.067335+0000","last_change":"2024-09-15T21:55:20.066836+0000","last_active":"2024-09-15T21:55:20.067335+0000","last_peered":"2024-09-15T21:55:20.067335+0000","last_clean":"2024-09-15T21:55:20.067335+0000","last_became_active":"2024-09-15T21:55:20.066434+0000","last_became_peered":"2024-09-15T21:55:20.066434+0000","last_unstale":"2024-09-15T21:55:20.067335+0000","last_undegraded":"2024-09-15T21:55:20.067335+0000","last_fullsized":"2024-09-15T21:55:20.067335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036377+0000","last_change":"2024-09-15T21:55:20.036377+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036377+0000","last_undegraded":"2024-09-15T21:55:20.036377+0000","last_fullsized":"2024-09-15T21:55:20.036377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.056086+0000","last_change":"2024-09-15T21:55:20.049677+0000","last_active":"2024-09-15T21:55:20.056086+0000","last_peered":"2024-09-15T21:55:20.056086+0000","last_clean":"2024-09-15T21:55:20.056086+0000","last_became_active":"2024-09-15T21:55:20.046329+0000","last_became_peered":"2024-09-15T21:55:20.046329+0000","last_unstale":"2024-09-15T21:55:20.056086+0000","last_undegraded":"2024-09-15T21:55:20.056086+0000","last_fullsized":"2024-09-15T21:55:20.056086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.063529+0000","last_change":"2024-09-15T21:55:20.056808+0000","last_active":"2024-09-15T21:55:20.063529+0000","last_peered":"2024-09-15T21:55:20.063529+0000","last_clean":"2024-09-15T21:55:20.063529+0000","last_became_active":"2024-09-15T21:55:20.055774+0000","last_became_peered":"2024-09-15T21:55:20.055774+0000","last_unstale":"2024-09-15T21:55:20.063529+0000","last_undegraded":"2024-09-15T21:55:20.063529+0000","last_fullsized":"2024-09-15T21:55:20.063529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040547+0000","last_change":"2024-09-15T21:55:20.040547+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040547+0000","last_undegraded":"2024-09-15T21:55:20.040547+0000","last_fullsized":"2024-09-15T21:55:20.040547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.056445+0000","last_change":"2024-09-15T21:55:20.052880+0000","last_active":"2024-09-15T21:55:20.056445+0000","last_peered":"2024-09-15T21:55:20.056445+0000","last_clean":"2024-09-15T21:55:20.056445+0000","last_became_active":"2024-09-15T21:55:20.052076+0000","last_became_peered":"2024-09-15T21:55:20.052076+0000","last_unstale":"2024-09-15T21:55:20.056445+0000","last_undegraded":"2024-09-15T21:55:20.056445+0000","last_fullsized":"2024-09-15T21:55:20.056445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045423+0000","last_change":"2024-09-15T21:55:20.045423+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045423+0000","last_undegraded":"2024-09-15T21:55:20.045423+0000","last_fullsized":"2024-09-15T21:55:20.045423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.057146+0000","last_change":"2024-09-15T21:55:20.054769+0000","last_active":"2024-09-15T21:55:20.057146+0000","last_peered":"2024-09-15T21:55:20.057146+0000","last_clean":"2024-09-15T21:55:20.057146+0000","last_became_active":"2024-09-15T21:55:20.053983+0000","last_became_peered":"2024-09-15T21:55:20.053983+0000","last_unstale":"2024-09-15T21:55:20.057146+0000","last_undegraded":"2024-09-15T21:55:20.057146+0000","last_fullsized":"2024-09-15T21:55:20.057146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045646+0000","last_change":"2024-09-15T21:55:20.045646+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045646+0000","last_undegraded":"2024-09-15T21:55:20.045646+0000","last_fullsized":"2024-09-15T21:55:20.045646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058304+0000","last_change":"2024-09-15T21:55:20.055173+0000","last_active":"2024-09-15T21:55:20.058304+0000","last_peered":"2024-09-15T21:55:20.058304+0000","last_clean":"2024-09-15T21:55:20.058304+0000","last_became_active":"2024-09-15T21:55:20.054689+0000","last_became_peered":"2024-09-15T21:55:20.054689+0000","last_unstale":"2024-09-15T21:55:20.058304+0000","last_undegraded":"2024-09-15T21:55:20.058304+0000","last_fullsized":"2024-09-15T21:55:20.058304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040720+0000","last_change":"2024-09-15T21:55:20.040720+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040720+0000","last_undegraded":"2024-09-15T21:55:20.040720+0000","last_fullsized":"2024-09-15T21:55:20.040720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058047+0000","last_change":"2024-09-15T21:55:20.054045+0000","last_active":"2024-09-15T21:55:20.058047+0000","last_peered":"2024-09-15T21:55:20.058047+0000","last_clean":"2024-09-15T21:55:20.058047+0000","last_became_active":"2024-09-15T21:55:20.053600+0000","last_became_peered":"2024-09-15T21:55:20.053600+0000","last_unstale":"2024-09-15T21:55:20.058047+0000","last_undegraded":"2024-09-15T21:55:20.058047+0000","last_fullsized":"2024-09-15T21:55:20.058047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035990+0000","last_change":"2024-09-15T21:55:20.035990+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035990+0000","last_undegraded":"2024-09-15T21:55:20.035990+0000","last_fullsized":"2024-09-15T21:55:20.035990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.057003+0000","last_change":"2024-09-15T21:55:20.053664+0000","last_active":"2024-09-15T21:55:20.057003+0000","last_peered":"2024-09-15T21:55:20.057003+0000","last_clean":"2024-09-15T21:55:20.057003+0000","last_became_active":"2024-09-15T21:55:20.051430+0000","last_became_peered":"2024-09-15T21:55:20.051430+0000","last_unstale":"2024-09-15T21:55:20.057003+0000","last_undegraded":"2024-09-15T21:55:20.057003+0000","last_fullsized":"2024-09-15T21:55:20.057003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:20.015969+0000","last_change":"2024-09-15T21:55:20.015969+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.015969+0000","last_undegraded":"2024-09-15T21:55:20.015969+0000","last_fullsized":"2024-09-15T21:55:20.015969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.054999+0000","last_change":"2024-09-15T21:55:20.050298+0000","last_active":"2024-09-15T21:55:20.054999+0000","last_peered":"2024-09-15T21:55:20.054999+0000","last_clean":"2024-09-15T21:55:20.054999+0000","last_became_active":"2024-09-15T21:55:20.049086+0000","last_became_peered":"2024-09-15T21:55:20.049086+0000","last_unstale":"2024-09-15T21:55:20.054999+0000","last_undegraded":"2024-09-15T21:55:20.054999+0000","last_fullsized":"2024-09-15T21:55:20.054999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034751+0000","last_change":"2024-09-15T21:55:20.034751+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034751+0000","last_undegraded":"2024-09-15T21:55:20.034751+0000","last_fullsized":"2024-09-15T21:55:20.034751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.070744+0000","last_change":"2024-09-15T21:55:20.067348+0000","last_active":"2024-09-15T21:55:20.070744+0000","last_peered":"2024-09-15T21:55:20.070744+0000","last_clean":"2024-09-15T21:55:20.070744+0000","last_became_active":"2024-09-15T21:55:20.066912+0000","last_became_peered":"2024-09-15T21:55:20.066912+0000","last_unstale":"2024-09-15T21:55:20.070744+0000","last_undegraded":"2024-09-15T21:55:20.070744+0000","last_fullsized":"2024-09-15T21:55:20.070744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:20.015969+0000","last_change":"2024-09-15T21:55:20.015969+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.015969+0000","last_undegraded":"2024-09-15T21:55:20.015969+0000","last_fullsized":"2024-09-15T21:55:20.015969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.056104+0000","last_change":"2024-09-15T21:55:20.046741+0000","last_active":"2024-09-15T21:55:20.056104+0000","last_peered":"2024-09-15T21:55:20.056104+0000","last_clean":"2024-09-15T21:55:20.056104+0000","last_became_active":"2024-09-15T21:55:20.044504+0000","last_became_peered":"2024-09-15T21:55:20.044504+0000","last_unstale":"2024-09-15T21:55:20.056104+0000","last_undegraded":"2024-09-15T21:55:20.056104+0000","last_fullsized":"2024-09-15T21:55:20.056104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033086+0000","last_change":"2024-09-15T21:55:20.033086+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033086+0000","last_undegraded":"2024-09-15T21:55:20.033086+0000","last_fullsized":"2024-09-15T21:55:20.033086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:19.005505+0000","last_change":"2024-09-15T21:55:19.005505+0000","last_active":"2024-09-15T21:55:19.005505+0000","last_peered":"2024-09-15T21:55:19.005505+0000","last_clean":"2024-09-15T21:55:19.005505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:19.005505+0000","last_undegraded":"2024-09-15T21:55:19.005505+0000","last_fullsized":"2024-09-15T21:55:19.005505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:20.015969+0000","last_change":"2024-09-15T21:55:20.015969+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.015969+0000","last_undegraded":"2024-09-15T21:55:20.015969+0000","last_fullsized":"2024-09-15T21:55:20.015969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.064056+0000","last_change":"2024-09-15T21:55:20.060882+0000","last_active":"2024-09-15T21:55:20.064056+0000","last_peered":"2024-09-15T21:55:20.064056+0000","last_clean":"2024-09-15T21:55:20.064056+0000","last_became_active":"2024-09-15T21:55:20.059856+0000","last_became_peered":"2024-09-15T21:55:20.059856+0000","last_unstale":"2024-09-15T21:55:20.064056+0000","last_undegraded":"2024-09-15T21:55:20.064056+0000","last_fullsized":"2024-09-15T21:55:20.064056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:20.015969+0000","last_change":"2024-09-15T21:55:20.015969+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.015969+0000","last_undegraded":"2024-09-15T21:55:20.015969+0000","last_fullsized":"2024-09-15T21:55:20.015969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:19.005505+0000","last_change":"2024-09-15T21:55:19.005505+0000","last_active":"2024-09-15T21:55:19.005505+0000","last_peered":"2024-09-15T21:55:19.005505+0000","last_clean":"2024-09-15T21:55:19.005505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:19.005505+0000","last_undegraded":"2024-09-15T21:55:19.005505+0000","last_fullsized":"2024-09-15T21:55:19.005505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:20.015969+0000","last_change":"2024-09-15T21:55:20.015969+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.015969+0000","last_undegraded":"2024-09-15T21:55:20.015969+0000","last_fullsized":"2024-09-15T21:55:20.015969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.051966+0000","last_change":"2024-09-15T21:55:20.049155+0000","last_active":"2024-09-15T21:55:20.051966+0000","last_peered":"2024-09-15T21:55:20.051966+0000","last_clean":"2024-09-15T21:55:20.051966+0000","last_became_active":"2024-09-15T21:55:20.048758+0000","last_became_peered":"2024-09-15T21:55:20.048758+0000","last_unstale":"2024-09-15T21:55:20.051966+0000","last_undegraded":"2024-09-15T21:55:20.051966+0000","last_fullsized":"2024-09-15T21:55:20.051966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.039420+0000","last_change":"2024-09-15T21:55:20.039420+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.039420+0000","last_undegraded":"2024-09-15T21:55:20.039420+0000","last_fullsized":"2024-09-15T21:55:20.039420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:19.005505+0000","last_change":"2024-09-15T21:55:19.005505+0000","last_active":"2024-09-15T21:55:19.005505+0000","last_peered":"2024-09-15T21:55:19.005505+0000","last_clean":"2024-09-15T21:55:19.005505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:19.005505+0000","last_undegraded":"2024-09-15T21:55:19.005505+0000","last_fullsized":"2024-09-15T21:55:19.005505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:20.015969+0000","last_change":"2024-09-15T21:55:20.015969+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.015969+0000","last_undegraded":"2024-09-15T21:55:20.015969+0000","last_fullsized":"2024-09-15T21:55:20.015969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T21:55:12.412657+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:12.412657+0000","last_peered":"2024-09-15T21:55:12.412657+0000","last_clean":"2024-09-15T21:55:12.412657+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:12.412657+0000","last_undegraded":"2024-09-15T21:55:12.412657+0000","last_fullsized":"2024-09-15T21:55:12.412657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.063634+0000","last_change":"2024-09-15T21:55:20.062164+0000","last_active":"2024-09-15T21:55:20.063634+0000","last_peered":"2024-09-15T21:55:20.063634+0000","last_clean":"2024-09-15T21:55:20.063634+0000","last_became_active":"2024-09-15T21:55:20.061451+0000","last_became_peered":"2024-09-15T21:55:20.061451+0000","last_unstale":"2024-09-15T21:55:20.063634+0000","last_undegraded":"2024-09-15T21:55:20.063634+0000","last_fullsized":"2024-09-15T21:55:20.063634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035398+0000","last_change":"2024-09-15T21:55:20.035398+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035398+0000","last_undegraded":"2024-09-15T21:55:20.035398+0000","last_fullsized":"2024-09-15T21:55:20.035398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:19.005505+0000","last_change":"2024-09-15T21:55:19.005505+0000","last_active":"2024-09-15T21:55:19.005505+0000","last_peered":"2024-09-15T21:55:19.005505+0000","last_clean":"2024-09-15T21:55:19.005505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:19.005505+0000","last_undegraded":"2024-09-15T21:55:19.005505+0000","last_fullsized":"2024-09-15T21:55:19.005505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035193+0000","last_change":"2024-09-15T21:55:20.035193+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035193+0000","last_undegraded":"2024-09-15T21:55:20.035193+0000","last_fullsized":"2024-09-15T21:55:20.035193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:19.005505+0000","last_change":"2024-09-15T21:55:19.005505+0000","last_active":"2024-09-15T21:55:19.005505+0000","last_peered":"2024-09-15T21:55:19.005505+0000","last_clean":"2024-09-15T21:55:19.005505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:19.005505+0000","last_undegraded":"2024-09-15T21:55:19.005505+0000","last_fullsized":"2024-09-15T21:55:19.005505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035772+0000","last_change":"2024-09-15T21:55:20.035772+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035772+0000","last_undegraded":"2024-09-15T21:55:20.035772+0000","last_fullsized":"2024-09-15T21:55:20.035772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058366+0000","last_change":"2024-09-15T21:55:20.053996+0000","last_active":"2024-09-15T21:55:20.058366+0000","last_peered":"2024-09-15T21:55:20.058366+0000","last_clean":"2024-09-15T21:55:20.058366+0000","last_became_active":"2024-09-15T21:55:20.053487+0000","last_became_peered":"2024-09-15T21:55:20.053487+0000","last_unstale":"2024-09-15T21:55:20.058366+0000","last_undegraded":"2024-09-15T21:55:20.058366+0000","last_fullsized":"2024-09-15T21:55:20.058366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034206+0000","last_change":"2024-09-15T21:55:20.034206+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034206+0000","last_undegraded":"2024-09-15T21:55:20.034206+0000","last_fullsized":"2024-09-15T21:55:20.034206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058016+0000","last_change":"2024-09-15T21:55:20.055656+0000","last_active":"2024-09-15T21:55:20.058016+0000","last_peered":"2024-09-15T21:55:20.058016+0000","last_clean":"2024-09-15T21:55:20.058016+0000","last_became_active":"2024-09-15T21:55:20.055168+0000","last_became_peered":"2024-09-15T21:55:20.055168+0000","last_unstale":"2024-09-15T21:55:20.058016+0000","last_undegraded":"2024-09-15T21:55:20.058016+0000","last_fullsized":"2024-09-15T21:55:20.058016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.043515+0000","last_change":"2024-09-15T21:55:20.043515+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.043515+0000","last_undegraded":"2024-09-15T21:55:20.043515+0000","last_fullsized":"2024-09-15T21:55:20.043515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:19.005505+0000","last_change":"2024-09-15T21:55:19.005505+0000","last_active":"2024-09-15T21:55:19.005505+0000","last_peered":"2024-09-15T21:55:19.005505+0000","last_clean":"2024-09-15T21:55:19.005505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:19.005505+0000","last_undegraded":"2024-09-15T21:55:19.005505+0000","last_fullsized":"2024-09-15T21:55:19.005505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038270+0000","last_change":"2024-09-15T21:55:20.038270+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038270+0000","last_undegraded":"2024-09-15T21:55:20.038270+0000","last_fullsized":"2024-09-15T21:55:20.038270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.055851+0000","last_change":"2024-09-15T21:55:20.051483+0000","last_active":"2024-09-15T21:55:20.055851+0000","last_peered":"2024-09-15T21:55:20.055851+0000","last_clean":"2024-09-15T21:55:20.055851+0000","last_became_active":"2024-09-15T21:55:20.051077+0000","last_became_peered":"2024-09-15T21:55:20.051077+0000","last_unstale":"2024-09-15T21:55:20.055851+0000","last_undegraded":"2024-09-15T21:55:20.055851+0000","last_fullsized":"2024-09-15T21:55:20.055851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038175+0000","last_change":"2024-09-15T21:55:20.038175+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038175+0000","last_undegraded":"2024-09-15T21:55:20.038175+0000","last_fullsized":"2024-09-15T21:55:20.038175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.061377+0000","last_change":"2024-09-15T21:55:20.058425+0000","last_active":"2024-09-15T21:55:20.061377+0000","last_peered":"2024-09-15T21:55:20.061377+0000","last_clean":"2024-09-15T21:55:20.061377+0000","last_became_active":"2024-09-15T21:55:20.057897+0000","last_became_peered":"2024-09-15T21:55:20.057897+0000","last_unstale":"2024-09-15T21:55:20.061377+0000","last_undegraded":"2024-09-15T21:55:20.061377+0000","last_fullsized":"2024-09-15T21:55:20.061377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034852+0000","last_change":"2024-09-15T21:55:20.034852+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034852+0000","last_undegraded":"2024-09-15T21:55:20.034852+0000","last_fullsized":"2024-09-15T21:55:20.034852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:19.005505+0000","last_change":"2024-09-15T21:55:19.005505+0000","last_active":"2024-09-15T21:55:19.005505+0000","last_peered":"2024-09-15T21:55:19.005505+0000","last_clean":"2024-09-15T21:55:19.005505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:19.005505+0000","last_undegraded":"2024-09-15T21:55:19.005505+0000","last_fullsized":"2024-09-15T21:55:19.005505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034522+0000","last_change":"2024-09-15T21:55:20.034522+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034522+0000","last_undegraded":"2024-09-15T21:55:20.034522+0000","last_fullsized":"2024-09-15T21:55:20.034522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058664+0000","last_change":"2024-09-15T21:55:20.057081+0000","last_active":"2024-09-15T21:55:20.058664+0000","last_peered":"2024-09-15T21:55:20.058664+0000","last_clean":"2024-09-15T21:55:20.058664+0000","last_became_active":"2024-09-15T21:55:20.056673+0000","last_became_peered":"2024-09-15T21:55:20.056673+0000","last_unstale":"2024-09-15T21:55:20.058664+0000","last_undegraded":"2024-09-15T21:55:20.058664+0000","last_fullsized":"2024-09-15T21:55:20.058664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:46.832251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.037753+0000","last_change":"2024-09-15T21:55:20.037753+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.037753+0000","last_undegraded":"2024-09-15T21:55:20.037753+0000","last_fullsized":"2024-09-15T21:55:20.037753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.057859+0000","last_change":"2024-09-15T21:55:20.053890+0000","last_active":"2024-09-15T21:55:20.057859+0000","last_peered":"2024-09-15T21:55:20.057859+0000","last_clean":"2024-09-15T21:55:20.057859+0000","last_became_active":"2024-09-15T21:55:20.053359+0000","last_became_peered":"2024-09-15T21:55:20.053359+0000","last_unstale":"2024-09-15T21:55:20.057859+0000","last_undegraded":"2024-09-15T21:55:20.057859+0000","last_fullsized":"2024-09-15T21:55:20.057859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.039942+0000","last_change":"2024-09-15T21:55:20.039942+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.039942+0000","last_undegraded":"2024-09-15T21:55:20.039942+0000","last_fullsized":"2024-09-15T21:55:20.039942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:19.005505+0000","last_change":"2024-09-15T21:55:19.005505+0000","last_active":"2024-09-15T21:55:19.005505+0000","last_peered":"2024-09-15T21:55:19.005505+0000","last_clean":"2024-09-15T21:55:19.005505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:19.005505+0000","last_undegraded":"2024-09-15T21:55:19.005505+0000","last_fullsized":"2024-09-15T21:55:19.005505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035058+0000","last_change":"2024-09-15T21:55:20.035058+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035058+0000","last_undegraded":"2024-09-15T21:55:20.035058+0000","last_fullsized":"2024-09-15T21:55:20.035058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044376+0000","last_change":"2024-09-15T21:55:20.044376+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044376+0000","last_undegraded":"2024-09-15T21:55:20.044376+0000","last_fullsized":"2024-09-15T21:55:20.044376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:19.005505+0000","last_change":"2024-09-15T21:55:19.005505+0000","last_active":"2024-09-15T21:55:19.005505+0000","last_peered":"2024-09-15T21:55:19.005505+0000","last_clean":"2024-09-15T21:55:19.005505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:19.005505+0000","last_undegraded":"2024-09-15T21:55:19.005505+0000","last_fullsized":"2024-09-15T21:55:19.005505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040551+0000","last_change":"2024-09-15T21:55:20.040551+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040551+0000","last_undegraded":"2024-09-15T21:55:20.040551+0000","last_fullsized":"2024-09-15T21:55:20.040551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T21:55:19.005505+0000","last_change":"2024-09-15T21:55:19.005505+0000","last_active":"2024-09-15T21:55:19.005505+0000","last_peered":"2024-09-15T21:55:19.005505+0000","last_clean":"2024-09-15T21:55:19.005505+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:19.005505+0000","last_undegraded":"2024-09-15T21:55:19.005505+0000","last_fullsized":"2024-09-15T21:55:19.005505+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044136+0000","last_change":"2024-09-15T21:55:20.044136+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044136+0000","last_undegraded":"2024-09-15T21:55:20.044136+0000","last_fullsized":"2024-09-15T21:55:20.044136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.063582+0000","last_change":"2024-09-15T21:55:20.055671+0000","last_active":"2024-09-15T21:55:20.063582+0000","last_peered":"2024-09-15T21:55:20.063582+0000","last_clean":"2024-09-15T21:55:20.063582+0000","last_became_active":"2024-09-15T21:55:20.054385+0000","last_became_peered":"2024-09-15T21:55:20.054385+0000","last_unstale":"2024-09-15T21:55:20.063582+0000","last_undegraded":"2024-09-15T21:55:20.063582+0000","last_fullsized":"2024-09-15T21:55:20.063582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:50.157193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036713+0000","last_change":"2024-09-15T21:55:20.036713+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036713+0000","last_undegraded":"2024-09-15T21:55:20.036713+0000","last_fullsized":"2024-09-15T21:55:20.036713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.060487+0000","last_change":"2024-09-15T21:55:20.057739+0000","last_active":"2024-09-15T21:55:20.060487+0000","last_peered":"2024-09-15T21:55:20.060487+0000","last_clean":"2024-09-15T21:55:20.060487+0000","last_became_active":"2024-09-15T21:55:20.056988+0000","last_became_peered":"2024-09-15T21:55:20.056988+0000","last_unstale":"2024-09-15T21:55:20.060487+0000","last_undegraded":"2024-09-15T21:55:20.060487+0000","last_fullsized":"2024-09-15T21:55:20.060487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":102,"acting":102,"num_store_stats":6},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509443,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":753664,"data_stored":637948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35504,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336336,"statfs":{"total":96636764160,"available":96600408064,"internally_reserved":0,"allocated":159744,"data_stored":47580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:55:25.108 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:55:25.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f856a662640 1 Processor -- start 2024-09-15T21:55:25.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f856a662640 1 -- start start 2024-09-15T21:55:25.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f856a662640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f85640b9510 0x7f85640baed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f856a662640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85640735b0 0x7f8564073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f856a662640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8564073f80 con 0x7f85641481a0 2024-09-15T21:55:25.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f856a662640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f85640b98f0 con 0x7f85640b9510 2024-09-15T21:55:25.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f856a662640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f85640730b0 con 0x7f85640735b0 2024-09-15T21:55:25.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f855bfff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f85641481a0 0x7f8564141b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46070/0 (socket says 172.21.15.1:46070) 2024-09-15T21:55:25.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f855bfff640 1 -- 172.21.15.1:0/4095925854 learned_addr learned my addr 172.21.15.1:0/4095925854 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:25.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f8563fff640 1 --2- 172.21.15.1:0/4095925854 >> v2:172.21.15.70:3300/0 conn(0x7f85640b9510 0x7f85640baed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f8568bff640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85640735b0 0x7f8564073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1215274897 0 0) 0x7f8564073f80 con 0x7f85641481a0 2024-09-15T21:55:25.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8550003530 con 0x7f85641481a0 2024-09-15T21:55:25.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4077250754 0 0) 0x7f8550003530 con 0x7f85641481a0 2024-09-15T21:55:25.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85640735b0 msgr2=0x7f8564073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:25.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85640735b0 0x7f8564073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 >> v2:172.21.15.70:3300/0 conn(0x7f85640b9510 msgr2=0x7f85640baed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:25.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 --2- 172.21.15.1:0/4095925854 >> v2:172.21.15.70:3300/0 conn(0x7f85640b9510 0x7f85640baed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85641487f0 con 0x7f85641481a0 2024-09-15T21:55:25.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f854c001680 con 0x7f85641481a0 2024-09-15T21:55:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 >> v1:172.21.15.1:6789/0 conn(0x7f85641481a0 legacy=0x7f8564141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85640735b0 0x7f85500039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8550003f40 0x7f8550004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8550004d50 0x7f85500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f85640b98f0 con 0x7f8550003f40 2024-09-15T21:55:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85640730b0 con 0x7f8550004d50 2024-09-15T21:55:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f855000b9d0 con 0x7f85640735b0 2024-09-15T21:55:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f855bfff640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8550003f40 0x7f8550004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f8563fff640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85640735b0 0x7f85500039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f855bfff640 1 -- 172.21.15.1:0/4095925854 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85640735b0 msgr2=0x7f85500039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f855bfff640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85640735b0 0x7f85500039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f855bfff640 1 -- 172.21.15.1:0/4095925854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8550004d50 msgr2=0x7f85500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:25.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f8568bff640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8550004d50 0x7f85500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f855bfff640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8550004d50 0x7f85500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f855bfff640 1 -- 172.21.15.1:0/4095925854 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8550003530 con 0x7f8550003f40 2024-09-15T21:55:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f8563fff640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85640735b0 0x7f85500039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:25.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.261+0000 7f8568bff640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8550004d50 0x7f85500051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:25.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f855bfff640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8550003f40 0x7f8550004810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f854c00c210 tx=0x7f854c01f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d688350336838a0f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:25.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c007d40 con 0x7f8550003f40 2024-09-15T21:55:25.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854c005b00 con 0x7f8550003f40 2024-09-15T21:55:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f85637fe640 1 -- 172.21.15.1:0/4095925854 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c007070 con 0x7f8550003f40 2024-09-15T21:55:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 -- 172.21.15.1:0/4095925854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8550003f40 msgr2=0x7f8550004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 --2- 172.21.15.1:0/4095925854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8550003f40 0x7f8550004810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f854c00c210 tx=0x7f854c01f390 comp rx=0 tx=0).stop 2024-09-15T21:55:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f8568bff640 1 -- 172.21.15.1:0/4095925854 reap_dead start 2024-09-15T21:55:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 -- 172.21.15.1:0/4095925854 shutdown_connections 2024-09-15T21:55:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 -- 172.21.15.1:0/4095925854 >> 172.21.15.1:0/4095925854 conn(0x7f856409d260 msgr2=0x7f856409d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 -- 172.21.15.1:0/4095925854 shutdown_connections 2024-09-15T21:55:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 -- 172.21.15.1:0/4095925854 wait complete. 2024-09-15T21:55:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 Processor -- start 2024-09-15T21:55:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 -- start start 2024-09-15T21:55:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8550003f40 0x7f856409f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85641dd9c0 0x7f85641dde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85641e0dc0 0x7f85641e1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f85641422a0 con 0x7f8550003f40 2024-09-15T21:55:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8564072b30 con 0x7f85641dd9c0 2024-09-15T21:55:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f856a662640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8564142420 con 0x7f85641e0dc0 2024-09-15T21:55:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f8563fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8550003f40 0x7f856409f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f8563fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8550003f40 0x7f856409f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34582/0 (socket says 172.21.15.1:34582) 2024-09-15T21:55:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f8563fff640 1 -- 172.21.15.1:0/4056921757 learned_addr learned my addr 172.21.15.1:0/4056921757 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f855bfff640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85641dd9c0 0x7f85641dde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f8568bff640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85641e0dc0 0x7f85641e1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f8563fff640 1 -- 172.21.15.1:0/4056921757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85641e0dc0 msgr2=0x7f85641e1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f8563fff640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85641e0dc0 0x7f85641e1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f8563fff640 1 -- 172.21.15.1:0/4056921757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85641dd9c0 msgr2=0x7f85641dde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f8563fff640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85641dd9c0 0x7f85641dde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f8563fff640 1 -- 172.21.15.1:0/4056921757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85641de360 con 0x7f8550003f40 2024-09-15T21:55:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f8568bff640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85641e0dc0 0x7f85641e1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f8563fff640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8550003f40 0x7f856409f410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8554010980 tx=0x7f8554010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.265+0000 7f85617fa640 1 -- 172.21.15.1:0/4056921757 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855400f040 con 0x7f8550003f40 2024-09-15T21:55:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.269+0000 7f85617fa640 1 -- 172.21.15.1:0/4056921757 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f855400ec20 con 0x7f8550003f40 2024-09-15T21:55:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.269+0000 7f856a662640 1 -- 172.21.15.1:0/4056921757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856409e940 con 0x7f8550003f40 2024-09-15T21:55:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.269+0000 7f85617fa640 1 -- 172.21.15.1:0/4056921757 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554004020 con 0x7f8550003f40 2024-09-15T21:55:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.269+0000 7f856a662640 1 -- 172.21.15.1:0/4056921757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85640a0db0 con 0x7f8550003f40 2024-09-15T21:55:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.269+0000 7f856a662640 1 -- 172.21.15.1:0/4056921757 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85640baed0 con 0x7f8550003f40 2024-09-15T21:55:25.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.269+0000 7f85617fa640 1 -- 172.21.15.1:0/4056921757 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f85540041c0 con 0x7f8550003f40 2024-09-15T21:55:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.269+0000 7f85617fa640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f85440678c0 0x7f8544069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.269+0000 7f855bfff640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f85440678c0 0x7f8544069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.269+0000 7f85617fa640 1 -- 172.21.15.1:0/4056921757 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f85540860e0 con 0x7f8550003f40 2024-09-15T21:55:25.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.269+0000 7f855bfff640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f85440678c0 0x7f8544069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f854c0af000 tx=0x7f854c0aa000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:25.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.273+0000 7f85617fa640 1 -- 172.21.15.1:0/4056921757 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8554018030 con 0x7f8550003f40 2024-09-15T21:55:25.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.425+0000 7f856a662640 1 -- 172.21.15.1:0/4056921757 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85641402a0 con 0x7f85440678c0 2024-09-15T21:55:25.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.445+0000 7f85617fa640 1 -- 172.21.15.1:0/4056921757 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247717 (secure 0 0 0) 0x7f85641402a0 con 0x7f85440678c0 2024-09-15T21:55:25.451 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:25.452 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:55:25.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.449+0000 7f856a662640 1 -- 172.21.15.1:0/4056921757 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f85440678c0 msgr2=0x7f8544069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.449+0000 7f856a662640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f85440678c0 0x7f8544069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f854c0af000 tx=0x7f854c0aa000 comp rx=0 tx=0).stop 2024-09-15T21:55:25.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.449+0000 7f856a662640 1 -- 172.21.15.1:0/4056921757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8550003f40 msgr2=0x7f856409f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.449+0000 7f856a662640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8550003f40 0x7f856409f410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8554010980 tx=0x7f8554010e40 comp rx=0 tx=0).stop 2024-09-15T21:55:25.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.449+0000 7f856a662640 1 -- 172.21.15.1:0/4056921757 shutdown_connections 2024-09-15T21:55:25.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.449+0000 7f856a662640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85641e0dc0 0x7f85641e1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.449+0000 7f856a662640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f85440678c0 0x7f8544069d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.449+0000 7f856a662640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85641dd9c0 0x7f85641dde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.449+0000 7f856a662640 1 --2- 172.21.15.1:0/4056921757 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8550003f40 0x7f856409f410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.449+0000 7f856a662640 1 -- 172.21.15.1:0/4056921757 >> 172.21.15.1:0/4056921757 conn(0x7f856409d260 msgr2=0x7f856406f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:25.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.449+0000 7f856a662640 1 -- 172.21.15.1:0/4056921757 shutdown_connections 2024-09-15T21:55:25.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.449+0000 7f856a662640 1 -- 172.21.15.1:0/4056921757 wait complete. 2024-09-15T21:55:25.468 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-15T21:55:25.079422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256252,"kb_used_data":2580,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754718468,"statfs":{"total":773094113280,"available":772831711232,"internally_reserved":0,"allocated":2641920,"data_stored":1647194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.016188"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484762+0000","last_change":"2024-09-15T21:55:21.088474+0000","last_active":"2024-09-15T21:55:22.484762+0000","last_peered":"2024-09-15T21:55:22.484762+0000","last_clean":"2024-09-15T21:55:22.484762+0000","last_became_active":"2024-09-15T21:55:21.088066+0000","last_became_peered":"2024-09-15T21:55:21.088066+0000","last_unstale":"2024-09-15T21:55:22.484762+0000","last_undegraded":"2024-09-15T21:55:22.484762+0000","last_fullsized":"2024-09-15T21:55:22.484762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:35.421317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.037857+0000","last_change":"2024-09-15T21:55:20.037857+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.037857+0000","last_undegraded":"2024-09-15T21:55:20.037857+0000","last_fullsized":"2024-09-15T21:55:20.037857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045680+0000","last_change":"2024-09-15T21:55:20.045680+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045680+0000","last_undegraded":"2024-09-15T21:55:20.045680+0000","last_fullsized":"2024-09-15T21:55:20.045680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.041645+0000","last_change":"2024-09-15T21:55:20.041645+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.041645+0000","last_undegraded":"2024-09-15T21:55:20.041645+0000","last_fullsized":"2024-09-15T21:55:20.041645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484114+0000","last_change":"2024-09-15T21:55:21.081320+0000","last_active":"2024-09-15T21:55:22.484114+0000","last_peered":"2024-09-15T21:55:22.484114+0000","last_clean":"2024-09-15T21:55:22.484114+0000","last_became_active":"2024-09-15T21:55:21.080501+0000","last_became_peered":"2024-09-15T21:55:21.080501+0000","last_unstale":"2024-09-15T21:55:22.484114+0000","last_undegraded":"2024-09-15T21:55:22.484114+0000","last_fullsized":"2024-09-15T21:55:22.484114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:24.528185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.048263+0000","last_change":"2024-09-15T21:55:20.048263+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.048263+0000","last_undegraded":"2024-09-15T21:55:20.048263+0000","last_fullsized":"2024-09-15T21:55:20.048263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483929+0000","last_change":"2024-09-15T21:55:21.081625+0000","last_active":"2024-09-15T21:55:22.483929+0000","last_peered":"2024-09-15T21:55:22.483929+0000","last_clean":"2024-09-15T21:55:22.483929+0000","last_became_active":"2024-09-15T21:55:21.081233+0000","last_became_peered":"2024-09-15T21:55:21.081233+0000","last_unstale":"2024-09-15T21:55:22.483929+0000","last_undegraded":"2024-09-15T21:55:22.483929+0000","last_fullsized":"2024-09-15T21:55:22.483929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:56.638597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.049532+0000","last_change":"2024-09-15T21:55:20.049532+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.049532+0000","last_undegraded":"2024-09-15T21:55:20.049532+0000","last_fullsized":"2024-09-15T21:55:20.049532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485001+0000","last_change":"2024-09-15T21:55:21.094131+0000","last_active":"2024-09-15T21:55:22.485001+0000","last_peered":"2024-09-15T21:55:22.485001+0000","last_clean":"2024-09-15T21:55:22.485001+0000","last_became_active":"2024-09-15T21:55:21.093635+0000","last_became_peered":"2024-09-15T21:55:21.093635+0000","last_unstale":"2024-09-15T21:55:22.485001+0000","last_undegraded":"2024-09-15T21:55:22.485001+0000","last_fullsized":"2024-09-15T21:55:22.485001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.303590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036035+0000","last_change":"2024-09-15T21:55:20.036035+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036035+0000","last_undegraded":"2024-09-15T21:55:20.036035+0000","last_fullsized":"2024-09-15T21:55:20.036035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033278+0000","last_change":"2024-09-15T21:55:20.033278+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033278+0000","last_undegraded":"2024-09-15T21:55:20.033278+0000","last_fullsized":"2024-09-15T21:55:20.033278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.037108+0000","last_change":"2024-09-15T21:55:20.037108+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.037108+0000","last_undegraded":"2024-09-15T21:55:20.037108+0000","last_fullsized":"2024-09-15T21:55:20.037108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.041091+0000","last_change":"2024-09-15T21:55:20.041091+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.041091+0000","last_undegraded":"2024-09-15T21:55:20.041091+0000","last_fullsized":"2024-09-15T21:55:20.041091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045050+0000","last_change":"2024-09-15T21:55:20.045050+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045050+0000","last_undegraded":"2024-09-15T21:55:20.045050+0000","last_fullsized":"2024-09-15T21:55:20.045050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038764+0000","last_change":"2024-09-15T21:55:20.038764+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038764+0000","last_undegraded":"2024-09-15T21:55:20.038764+0000","last_fullsized":"2024-09-15T21:55:20.038764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045788+0000","last_change":"2024-09-15T21:55:20.045788+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045788+0000","last_undegraded":"2024-09-15T21:55:20.045788+0000","last_fullsized":"2024-09-15T21:55:20.045788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044531+0000","last_change":"2024-09-15T21:55:20.044531+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044531+0000","last_undegraded":"2024-09-15T21:55:20.044531+0000","last_fullsized":"2024-09-15T21:55:20.044531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.225030+0000","last_change":"2024-09-15T21:55:21.056138+0000","last_active":"2024-09-15T21:55:22.225030+0000","last_peered":"2024-09-15T21:55:22.225030+0000","last_clean":"2024-09-15T21:55:22.225030+0000","last_became_active":"2024-09-15T21:55:21.055873+0000","last_became_peered":"2024-09-15T21:55:21.055873+0000","last_unstale":"2024-09-15T21:55:22.225030+0000","last_undegraded":"2024-09-15T21:55:22.225030+0000","last_fullsized":"2024-09-15T21:55:22.225030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:11.494691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484459+0000","last_change":"2024-09-15T21:55:21.088654+0000","last_active":"2024-09-15T21:55:22.484459+0000","last_peered":"2024-09-15T21:55:22.484459+0000","last_clean":"2024-09-15T21:55:22.484459+0000","last_became_active":"2024-09-15T21:55:21.087902+0000","last_became_peered":"2024-09-15T21:55:21.087902+0000","last_unstale":"2024-09-15T21:55:22.484459+0000","last_undegraded":"2024-09-15T21:55:22.484459+0000","last_fullsized":"2024-09-15T21:55:22.484459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:40.823067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033749+0000","last_change":"2024-09-15T21:55:20.033749+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033749+0000","last_undegraded":"2024-09-15T21:55:20.033749+0000","last_fullsized":"2024-09-15T21:55:20.033749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.047119+0000","last_change":"2024-09-15T21:55:20.047119+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.047119+0000","last_undegraded":"2024-09-15T21:55:20.047119+0000","last_fullsized":"2024-09-15T21:55:20.047119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.046658+0000","last_change":"2024-09-15T21:55:20.046658+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.046658+0000","last_undegraded":"2024-09-15T21:55:20.046658+0000","last_fullsized":"2024-09-15T21:55:20.046658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040720+0000","last_change":"2024-09-15T21:55:20.040720+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040720+0000","last_undegraded":"2024-09-15T21:55:20.040720+0000","last_fullsized":"2024-09-15T21:55:20.040720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.042262+0000","last_change":"2024-09-15T21:55:20.042262+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.042262+0000","last_undegraded":"2024-09-15T21:55:20.042262+0000","last_fullsized":"2024-09-15T21:55:20.042262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038892+0000","last_change":"2024-09-15T21:55:20.038892+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038892+0000","last_undegraded":"2024-09-15T21:55:20.038892+0000","last_fullsized":"2024-09-15T21:55:20.038892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033476+0000","last_change":"2024-09-15T21:55:20.033476+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033476+0000","last_undegraded":"2024-09-15T21:55:20.033476+0000","last_fullsized":"2024-09-15T21:55:20.033476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038591+0000","last_change":"2024-09-15T21:55:20.038591+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038591+0000","last_undegraded":"2024-09-15T21:55:20.038591+0000","last_fullsized":"2024-09-15T21:55:20.038591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.041805+0000","last_change":"2024-09-15T21:55:20.041805+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.041805+0000","last_undegraded":"2024-09-15T21:55:20.041805+0000","last_fullsized":"2024-09-15T21:55:20.041805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040398+0000","last_change":"2024-09-15T21:55:20.040398+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040398+0000","last_undegraded":"2024-09-15T21:55:20.040398+0000","last_fullsized":"2024-09-15T21:55:20.040398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044672+0000","last_change":"2024-09-15T21:55:20.044672+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044672+0000","last_undegraded":"2024-09-15T21:55:20.044672+0000","last_fullsized":"2024-09-15T21:55:20.044672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224741+0000","last_change":"2024-09-15T21:55:21.084544+0000","last_active":"2024-09-15T21:55:22.224741+0000","last_peered":"2024-09-15T21:55:22.224741+0000","last_clean":"2024-09-15T21:55:22.224741+0000","last_became_active":"2024-09-15T21:55:21.084180+0000","last_became_peered":"2024-09-15T21:55:21.084180+0000","last_unstale":"2024-09-15T21:55:22.224741+0000","last_undegraded":"2024-09-15T21:55:22.224741+0000","last_fullsized":"2024-09-15T21:55:22.224741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:41.953343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035371+0000","last_change":"2024-09-15T21:55:20.035371+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035371+0000","last_undegraded":"2024-09-15T21:55:20.035371+0000","last_fullsized":"2024-09-15T21:55:20.035371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036019+0000","last_change":"2024-09-15T21:55:20.036019+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036019+0000","last_undegraded":"2024-09-15T21:55:20.036019+0000","last_fullsized":"2024-09-15T21:55:20.036019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.067335+0000","last_change":"2024-09-15T21:55:20.066836+0000","last_active":"2024-09-15T21:55:20.067335+0000","last_peered":"2024-09-15T21:55:20.067335+0000","last_clean":"2024-09-15T21:55:20.067335+0000","last_became_active":"2024-09-15T21:55:20.066434+0000","last_became_peered":"2024-09-15T21:55:20.066434+0000","last_unstale":"2024-09-15T21:55:20.067335+0000","last_undegraded":"2024-09-15T21:55:20.067335+0000","last_fullsized":"2024-09-15T21:55:20.067335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036377+0000","last_change":"2024-09-15T21:55:20.036377+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036377+0000","last_undegraded":"2024-09-15T21:55:20.036377+0000","last_fullsized":"2024-09-15T21:55:20.036377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.056086+0000","last_change":"2024-09-15T21:55:20.049677+0000","last_active":"2024-09-15T21:55:20.056086+0000","last_peered":"2024-09-15T21:55:20.056086+0000","last_clean":"2024-09-15T21:55:20.056086+0000","last_became_active":"2024-09-15T21:55:20.046329+0000","last_became_peered":"2024-09-15T21:55:20.046329+0000","last_unstale":"2024-09-15T21:55:20.056086+0000","last_undegraded":"2024-09-15T21:55:20.056086+0000","last_fullsized":"2024-09-15T21:55:20.056086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.063529+0000","last_change":"2024-09-15T21:55:20.056808+0000","last_active":"2024-09-15T21:55:20.063529+0000","last_peered":"2024-09-15T21:55:20.063529+0000","last_clean":"2024-09-15T21:55:20.063529+0000","last_became_active":"2024-09-15T21:55:20.055774+0000","last_became_peered":"2024-09-15T21:55:20.055774+0000","last_unstale":"2024-09-15T21:55:20.063529+0000","last_undegraded":"2024-09-15T21:55:20.063529+0000","last_fullsized":"2024-09-15T21:55:20.063529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040547+0000","last_change":"2024-09-15T21:55:20.040547+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040547+0000","last_undegraded":"2024-09-15T21:55:20.040547+0000","last_fullsized":"2024-09-15T21:55:20.040547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.056445+0000","last_change":"2024-09-15T21:55:20.052880+0000","last_active":"2024-09-15T21:55:20.056445+0000","last_peered":"2024-09-15T21:55:20.056445+0000","last_clean":"2024-09-15T21:55:20.056445+0000","last_became_active":"2024-09-15T21:55:20.052076+0000","last_became_peered":"2024-09-15T21:55:20.052076+0000","last_unstale":"2024-09-15T21:55:20.056445+0000","last_undegraded":"2024-09-15T21:55:20.056445+0000","last_fullsized":"2024-09-15T21:55:20.056445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045423+0000","last_change":"2024-09-15T21:55:20.045423+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045423+0000","last_undegraded":"2024-09-15T21:55:20.045423+0000","last_fullsized":"2024-09-15T21:55:20.045423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.057146+0000","last_change":"2024-09-15T21:55:20.054769+0000","last_active":"2024-09-15T21:55:20.057146+0000","last_peered":"2024-09-15T21:55:20.057146+0000","last_clean":"2024-09-15T21:55:20.057146+0000","last_became_active":"2024-09-15T21:55:20.053983+0000","last_became_peered":"2024-09-15T21:55:20.053983+0000","last_unstale":"2024-09-15T21:55:20.057146+0000","last_undegraded":"2024-09-15T21:55:20.057146+0000","last_fullsized":"2024-09-15T21:55:20.057146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045646+0000","last_change":"2024-09-15T21:55:20.045646+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045646+0000","last_undegraded":"2024-09-15T21:55:20.045646+0000","last_fullsized":"2024-09-15T21:55:20.045646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058304+0000","last_change":"2024-09-15T21:55:20.055173+0000","last_active":"2024-09-15T21:55:20.058304+0000","last_peered":"2024-09-15T21:55:20.058304+0000","last_clean":"2024-09-15T21:55:20.058304+0000","last_became_active":"2024-09-15T21:55:20.054689+0000","last_became_peered":"2024-09-15T21:55:20.054689+0000","last_unstale":"2024-09-15T21:55:20.058304+0000","last_undegraded":"2024-09-15T21:55:20.058304+0000","last_fullsized":"2024-09-15T21:55:20.058304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040720+0000","last_change":"2024-09-15T21:55:20.040720+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040720+0000","last_undegraded":"2024-09-15T21:55:20.040720+0000","last_fullsized":"2024-09-15T21:55:20.040720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058047+0000","last_change":"2024-09-15T21:55:20.054045+0000","last_active":"2024-09-15T21:55:20.058047+0000","last_peered":"2024-09-15T21:55:20.058047+0000","last_clean":"2024-09-15T21:55:20.058047+0000","last_became_active":"2024-09-15T21:55:20.053600+0000","last_became_peered":"2024-09-15T21:55:20.053600+0000","last_unstale":"2024-09-15T21:55:20.058047+0000","last_undegraded":"2024-09-15T21:55:20.058047+0000","last_fullsized":"2024-09-15T21:55:20.058047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035990+0000","last_change":"2024-09-15T21:55:20.035990+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035990+0000","last_undegraded":"2024-09-15T21:55:20.035990+0000","last_fullsized":"2024-09-15T21:55:20.035990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.057003+0000","last_change":"2024-09-15T21:55:20.053664+0000","last_active":"2024-09-15T21:55:20.057003+0000","last_peered":"2024-09-15T21:55:20.057003+0000","last_clean":"2024-09-15T21:55:20.057003+0000","last_became_active":"2024-09-15T21:55:20.051430+0000","last_became_peered":"2024-09-15T21:55:20.051430+0000","last_unstale":"2024-09-15T21:55:20.057003+0000","last_undegraded":"2024-09-15T21:55:20.057003+0000","last_fullsized":"2024-09-15T21:55:20.057003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483958+0000","last_change":"2024-09-15T21:55:21.081085+0000","last_active":"2024-09-15T21:55:22.483958+0000","last_peered":"2024-09-15T21:55:22.483958+0000","last_clean":"2024-09-15T21:55:22.483958+0000","last_became_active":"2024-09-15T21:55:21.080302+0000","last_became_peered":"2024-09-15T21:55:21.080302+0000","last_unstale":"2024-09-15T21:55:22.483958+0000","last_undegraded":"2024-09-15T21:55:22.483958+0000","last_fullsized":"2024-09-15T21:55:22.483958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:35.161272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.054999+0000","last_change":"2024-09-15T21:55:20.050298+0000","last_active":"2024-09-15T21:55:20.054999+0000","last_peered":"2024-09-15T21:55:20.054999+0000","last_clean":"2024-09-15T21:55:20.054999+0000","last_became_active":"2024-09-15T21:55:20.049086+0000","last_became_peered":"2024-09-15T21:55:20.049086+0000","last_unstale":"2024-09-15T21:55:20.054999+0000","last_undegraded":"2024-09-15T21:55:20.054999+0000","last_fullsized":"2024-09-15T21:55:20.054999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034751+0000","last_change":"2024-09-15T21:55:20.034751+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034751+0000","last_undegraded":"2024-09-15T21:55:20.034751+0000","last_fullsized":"2024-09-15T21:55:20.034751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.070744+0000","last_change":"2024-09-15T21:55:20.067348+0000","last_active":"2024-09-15T21:55:20.070744+0000","last_peered":"2024-09-15T21:55:20.070744+0000","last_clean":"2024-09-15T21:55:20.070744+0000","last_became_active":"2024-09-15T21:55:20.066912+0000","last_became_peered":"2024-09-15T21:55:20.066912+0000","last_unstale":"2024-09-15T21:55:20.070744+0000","last_undegraded":"2024-09-15T21:55:20.070744+0000","last_fullsized":"2024-09-15T21:55:20.070744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484340+0000","last_change":"2024-09-15T21:55:21.092869+0000","last_active":"2024-09-15T21:55:22.484340+0000","last_peered":"2024-09-15T21:55:22.484340+0000","last_clean":"2024-09-15T21:55:22.484340+0000","last_became_active":"2024-09-15T21:55:21.092360+0000","last_became_peered":"2024-09-15T21:55:21.092360+0000","last_unstale":"2024-09-15T21:55:22.484340+0000","last_undegraded":"2024-09-15T21:55:22.484340+0000","last_fullsized":"2024-09-15T21:55:22.484340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:08.584649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.056104+0000","last_change":"2024-09-15T21:55:20.046741+0000","last_active":"2024-09-15T21:55:20.056104+0000","last_peered":"2024-09-15T21:55:20.056104+0000","last_clean":"2024-09-15T21:55:20.056104+0000","last_became_active":"2024-09-15T21:55:20.044504+0000","last_became_peered":"2024-09-15T21:55:20.044504+0000","last_unstale":"2024-09-15T21:55:20.056104+0000","last_undegraded":"2024-09-15T21:55:20.056104+0000","last_fullsized":"2024-09-15T21:55:20.056104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033086+0000","last_change":"2024-09-15T21:55:20.033086+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033086+0000","last_undegraded":"2024-09-15T21:55:20.033086+0000","last_fullsized":"2024-09-15T21:55:20.033086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224516+0000","last_change":"2024-09-15T21:55:20.045879+0000","last_active":"2024-09-15T21:55:22.224516+0000","last_peered":"2024-09-15T21:55:22.224516+0000","last_clean":"2024-09-15T21:55:22.224516+0000","last_became_active":"2024-09-15T21:55:20.045166+0000","last_became_peered":"2024-09-15T21:55:20.045166+0000","last_unstale":"2024-09-15T21:55:22.224516+0000","last_undegraded":"2024-09-15T21:55:22.224516+0000","last_fullsized":"2024-09-15T21:55:22.224516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:27.871582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484582+0000","last_change":"2024-09-15T21:55:21.091543+0000","last_active":"2024-09-15T21:55:22.484582+0000","last_peered":"2024-09-15T21:55:22.484582+0000","last_clean":"2024-09-15T21:55:22.484582+0000","last_became_active":"2024-09-15T21:55:21.088040+0000","last_became_peered":"2024-09-15T21:55:21.088040+0000","last_unstale":"2024-09-15T21:55:22.484582+0000","last_undegraded":"2024-09-15T21:55:22.484582+0000","last_fullsized":"2024-09-15T21:55:22.484582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:58.437513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.064056+0000","last_change":"2024-09-15T21:55:20.060882+0000","last_active":"2024-09-15T21:55:20.064056+0000","last_peered":"2024-09-15T21:55:20.064056+0000","last_clean":"2024-09-15T21:55:20.064056+0000","last_became_active":"2024-09-15T21:55:20.059856+0000","last_became_peered":"2024-09-15T21:55:20.059856+0000","last_unstale":"2024-09-15T21:55:20.064056+0000","last_undegraded":"2024-09-15T21:55:20.064056+0000","last_fullsized":"2024-09-15T21:55:20.064056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484517+0000","last_change":"2024-09-15T21:55:21.088545+0000","last_active":"2024-09-15T21:55:22.484517+0000","last_peered":"2024-09-15T21:55:22.484517+0000","last_clean":"2024-09-15T21:55:22.484517+0000","last_became_active":"2024-09-15T21:55:21.080729+0000","last_became_peered":"2024-09-15T21:55:21.080729+0000","last_unstale":"2024-09-15T21:55:22.484517+0000","last_undegraded":"2024-09-15T21:55:22.484517+0000","last_fullsized":"2024-09-15T21:55:22.484517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:10.451575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224968+0000","last_change":"2024-09-15T21:55:20.053774+0000","last_active":"2024-09-15T21:55:22.224968+0000","last_peered":"2024-09-15T21:55:22.224968+0000","last_clean":"2024-09-15T21:55:22.224968+0000","last_became_active":"2024-09-15T21:55:20.053417+0000","last_became_peered":"2024-09-15T21:55:20.053417+0000","last_unstale":"2024-09-15T21:55:22.224968+0000","last_undegraded":"2024-09-15T21:55:22.224968+0000","last_fullsized":"2024-09-15T21:55:22.224968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:42:50.046558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484974+0000","last_change":"2024-09-15T21:55:21.088812+0000","last_active":"2024-09-15T21:55:22.484974+0000","last_peered":"2024-09-15T21:55:22.484974+0000","last_clean":"2024-09-15T21:55:22.484974+0000","last_became_active":"2024-09-15T21:55:21.088403+0000","last_became_peered":"2024-09-15T21:55:21.088403+0000","last_unstale":"2024-09-15T21:55:22.484974+0000","last_undegraded":"2024-09-15T21:55:22.484974+0000","last_fullsized":"2024-09-15T21:55:22.484974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:53:46.896732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.051966+0000","last_change":"2024-09-15T21:55:20.049155+0000","last_active":"2024-09-15T21:55:20.051966+0000","last_peered":"2024-09-15T21:55:20.051966+0000","last_clean":"2024-09-15T21:55:20.051966+0000","last_became_active":"2024-09-15T21:55:20.048758+0000","last_became_peered":"2024-09-15T21:55:20.048758+0000","last_unstale":"2024-09-15T21:55:20.051966+0000","last_undegraded":"2024-09-15T21:55:20.051966+0000","last_fullsized":"2024-09-15T21:55:20.051966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.039420+0000","last_change":"2024-09-15T21:55:20.039420+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.039420+0000","last_undegraded":"2024-09-15T21:55:20.039420+0000","last_fullsized":"2024-09-15T21:55:20.039420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224802+0000","last_change":"2024-09-15T21:55:20.057638+0000","last_active":"2024-09-15T21:55:22.224802+0000","last_peered":"2024-09-15T21:55:22.224802+0000","last_clean":"2024-09-15T21:55:22.224802+0000","last_became_active":"2024-09-15T21:55:20.057104+0000","last_became_peered":"2024-09-15T21:55:20.057104+0000","last_unstale":"2024-09-15T21:55:22.224802+0000","last_undegraded":"2024-09-15T21:55:22.224802+0000","last_fullsized":"2024-09-15T21:55:22.224802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:46.407918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484034+0000","last_change":"2024-09-15T21:55:21.092764+0000","last_active":"2024-09-15T21:55:22.484034+0000","last_peered":"2024-09-15T21:55:22.484034+0000","last_clean":"2024-09-15T21:55:22.484034+0000","last_became_active":"2024-09-15T21:55:21.092278+0000","last_became_peered":"2024-09-15T21:55:21.092278+0000","last_unstale":"2024-09-15T21:55:22.484034+0000","last_undegraded":"2024-09-15T21:55:22.484034+0000","last_fullsized":"2024-09-15T21:55:22.484034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:16.853013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483633+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:22.483633+0000","last_peered":"2024-09-15T21:55:22.483633+0000","last_clean":"2024-09-15T21:55:22.483633+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:22.483633+0000","last_undegraded":"2024-09-15T21:55:22.483633+0000","last_fullsized":"2024-09-15T21:55:22.483633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.063634+0000","last_change":"2024-09-15T21:55:20.062164+0000","last_active":"2024-09-15T21:55:20.063634+0000","last_peered":"2024-09-15T21:55:20.063634+0000","last_clean":"2024-09-15T21:55:20.063634+0000","last_became_active":"2024-09-15T21:55:20.061451+0000","last_became_peered":"2024-09-15T21:55:20.061451+0000","last_unstale":"2024-09-15T21:55:20.063634+0000","last_undegraded":"2024-09-15T21:55:20.063634+0000","last_fullsized":"2024-09-15T21:55:20.063634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035398+0000","last_change":"2024-09-15T21:55:20.035398+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035398+0000","last_undegraded":"2024-09-15T21:55:20.035398+0000","last_fullsized":"2024-09-15T21:55:20.035398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483452+0000","last_change":"2024-09-15T21:55:20.067427+0000","last_active":"2024-09-15T21:55:22.483452+0000","last_peered":"2024-09-15T21:55:22.483452+0000","last_clean":"2024-09-15T21:55:22.483452+0000","last_became_active":"2024-09-15T21:55:20.066778+0000","last_became_peered":"2024-09-15T21:55:20.066778+0000","last_unstale":"2024-09-15T21:55:22.483452+0000","last_undegraded":"2024-09-15T21:55:22.483452+0000","last_fullsized":"2024-09-15T21:55:22.483452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:26.867497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035193+0000","last_change":"2024-09-15T21:55:20.035193+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035193+0000","last_undegraded":"2024-09-15T21:55:20.035193+0000","last_fullsized":"2024-09-15T21:55:20.035193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224713+0000","last_change":"2024-09-15T21:55:20.064316+0000","last_active":"2024-09-15T21:55:22.224713+0000","last_peered":"2024-09-15T21:55:22.224713+0000","last_clean":"2024-09-15T21:55:22.224713+0000","last_became_active":"2024-09-15T21:55:20.064010+0000","last_became_peered":"2024-09-15T21:55:20.064010+0000","last_unstale":"2024-09-15T21:55:22.224713+0000","last_undegraded":"2024-09-15T21:55:22.224713+0000","last_fullsized":"2024-09-15T21:55:22.224713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:55.450682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035772+0000","last_change":"2024-09-15T21:55:20.035772+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035772+0000","last_undegraded":"2024-09-15T21:55:20.035772+0000","last_fullsized":"2024-09-15T21:55:20.035772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058366+0000","last_change":"2024-09-15T21:55:20.053996+0000","last_active":"2024-09-15T21:55:20.058366+0000","last_peered":"2024-09-15T21:55:20.058366+0000","last_clean":"2024-09-15T21:55:20.058366+0000","last_became_active":"2024-09-15T21:55:20.053487+0000","last_became_peered":"2024-09-15T21:55:20.053487+0000","last_unstale":"2024-09-15T21:55:20.058366+0000","last_undegraded":"2024-09-15T21:55:20.058366+0000","last_fullsized":"2024-09-15T21:55:20.058366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034206+0000","last_change":"2024-09-15T21:55:20.034206+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034206+0000","last_undegraded":"2024-09-15T21:55:20.034206+0000","last_fullsized":"2024-09-15T21:55:20.034206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058016+0000","last_change":"2024-09-15T21:55:20.055656+0000","last_active":"2024-09-15T21:55:20.058016+0000","last_peered":"2024-09-15T21:55:20.058016+0000","last_clean":"2024-09-15T21:55:20.058016+0000","last_became_active":"2024-09-15T21:55:20.055168+0000","last_became_peered":"2024-09-15T21:55:20.055168+0000","last_unstale":"2024-09-15T21:55:20.058016+0000","last_undegraded":"2024-09-15T21:55:20.058016+0000","last_fullsized":"2024-09-15T21:55:20.058016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.043515+0000","last_change":"2024-09-15T21:55:20.043515+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.043515+0000","last_undegraded":"2024-09-15T21:55:20.043515+0000","last_fullsized":"2024-09-15T21:55:20.043515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484562+0000","last_change":"2024-09-15T21:55:20.067021+0000","last_active":"2024-09-15T21:55:22.484562+0000","last_peered":"2024-09-15T21:55:22.484562+0000","last_clean":"2024-09-15T21:55:22.484562+0000","last_became_active":"2024-09-15T21:55:20.066354+0000","last_became_peered":"2024-09-15T21:55:20.066354+0000","last_unstale":"2024-09-15T21:55:22.484562+0000","last_undegraded":"2024-09-15T21:55:22.484562+0000","last_fullsized":"2024-09-15T21:55:22.484562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:57.837195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038270+0000","last_change":"2024-09-15T21:55:20.038270+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038270+0000","last_undegraded":"2024-09-15T21:55:20.038270+0000","last_fullsized":"2024-09-15T21:55:20.038270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.055851+0000","last_change":"2024-09-15T21:55:20.051483+0000","last_active":"2024-09-15T21:55:20.055851+0000","last_peered":"2024-09-15T21:55:20.055851+0000","last_clean":"2024-09-15T21:55:20.055851+0000","last_became_active":"2024-09-15T21:55:20.051077+0000","last_became_peered":"2024-09-15T21:55:20.051077+0000","last_unstale":"2024-09-15T21:55:20.055851+0000","last_undegraded":"2024-09-15T21:55:20.055851+0000","last_fullsized":"2024-09-15T21:55:20.055851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038175+0000","last_change":"2024-09-15T21:55:20.038175+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038175+0000","last_undegraded":"2024-09-15T21:55:20.038175+0000","last_fullsized":"2024-09-15T21:55:20.038175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.061377+0000","last_change":"2024-09-15T21:55:20.058425+0000","last_active":"2024-09-15T21:55:20.061377+0000","last_peered":"2024-09-15T21:55:20.061377+0000","last_clean":"2024-09-15T21:55:20.061377+0000","last_became_active":"2024-09-15T21:55:20.057897+0000","last_became_peered":"2024-09-15T21:55:20.057897+0000","last_unstale":"2024-09-15T21:55:20.061377+0000","last_undegraded":"2024-09-15T21:55:20.061377+0000","last_fullsized":"2024-09-15T21:55:20.061377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034852+0000","last_change":"2024-09-15T21:55:20.034852+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034852+0000","last_undegraded":"2024-09-15T21:55:20.034852+0000","last_fullsized":"2024-09-15T21:55:20.034852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483454+0000","last_change":"2024-09-15T21:55:20.067341+0000","last_active":"2024-09-15T21:55:22.483454+0000","last_peered":"2024-09-15T21:55:22.483454+0000","last_clean":"2024-09-15T21:55:22.483454+0000","last_became_active":"2024-09-15T21:55:20.066114+0000","last_became_peered":"2024-09-15T21:55:20.066114+0000","last_unstale":"2024-09-15T21:55:22.483454+0000","last_undegraded":"2024-09-15T21:55:22.483454+0000","last_fullsized":"2024-09-15T21:55:22.483454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:54.611870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034522+0000","last_change":"2024-09-15T21:55:20.034522+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034522+0000","last_undegraded":"2024-09-15T21:55:20.034522+0000","last_fullsized":"2024-09-15T21:55:20.034522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058664+0000","last_change":"2024-09-15T21:55:20.057081+0000","last_active":"2024-09-15T21:55:20.058664+0000","last_peered":"2024-09-15T21:55:20.058664+0000","last_clean":"2024-09-15T21:55:20.058664+0000","last_became_active":"2024-09-15T21:55:20.056673+0000","last_became_peered":"2024-09-15T21:55:20.056673+0000","last_unstale":"2024-09-15T21:55:20.058664+0000","last_undegraded":"2024-09-15T21:55:20.058664+0000","last_fullsized":"2024-09-15T21:55:20.058664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:46.832251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.037753+0000","last_change":"2024-09-15T21:55:20.037753+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.037753+0000","last_undegraded":"2024-09-15T21:55:20.037753+0000","last_fullsized":"2024-09-15T21:55:20.037753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.057859+0000","last_change":"2024-09-15T21:55:20.053890+0000","last_active":"2024-09-15T21:55:20.057859+0000","last_peered":"2024-09-15T21:55:20.057859+0000","last_clean":"2024-09-15T21:55:20.057859+0000","last_became_active":"2024-09-15T21:55:20.053359+0000","last_became_peered":"2024-09-15T21:55:20.053359+0000","last_unstale":"2024-09-15T21:55:20.057859+0000","last_undegraded":"2024-09-15T21:55:20.057859+0000","last_fullsized":"2024-09-15T21:55:20.057859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.039942+0000","last_change":"2024-09-15T21:55:20.039942+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.039942+0000","last_undegraded":"2024-09-15T21:55:20.039942+0000","last_fullsized":"2024-09-15T21:55:20.039942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484372+0000","last_change":"2024-09-15T21:55:20.066502+0000","last_active":"2024-09-15T21:55:22.484372+0000","last_peered":"2024-09-15T21:55:22.484372+0000","last_clean":"2024-09-15T21:55:22.484372+0000","last_became_active":"2024-09-15T21:55:20.066143+0000","last_became_peered":"2024-09-15T21:55:20.066143+0000","last_unstale":"2024-09-15T21:55:22.484372+0000","last_undegraded":"2024-09-15T21:55:22.484372+0000","last_fullsized":"2024-09-15T21:55:22.484372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:26.132589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035058+0000","last_change":"2024-09-15T21:55:20.035058+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035058+0000","last_undegraded":"2024-09-15T21:55:20.035058+0000","last_fullsized":"2024-09-15T21:55:20.035058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044376+0000","last_change":"2024-09-15T21:55:20.044376+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044376+0000","last_undegraded":"2024-09-15T21:55:20.044376+0000","last_fullsized":"2024-09-15T21:55:20.044376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483812+0000","last_change":"2024-09-15T21:55:20.069937+0000","last_active":"2024-09-15T21:55:22.483812+0000","last_peered":"2024-09-15T21:55:22.483812+0000","last_clean":"2024-09-15T21:55:22.483812+0000","last_became_active":"2024-09-15T21:55:20.069454+0000","last_became_peered":"2024-09-15T21:55:20.069454+0000","last_unstale":"2024-09-15T21:55:22.483812+0000","last_undegraded":"2024-09-15T21:55:22.483812+0000","last_fullsized":"2024-09-15T21:55:22.483812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:40.942879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040551+0000","last_change":"2024-09-15T21:55:20.040551+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040551+0000","last_undegraded":"2024-09-15T21:55:20.040551+0000","last_fullsized":"2024-09-15T21:55:20.040551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484270+0000","last_change":"2024-09-15T21:55:20.068019+0000","last_active":"2024-09-15T21:55:22.484270+0000","last_peered":"2024-09-15T21:55:22.484270+0000","last_clean":"2024-09-15T21:55:22.484270+0000","last_became_active":"2024-09-15T21:55:20.067127+0000","last_became_peered":"2024-09-15T21:55:20.067127+0000","last_unstale":"2024-09-15T21:55:22.484270+0000","last_undegraded":"2024-09-15T21:55:22.484270+0000","last_fullsized":"2024-09-15T21:55:22.484270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:10.484227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044136+0000","last_change":"2024-09-15T21:55:20.044136+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044136+0000","last_undegraded":"2024-09-15T21:55:20.044136+0000","last_fullsized":"2024-09-15T21:55:20.044136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.063582+0000","last_change":"2024-09-15T21:55:20.055671+0000","last_active":"2024-09-15T21:55:20.063582+0000","last_peered":"2024-09-15T21:55:20.063582+0000","last_clean":"2024-09-15T21:55:20.063582+0000","last_became_active":"2024-09-15T21:55:20.054385+0000","last_became_peered":"2024-09-15T21:55:20.054385+0000","last_unstale":"2024-09-15T21:55:20.063582+0000","last_undegraded":"2024-09-15T21:55:20.063582+0000","last_fullsized":"2024-09-15T21:55:20.063582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:50.157193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036713+0000","last_change":"2024-09-15T21:55:20.036713+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036713+0000","last_undegraded":"2024-09-15T21:55:20.036713+0000","last_fullsized":"2024-09-15T21:55:20.036713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.060487+0000","last_change":"2024-09-15T21:55:20.057739+0000","last_active":"2024-09-15T21:55:20.060487+0000","last_peered":"2024-09-15T21:55:20.060487+0000","last_clean":"2024-09-15T21:55:20.060487+0000","last_became_active":"2024-09-15T21:55:20.056988+0000","last_became_peered":"2024-09-15T21:55:20.056988+0000","last_unstale":"2024-09-15T21:55:20.060487+0000","last_undegraded":"2024-09-15T21:55:20.060487+0000","last_fullsized":"2024-09-15T21:55:20.060487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509443,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:55:25.472 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:55:25.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.617+0000 7f12e3baf640 1 Processor -- start 2024-09-15T21:55:25.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e3baf640 1 -- start start 2024-09-15T21:55:25.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e3baf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f12dc0b5220 0x7f12dc09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e3baf640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f12dc0b5600 0x7f12dc09ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e3baf640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12dc0b6a50 con 0x7f12dc148f20 2024-09-15T21:55:25.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e3baf640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f12dc09b800 con 0x7f12dc0b5600 2024-09-15T21:55:25.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e3baf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f12dc0b4dd0 con 0x7f12dc0b5220 2024-09-15T21:55:25.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e214c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f12dc148f20 0x7f12dc149370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46072/0 (socket says 172.21.15.1:46072) 2024-09-15T21:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e114a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f12dc0b5600 0x7f12dc09ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e214c640 1 -- 172.21.15.1:0/2763295632 learned_addr learned my addr 172.21.15.1:0/2763295632 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e194b640 1 --2- 172.21.15.1:0/2763295632 >> v2:172.21.15.70:3300/0 conn(0x7f12dc0b5220 0x7f12dc09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e0949640 1 -- 172.21.15.1:0/2763295632 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1724143295 0 0) 0x7f12dc0b6a50 con 0x7f12dc148f20 2024-09-15T21:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e0949640 1 -- 172.21.15.1:0/2763295632 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12c8003530 con 0x7f12dc148f20 2024-09-15T21:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e114a640 1 -- 172.21.15.1:0/2763295632 >> v2:172.21.15.70:3300/0 conn(0x7f12dc0b5220 msgr2=0x7f12dc09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e114a640 1 --2- 172.21.15.1:0/2763295632 >> v2:172.21.15.70:3300/0 conn(0x7f12dc0b5220 0x7f12dc09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e114a640 1 -- 172.21.15.1:0/2763295632 >> v1:172.21.15.1:6789/0 conn(0x7f12dc148f20 legacy=0x7f12dc149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e114a640 1 -- 172.21.15.1:0/2763295632 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc09af90 con 0x7f12dc0b5600 2024-09-15T21:55:25.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e114a640 1 --2- 172.21.15.1:0/2763295632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12dc0b5600 0x7f12dc09ee10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0b0400 tx=0x7f12d801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5558fac9369368 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:25.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e0949640 1 -- 172.21.15.1:0/2763295632 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d80b0070 con 0x7f12dc0b5600 2024-09-15T21:55:25.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e0949640 1 -- 172.21.15.1:0/2763295632 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d80ab600 con 0x7f12dc0b5600 2024-09-15T21:55:25.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.621+0000 7f12e0949640 1 -- 172.21.15.1:0/2763295632 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d80ab9b0 con 0x7f12dc0b5600 2024-09-15T21:55:25.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 -- 172.21.15.1:0/2763295632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12dc0b5600 msgr2=0x7f12dc09ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 --2- 172.21.15.1:0/2763295632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12dc0b5600 0x7f12dc09ee10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0b0400 tx=0x7f12d801c330 comp rx=0 tx=0).stop 2024-09-15T21:55:25.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 -- 172.21.15.1:0/2763295632 shutdown_connections 2024-09-15T21:55:25.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 --2- 172.21.15.1:0/2763295632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12dc0b5600 0x7f12dc09ee10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 --2- 172.21.15.1:0/2763295632 >> v2:172.21.15.70:3300/0 conn(0x7f12dc0b5220 0x7f12dc09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 -- 172.21.15.1:0/2763295632 >> 172.21.15.1:0/2763295632 conn(0x7f12dc0b5c40 msgr2=0x7f12dc0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:25.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 -- 172.21.15.1:0/2763295632 shutdown_connections 2024-09-15T21:55:25.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 -- 172.21.15.1:0/2763295632 wait complete. 2024-09-15T21:55:25.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 Processor -- start 2024-09-15T21:55:25.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 -- start start 2024-09-15T21:55:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12dc0b5220 0x7f12dc0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12dc0b5600 0x7f12dc1e35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f12dc148f20 0x7f12dc1e3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc152700 con 0x7f12dc0b5600 2024-09-15T21:55:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc152880 con 0x7f12dc0b5220 2024-09-15T21:55:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f12dc152a00 con 0x7f12dc148f20 2024-09-15T21:55:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e114a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12dc0b5600 0x7f12dc1e35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e114a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12dc0b5600 0x7f12dc1e35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34614/0 (socket says 172.21.15.1:34614) 2024-09-15T21:55:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e114a640 1 -- 172.21.15.1:0/329240566 learned_addr learned my addr 172.21.15.1:0/329240566 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e194b640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12dc0b5220 0x7f12dc0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e214c640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f12dc148f20 0x7f12dc1e3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e114a640 1 -- 172.21.15.1:0/329240566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f12dc148f20 msgr2=0x7f12dc1e3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e114a640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f12dc148f20 0x7f12dc1e3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e114a640 1 -- 172.21.15.1:0/329240566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12dc0b5220 msgr2=0x7f12dc0afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e114a640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12dc0b5220 0x7f12dc0afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e114a640 1 -- 172.21.15.1:0/329240566 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc144830 con 0x7f12dc0b5600 2024-09-15T21:55:25.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e114a640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12dc0b5600 0x7f12dc1e35e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f12d80ae040 tx=0x7f12d80190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:25.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12d27fc640 1 -- 172.21.15.1:0/329240566 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d80b0040 con 0x7f12dc0b5600 2024-09-15T21:55:25.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12d27fc640 1 -- 172.21.15.1:0/329240566 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d8004030 con 0x7f12dc0b5600 2024-09-15T21:55:25.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 -- 172.21.15.1:0/329240566 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12dc073350 con 0x7f12dc0b5600 2024-09-15T21:55:25.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12d27fc640 1 -- 172.21.15.1:0/329240566 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8006e20 con 0x7f12dc0b5600 2024-09-15T21:55:25.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.625+0000 7f12e3baf640 1 -- 172.21.15.1:0/329240566 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12dc144550 con 0x7f12dc0b5600 2024-09-15T21:55:25.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.629+0000 7f12e3baf640 1 -- 172.21.15.1:0/329240566 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12dc0aec90 con 0x7f12dc0b5600 2024-09-15T21:55:25.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.629+0000 7f12d27fc640 1 -- 172.21.15.1:0/329240566 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f12d8003620 con 0x7f12dc0b5600 2024-09-15T21:55:25.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.629+0000 7f12d27fc640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f12c00678c0 0x7f12c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.629+0000 7f12d27fc640 1 -- 172.21.15.1:0/329240566 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f12d811f960 con 0x7f12dc0b5600 2024-09-15T21:55:25.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.629+0000 7f12e194b640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f12c00678c0 0x7f12c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.629+0000 7f12e194b640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f12c00678c0 0x7f12c0069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00b930 tx=0x7f12cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:25.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.633+0000 7f12d27fc640 1 -- 172.21.15.1:0/329240566 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f12d80b8020 con 0x7f12dc0b5600 2024-09-15T21:55:25.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.789+0000 7f12e3baf640 1 -- 172.21.15.1:0/329240566 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12dc0af0c0 con 0x7f12c00678c0 2024-09-15T21:55:25.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.805+0000 7f12d27fc640 1 -- 172.21.15.1:0/329240566 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247717 (secure 0 0 0) 0x7f12dc0af0c0 con 0x7f12c00678c0 2024-09-15T21:55:25.812 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:25.815 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:55:25.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.809+0000 7f12e3baf640 1 -- 172.21.15.1:0/329240566 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f12c00678c0 msgr2=0x7f12c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.809+0000 7f12e3baf640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f12c00678c0 0x7f12c0069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00b930 tx=0x7f12cc008040 comp rx=0 tx=0).stop 2024-09-15T21:55:25.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.809+0000 7f12e3baf640 1 -- 172.21.15.1:0/329240566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12dc0b5600 msgr2=0x7f12dc1e35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.809+0000 7f12e3baf640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12dc0b5600 0x7f12dc1e35e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f12d80ae040 tx=0x7f12d80190d0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.809+0000 7f12e3baf640 1 -- 172.21.15.1:0/329240566 shutdown_connections 2024-09-15T21:55:25.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.809+0000 7f12e3baf640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f12dc148f20 0x7f12dc1e3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.809+0000 7f12e3baf640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f12dc0b5600 0x7f12dc1e35e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.809+0000 7f12e3baf640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f12c00678c0 0x7f12c0069d80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.809+0000 7f12e3baf640 1 --2- 172.21.15.1:0/329240566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12dc0b5220 0x7f12dc0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.809+0000 7f12e3baf640 1 -- 172.21.15.1:0/329240566 >> 172.21.15.1:0/329240566 conn(0x7f12dc0b5c40 msgr2=0x7f12dc0b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:25.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.809+0000 7f12e3baf640 1 -- 172.21.15.1:0/329240566 shutdown_connections 2024-09-15T21:55:25.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.813+0000 7f12e3baf640 1 -- 172.21.15.1:0/329240566 wait complete. 2024-09-15T21:55:25.831 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-15T21:55:25.079422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256252,"kb_used_data":2580,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754718468,"statfs":{"total":773094113280,"available":772831711232,"internally_reserved":0,"allocated":2641920,"data_stored":1647194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.016188"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484762+0000","last_change":"2024-09-15T21:55:21.088474+0000","last_active":"2024-09-15T21:55:22.484762+0000","last_peered":"2024-09-15T21:55:22.484762+0000","last_clean":"2024-09-15T21:55:22.484762+0000","last_became_active":"2024-09-15T21:55:21.088066+0000","last_became_peered":"2024-09-15T21:55:21.088066+0000","last_unstale":"2024-09-15T21:55:22.484762+0000","last_undegraded":"2024-09-15T21:55:22.484762+0000","last_fullsized":"2024-09-15T21:55:22.484762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:35.421317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.037857+0000","last_change":"2024-09-15T21:55:20.037857+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.037857+0000","last_undegraded":"2024-09-15T21:55:20.037857+0000","last_fullsized":"2024-09-15T21:55:20.037857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045680+0000","last_change":"2024-09-15T21:55:20.045680+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045680+0000","last_undegraded":"2024-09-15T21:55:20.045680+0000","last_fullsized":"2024-09-15T21:55:20.045680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.041645+0000","last_change":"2024-09-15T21:55:20.041645+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.041645+0000","last_undegraded":"2024-09-15T21:55:20.041645+0000","last_fullsized":"2024-09-15T21:55:20.041645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484114+0000","last_change":"2024-09-15T21:55:21.081320+0000","last_active":"2024-09-15T21:55:22.484114+0000","last_peered":"2024-09-15T21:55:22.484114+0000","last_clean":"2024-09-15T21:55:22.484114+0000","last_became_active":"2024-09-15T21:55:21.080501+0000","last_became_peered":"2024-09-15T21:55:21.080501+0000","last_unstale":"2024-09-15T21:55:22.484114+0000","last_undegraded":"2024-09-15T21:55:22.484114+0000","last_fullsized":"2024-09-15T21:55:22.484114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:24.528185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.048263+0000","last_change":"2024-09-15T21:55:20.048263+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.048263+0000","last_undegraded":"2024-09-15T21:55:20.048263+0000","last_fullsized":"2024-09-15T21:55:20.048263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483929+0000","last_change":"2024-09-15T21:55:21.081625+0000","last_active":"2024-09-15T21:55:22.483929+0000","last_peered":"2024-09-15T21:55:22.483929+0000","last_clean":"2024-09-15T21:55:22.483929+0000","last_became_active":"2024-09-15T21:55:21.081233+0000","last_became_peered":"2024-09-15T21:55:21.081233+0000","last_unstale":"2024-09-15T21:55:22.483929+0000","last_undegraded":"2024-09-15T21:55:22.483929+0000","last_fullsized":"2024-09-15T21:55:22.483929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:56.638597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.049532+0000","last_change":"2024-09-15T21:55:20.049532+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.049532+0000","last_undegraded":"2024-09-15T21:55:20.049532+0000","last_fullsized":"2024-09-15T21:55:20.049532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485001+0000","last_change":"2024-09-15T21:55:21.094131+0000","last_active":"2024-09-15T21:55:22.485001+0000","last_peered":"2024-09-15T21:55:22.485001+0000","last_clean":"2024-09-15T21:55:22.485001+0000","last_became_active":"2024-09-15T21:55:21.093635+0000","last_became_peered":"2024-09-15T21:55:21.093635+0000","last_unstale":"2024-09-15T21:55:22.485001+0000","last_undegraded":"2024-09-15T21:55:22.485001+0000","last_fullsized":"2024-09-15T21:55:22.485001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.303590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036035+0000","last_change":"2024-09-15T21:55:20.036035+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036035+0000","last_undegraded":"2024-09-15T21:55:20.036035+0000","last_fullsized":"2024-09-15T21:55:20.036035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033278+0000","last_change":"2024-09-15T21:55:20.033278+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033278+0000","last_undegraded":"2024-09-15T21:55:20.033278+0000","last_fullsized":"2024-09-15T21:55:20.033278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.037108+0000","last_change":"2024-09-15T21:55:20.037108+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.037108+0000","last_undegraded":"2024-09-15T21:55:20.037108+0000","last_fullsized":"2024-09-15T21:55:20.037108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.041091+0000","last_change":"2024-09-15T21:55:20.041091+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.041091+0000","last_undegraded":"2024-09-15T21:55:20.041091+0000","last_fullsized":"2024-09-15T21:55:20.041091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045050+0000","last_change":"2024-09-15T21:55:20.045050+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045050+0000","last_undegraded":"2024-09-15T21:55:20.045050+0000","last_fullsized":"2024-09-15T21:55:20.045050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038764+0000","last_change":"2024-09-15T21:55:20.038764+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038764+0000","last_undegraded":"2024-09-15T21:55:20.038764+0000","last_fullsized":"2024-09-15T21:55:20.038764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045788+0000","last_change":"2024-09-15T21:55:20.045788+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045788+0000","last_undegraded":"2024-09-15T21:55:20.045788+0000","last_fullsized":"2024-09-15T21:55:20.045788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044531+0000","last_change":"2024-09-15T21:55:20.044531+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044531+0000","last_undegraded":"2024-09-15T21:55:20.044531+0000","last_fullsized":"2024-09-15T21:55:20.044531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.225030+0000","last_change":"2024-09-15T21:55:21.056138+0000","last_active":"2024-09-15T21:55:22.225030+0000","last_peered":"2024-09-15T21:55:22.225030+0000","last_clean":"2024-09-15T21:55:22.225030+0000","last_became_active":"2024-09-15T21:55:21.055873+0000","last_became_peered":"2024-09-15T21:55:21.055873+0000","last_unstale":"2024-09-15T21:55:22.225030+0000","last_undegraded":"2024-09-15T21:55:22.225030+0000","last_fullsized":"2024-09-15T21:55:22.225030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:11.494691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484459+0000","last_change":"2024-09-15T21:55:21.088654+0000","last_active":"2024-09-15T21:55:22.484459+0000","last_peered":"2024-09-15T21:55:22.484459+0000","last_clean":"2024-09-15T21:55:22.484459+0000","last_became_active":"2024-09-15T21:55:21.087902+0000","last_became_peered":"2024-09-15T21:55:21.087902+0000","last_unstale":"2024-09-15T21:55:22.484459+0000","last_undegraded":"2024-09-15T21:55:22.484459+0000","last_fullsized":"2024-09-15T21:55:22.484459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:40.823067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033749+0000","last_change":"2024-09-15T21:55:20.033749+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033749+0000","last_undegraded":"2024-09-15T21:55:20.033749+0000","last_fullsized":"2024-09-15T21:55:20.033749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.047119+0000","last_change":"2024-09-15T21:55:20.047119+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.047119+0000","last_undegraded":"2024-09-15T21:55:20.047119+0000","last_fullsized":"2024-09-15T21:55:20.047119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.046658+0000","last_change":"2024-09-15T21:55:20.046658+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.046658+0000","last_undegraded":"2024-09-15T21:55:20.046658+0000","last_fullsized":"2024-09-15T21:55:20.046658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040720+0000","last_change":"2024-09-15T21:55:20.040720+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040720+0000","last_undegraded":"2024-09-15T21:55:20.040720+0000","last_fullsized":"2024-09-15T21:55:20.040720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.042262+0000","last_change":"2024-09-15T21:55:20.042262+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.042262+0000","last_undegraded":"2024-09-15T21:55:20.042262+0000","last_fullsized":"2024-09-15T21:55:20.042262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038892+0000","last_change":"2024-09-15T21:55:20.038892+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038892+0000","last_undegraded":"2024-09-15T21:55:20.038892+0000","last_fullsized":"2024-09-15T21:55:20.038892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033476+0000","last_change":"2024-09-15T21:55:20.033476+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033476+0000","last_undegraded":"2024-09-15T21:55:20.033476+0000","last_fullsized":"2024-09-15T21:55:20.033476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038591+0000","last_change":"2024-09-15T21:55:20.038591+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038591+0000","last_undegraded":"2024-09-15T21:55:20.038591+0000","last_fullsized":"2024-09-15T21:55:20.038591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.041805+0000","last_change":"2024-09-15T21:55:20.041805+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.041805+0000","last_undegraded":"2024-09-15T21:55:20.041805+0000","last_fullsized":"2024-09-15T21:55:20.041805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040398+0000","last_change":"2024-09-15T21:55:20.040398+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040398+0000","last_undegraded":"2024-09-15T21:55:20.040398+0000","last_fullsized":"2024-09-15T21:55:20.040398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044672+0000","last_change":"2024-09-15T21:55:20.044672+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044672+0000","last_undegraded":"2024-09-15T21:55:20.044672+0000","last_fullsized":"2024-09-15T21:55:20.044672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224741+0000","last_change":"2024-09-15T21:55:21.084544+0000","last_active":"2024-09-15T21:55:22.224741+0000","last_peered":"2024-09-15T21:55:22.224741+0000","last_clean":"2024-09-15T21:55:22.224741+0000","last_became_active":"2024-09-15T21:55:21.084180+0000","last_became_peered":"2024-09-15T21:55:21.084180+0000","last_unstale":"2024-09-15T21:55:22.224741+0000","last_undegraded":"2024-09-15T21:55:22.224741+0000","last_fullsized":"2024-09-15T21:55:22.224741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:41.953343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035371+0000","last_change":"2024-09-15T21:55:20.035371+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035371+0000","last_undegraded":"2024-09-15T21:55:20.035371+0000","last_fullsized":"2024-09-15T21:55:20.035371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036019+0000","last_change":"2024-09-15T21:55:20.036019+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036019+0000","last_undegraded":"2024-09-15T21:55:20.036019+0000","last_fullsized":"2024-09-15T21:55:20.036019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.067335+0000","last_change":"2024-09-15T21:55:20.066836+0000","last_active":"2024-09-15T21:55:20.067335+0000","last_peered":"2024-09-15T21:55:20.067335+0000","last_clean":"2024-09-15T21:55:20.067335+0000","last_became_active":"2024-09-15T21:55:20.066434+0000","last_became_peered":"2024-09-15T21:55:20.066434+0000","last_unstale":"2024-09-15T21:55:20.067335+0000","last_undegraded":"2024-09-15T21:55:20.067335+0000","last_fullsized":"2024-09-15T21:55:20.067335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036377+0000","last_change":"2024-09-15T21:55:20.036377+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036377+0000","last_undegraded":"2024-09-15T21:55:20.036377+0000","last_fullsized":"2024-09-15T21:55:20.036377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.056086+0000","last_change":"2024-09-15T21:55:20.049677+0000","last_active":"2024-09-15T21:55:20.056086+0000","last_peered":"2024-09-15T21:55:20.056086+0000","last_clean":"2024-09-15T21:55:20.056086+0000","last_became_active":"2024-09-15T21:55:20.046329+0000","last_became_peered":"2024-09-15T21:55:20.046329+0000","last_unstale":"2024-09-15T21:55:20.056086+0000","last_undegraded":"2024-09-15T21:55:20.056086+0000","last_fullsized":"2024-09-15T21:55:20.056086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.063529+0000","last_change":"2024-09-15T21:55:20.056808+0000","last_active":"2024-09-15T21:55:20.063529+0000","last_peered":"2024-09-15T21:55:20.063529+0000","last_clean":"2024-09-15T21:55:20.063529+0000","last_became_active":"2024-09-15T21:55:20.055774+0000","last_became_peered":"2024-09-15T21:55:20.055774+0000","last_unstale":"2024-09-15T21:55:20.063529+0000","last_undegraded":"2024-09-15T21:55:20.063529+0000","last_fullsized":"2024-09-15T21:55:20.063529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040547+0000","last_change":"2024-09-15T21:55:20.040547+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040547+0000","last_undegraded":"2024-09-15T21:55:20.040547+0000","last_fullsized":"2024-09-15T21:55:20.040547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.056445+0000","last_change":"2024-09-15T21:55:20.052880+0000","last_active":"2024-09-15T21:55:20.056445+0000","last_peered":"2024-09-15T21:55:20.056445+0000","last_clean":"2024-09-15T21:55:20.056445+0000","last_became_active":"2024-09-15T21:55:20.052076+0000","last_became_peered":"2024-09-15T21:55:20.052076+0000","last_unstale":"2024-09-15T21:55:20.056445+0000","last_undegraded":"2024-09-15T21:55:20.056445+0000","last_fullsized":"2024-09-15T21:55:20.056445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045423+0000","last_change":"2024-09-15T21:55:20.045423+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045423+0000","last_undegraded":"2024-09-15T21:55:20.045423+0000","last_fullsized":"2024-09-15T21:55:20.045423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.057146+0000","last_change":"2024-09-15T21:55:20.054769+0000","last_active":"2024-09-15T21:55:20.057146+0000","last_peered":"2024-09-15T21:55:20.057146+0000","last_clean":"2024-09-15T21:55:20.057146+0000","last_became_active":"2024-09-15T21:55:20.053983+0000","last_became_peered":"2024-09-15T21:55:20.053983+0000","last_unstale":"2024-09-15T21:55:20.057146+0000","last_undegraded":"2024-09-15T21:55:20.057146+0000","last_fullsized":"2024-09-15T21:55:20.057146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045646+0000","last_change":"2024-09-15T21:55:20.045646+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045646+0000","last_undegraded":"2024-09-15T21:55:20.045646+0000","last_fullsized":"2024-09-15T21:55:20.045646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058304+0000","last_change":"2024-09-15T21:55:20.055173+0000","last_active":"2024-09-15T21:55:20.058304+0000","last_peered":"2024-09-15T21:55:20.058304+0000","last_clean":"2024-09-15T21:55:20.058304+0000","last_became_active":"2024-09-15T21:55:20.054689+0000","last_became_peered":"2024-09-15T21:55:20.054689+0000","last_unstale":"2024-09-15T21:55:20.058304+0000","last_undegraded":"2024-09-15T21:55:20.058304+0000","last_fullsized":"2024-09-15T21:55:20.058304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040720+0000","last_change":"2024-09-15T21:55:20.040720+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040720+0000","last_undegraded":"2024-09-15T21:55:20.040720+0000","last_fullsized":"2024-09-15T21:55:20.040720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058047+0000","last_change":"2024-09-15T21:55:20.054045+0000","last_active":"2024-09-15T21:55:20.058047+0000","last_peered":"2024-09-15T21:55:20.058047+0000","last_clean":"2024-09-15T21:55:20.058047+0000","last_became_active":"2024-09-15T21:55:20.053600+0000","last_became_peered":"2024-09-15T21:55:20.053600+0000","last_unstale":"2024-09-15T21:55:20.058047+0000","last_undegraded":"2024-09-15T21:55:20.058047+0000","last_fullsized":"2024-09-15T21:55:20.058047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035990+0000","last_change":"2024-09-15T21:55:20.035990+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035990+0000","last_undegraded":"2024-09-15T21:55:20.035990+0000","last_fullsized":"2024-09-15T21:55:20.035990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.057003+0000","last_change":"2024-09-15T21:55:20.053664+0000","last_active":"2024-09-15T21:55:20.057003+0000","last_peered":"2024-09-15T21:55:20.057003+0000","last_clean":"2024-09-15T21:55:20.057003+0000","last_became_active":"2024-09-15T21:55:20.051430+0000","last_became_peered":"2024-09-15T21:55:20.051430+0000","last_unstale":"2024-09-15T21:55:20.057003+0000","last_undegraded":"2024-09-15T21:55:20.057003+0000","last_fullsized":"2024-09-15T21:55:20.057003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483958+0000","last_change":"2024-09-15T21:55:21.081085+0000","last_active":"2024-09-15T21:55:22.483958+0000","last_peered":"2024-09-15T21:55:22.483958+0000","last_clean":"2024-09-15T21:55:22.483958+0000","last_became_active":"2024-09-15T21:55:21.080302+0000","last_became_peered":"2024-09-15T21:55:21.080302+0000","last_unstale":"2024-09-15T21:55:22.483958+0000","last_undegraded":"2024-09-15T21:55:22.483958+0000","last_fullsized":"2024-09-15T21:55:22.483958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:35.161272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.054999+0000","last_change":"2024-09-15T21:55:20.050298+0000","last_active":"2024-09-15T21:55:20.054999+0000","last_peered":"2024-09-15T21:55:20.054999+0000","last_clean":"2024-09-15T21:55:20.054999+0000","last_became_active":"2024-09-15T21:55:20.049086+0000","last_became_peered":"2024-09-15T21:55:20.049086+0000","last_unstale":"2024-09-15T21:55:20.054999+0000","last_undegraded":"2024-09-15T21:55:20.054999+0000","last_fullsized":"2024-09-15T21:55:20.054999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034751+0000","last_change":"2024-09-15T21:55:20.034751+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034751+0000","last_undegraded":"2024-09-15T21:55:20.034751+0000","last_fullsized":"2024-09-15T21:55:20.034751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.070744+0000","last_change":"2024-09-15T21:55:20.067348+0000","last_active":"2024-09-15T21:55:20.070744+0000","last_peered":"2024-09-15T21:55:20.070744+0000","last_clean":"2024-09-15T21:55:20.070744+0000","last_became_active":"2024-09-15T21:55:20.066912+0000","last_became_peered":"2024-09-15T21:55:20.066912+0000","last_unstale":"2024-09-15T21:55:20.070744+0000","last_undegraded":"2024-09-15T21:55:20.070744+0000","last_fullsized":"2024-09-15T21:55:20.070744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484340+0000","last_change":"2024-09-15T21:55:21.092869+0000","last_active":"2024-09-15T21:55:22.484340+0000","last_peered":"2024-09-15T21:55:22.484340+0000","last_clean":"2024-09-15T21:55:22.484340+0000","last_became_active":"2024-09-15T21:55:21.092360+0000","last_became_peered":"2024-09-15T21:55:21.092360+0000","last_unstale":"2024-09-15T21:55:22.484340+0000","last_undegraded":"2024-09-15T21:55:22.484340+0000","last_fullsized":"2024-09-15T21:55:22.484340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:08.584649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.056104+0000","last_change":"2024-09-15T21:55:20.046741+0000","last_active":"2024-09-15T21:55:20.056104+0000","last_peered":"2024-09-15T21:55:20.056104+0000","last_clean":"2024-09-15T21:55:20.056104+0000","last_became_active":"2024-09-15T21:55:20.044504+0000","last_became_peered":"2024-09-15T21:55:20.044504+0000","last_unstale":"2024-09-15T21:55:20.056104+0000","last_undegraded":"2024-09-15T21:55:20.056104+0000","last_fullsized":"2024-09-15T21:55:20.056104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033086+0000","last_change":"2024-09-15T21:55:20.033086+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033086+0000","last_undegraded":"2024-09-15T21:55:20.033086+0000","last_fullsized":"2024-09-15T21:55:20.033086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224516+0000","last_change":"2024-09-15T21:55:20.045879+0000","last_active":"2024-09-15T21:55:22.224516+0000","last_peered":"2024-09-15T21:55:22.224516+0000","last_clean":"2024-09-15T21:55:22.224516+0000","last_became_active":"2024-09-15T21:55:20.045166+0000","last_became_peered":"2024-09-15T21:55:20.045166+0000","last_unstale":"2024-09-15T21:55:22.224516+0000","last_undegraded":"2024-09-15T21:55:22.224516+0000","last_fullsized":"2024-09-15T21:55:22.224516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:27.871582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484582+0000","last_change":"2024-09-15T21:55:21.091543+0000","last_active":"2024-09-15T21:55:22.484582+0000","last_peered":"2024-09-15T21:55:22.484582+0000","last_clean":"2024-09-15T21:55:22.484582+0000","last_became_active":"2024-09-15T21:55:21.088040+0000","last_became_peered":"2024-09-15T21:55:21.088040+0000","last_unstale":"2024-09-15T21:55:22.484582+0000","last_undegraded":"2024-09-15T21:55:22.484582+0000","last_fullsized":"2024-09-15T21:55:22.484582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:58.437513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.064056+0000","last_change":"2024-09-15T21:55:20.060882+0000","last_active":"2024-09-15T21:55:20.064056+0000","last_peered":"2024-09-15T21:55:20.064056+0000","last_clean":"2024-09-15T21:55:20.064056+0000","last_became_active":"2024-09-15T21:55:20.059856+0000","last_became_peered":"2024-09-15T21:55:20.059856+0000","last_unstale":"2024-09-15T21:55:20.064056+0000","last_undegraded":"2024-09-15T21:55:20.064056+0000","last_fullsized":"2024-09-15T21:55:20.064056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484517+0000","last_change":"2024-09-15T21:55:21.088545+0000","last_active":"2024-09-15T21:55:22.484517+0000","last_peered":"2024-09-15T21:55:22.484517+0000","last_clean":"2024-09-15T21:55:22.484517+0000","last_became_active":"2024-09-15T21:55:21.080729+0000","last_became_peered":"2024-09-15T21:55:21.080729+0000","last_unstale":"2024-09-15T21:55:22.484517+0000","last_undegraded":"2024-09-15T21:55:22.484517+0000","last_fullsized":"2024-09-15T21:55:22.484517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:10.451575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224968+0000","last_change":"2024-09-15T21:55:20.053774+0000","last_active":"2024-09-15T21:55:22.224968+0000","last_peered":"2024-09-15T21:55:22.224968+0000","last_clean":"2024-09-15T21:55:22.224968+0000","last_became_active":"2024-09-15T21:55:20.053417+0000","last_became_peered":"2024-09-15T21:55:20.053417+0000","last_unstale":"2024-09-15T21:55:22.224968+0000","last_undegraded":"2024-09-15T21:55:22.224968+0000","last_fullsized":"2024-09-15T21:55:22.224968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:42:50.046558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484974+0000","last_change":"2024-09-15T21:55:21.088812+0000","last_active":"2024-09-15T21:55:22.484974+0000","last_peered":"2024-09-15T21:55:22.484974+0000","last_clean":"2024-09-15T21:55:22.484974+0000","last_became_active":"2024-09-15T21:55:21.088403+0000","last_became_peered":"2024-09-15T21:55:21.088403+0000","last_unstale":"2024-09-15T21:55:22.484974+0000","last_undegraded":"2024-09-15T21:55:22.484974+0000","last_fullsized":"2024-09-15T21:55:22.484974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:53:46.896732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.051966+0000","last_change":"2024-09-15T21:55:20.049155+0000","last_active":"2024-09-15T21:55:20.051966+0000","last_peered":"2024-09-15T21:55:20.051966+0000","last_clean":"2024-09-15T21:55:20.051966+0000","last_became_active":"2024-09-15T21:55:20.048758+0000","last_became_peered":"2024-09-15T21:55:20.048758+0000","last_unstale":"2024-09-15T21:55:20.051966+0000","last_undegraded":"2024-09-15T21:55:20.051966+0000","last_fullsized":"2024-09-15T21:55:20.051966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.039420+0000","last_change":"2024-09-15T21:55:20.039420+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.039420+0000","last_undegraded":"2024-09-15T21:55:20.039420+0000","last_fullsized":"2024-09-15T21:55:20.039420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224802+0000","last_change":"2024-09-15T21:55:20.057638+0000","last_active":"2024-09-15T21:55:22.224802+0000","last_peered":"2024-09-15T21:55:22.224802+0000","last_clean":"2024-09-15T21:55:22.224802+0000","last_became_active":"2024-09-15T21:55:20.057104+0000","last_became_peered":"2024-09-15T21:55:20.057104+0000","last_unstale":"2024-09-15T21:55:22.224802+0000","last_undegraded":"2024-09-15T21:55:22.224802+0000","last_fullsized":"2024-09-15T21:55:22.224802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:46.407918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484034+0000","last_change":"2024-09-15T21:55:21.092764+0000","last_active":"2024-09-15T21:55:22.484034+0000","last_peered":"2024-09-15T21:55:22.484034+0000","last_clean":"2024-09-15T21:55:22.484034+0000","last_became_active":"2024-09-15T21:55:21.092278+0000","last_became_peered":"2024-09-15T21:55:21.092278+0000","last_unstale":"2024-09-15T21:55:22.484034+0000","last_undegraded":"2024-09-15T21:55:22.484034+0000","last_fullsized":"2024-09-15T21:55:22.484034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:16.853013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483633+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:22.483633+0000","last_peered":"2024-09-15T21:55:22.483633+0000","last_clean":"2024-09-15T21:55:22.483633+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:22.483633+0000","last_undegraded":"2024-09-15T21:55:22.483633+0000","last_fullsized":"2024-09-15T21:55:22.483633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.063634+0000","last_change":"2024-09-15T21:55:20.062164+0000","last_active":"2024-09-15T21:55:20.063634+0000","last_peered":"2024-09-15T21:55:20.063634+0000","last_clean":"2024-09-15T21:55:20.063634+0000","last_became_active":"2024-09-15T21:55:20.061451+0000","last_became_peered":"2024-09-15T21:55:20.061451+0000","last_unstale":"2024-09-15T21:55:20.063634+0000","last_undegraded":"2024-09-15T21:55:20.063634+0000","last_fullsized":"2024-09-15T21:55:20.063634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035398+0000","last_change":"2024-09-15T21:55:20.035398+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035398+0000","last_undegraded":"2024-09-15T21:55:20.035398+0000","last_fullsized":"2024-09-15T21:55:20.035398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483452+0000","last_change":"2024-09-15T21:55:20.067427+0000","last_active":"2024-09-15T21:55:22.483452+0000","last_peered":"2024-09-15T21:55:22.483452+0000","last_clean":"2024-09-15T21:55:22.483452+0000","last_became_active":"2024-09-15T21:55:20.066778+0000","last_became_peered":"2024-09-15T21:55:20.066778+0000","last_unstale":"2024-09-15T21:55:22.483452+0000","last_undegraded":"2024-09-15T21:55:22.483452+0000","last_fullsized":"2024-09-15T21:55:22.483452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:26.867497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035193+0000","last_change":"2024-09-15T21:55:20.035193+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035193+0000","last_undegraded":"2024-09-15T21:55:20.035193+0000","last_fullsized":"2024-09-15T21:55:20.035193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224713+0000","last_change":"2024-09-15T21:55:20.064316+0000","last_active":"2024-09-15T21:55:22.224713+0000","last_peered":"2024-09-15T21:55:22.224713+0000","last_clean":"2024-09-15T21:55:22.224713+0000","last_became_active":"2024-09-15T21:55:20.064010+0000","last_became_peered":"2024-09-15T21:55:20.064010+0000","last_unstale":"2024-09-15T21:55:22.224713+0000","last_undegraded":"2024-09-15T21:55:22.224713+0000","last_fullsized":"2024-09-15T21:55:22.224713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:55.450682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035772+0000","last_change":"2024-09-15T21:55:20.035772+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035772+0000","last_undegraded":"2024-09-15T21:55:20.035772+0000","last_fullsized":"2024-09-15T21:55:20.035772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058366+0000","last_change":"2024-09-15T21:55:20.053996+0000","last_active":"2024-09-15T21:55:20.058366+0000","last_peered":"2024-09-15T21:55:20.058366+0000","last_clean":"2024-09-15T21:55:20.058366+0000","last_became_active":"2024-09-15T21:55:20.053487+0000","last_became_peered":"2024-09-15T21:55:20.053487+0000","last_unstale":"2024-09-15T21:55:20.058366+0000","last_undegraded":"2024-09-15T21:55:20.058366+0000","last_fullsized":"2024-09-15T21:55:20.058366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034206+0000","last_change":"2024-09-15T21:55:20.034206+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034206+0000","last_undegraded":"2024-09-15T21:55:20.034206+0000","last_fullsized":"2024-09-15T21:55:20.034206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058016+0000","last_change":"2024-09-15T21:55:20.055656+0000","last_active":"2024-09-15T21:55:20.058016+0000","last_peered":"2024-09-15T21:55:20.058016+0000","last_clean":"2024-09-15T21:55:20.058016+0000","last_became_active":"2024-09-15T21:55:20.055168+0000","last_became_peered":"2024-09-15T21:55:20.055168+0000","last_unstale":"2024-09-15T21:55:20.058016+0000","last_undegraded":"2024-09-15T21:55:20.058016+0000","last_fullsized":"2024-09-15T21:55:20.058016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.043515+0000","last_change":"2024-09-15T21:55:20.043515+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.043515+0000","last_undegraded":"2024-09-15T21:55:20.043515+0000","last_fullsized":"2024-09-15T21:55:20.043515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484562+0000","last_change":"2024-09-15T21:55:20.067021+0000","last_active":"2024-09-15T21:55:22.484562+0000","last_peered":"2024-09-15T21:55:22.484562+0000","last_clean":"2024-09-15T21:55:22.484562+0000","last_became_active":"2024-09-15T21:55:20.066354+0000","last_became_peered":"2024-09-15T21:55:20.066354+0000","last_unstale":"2024-09-15T21:55:22.484562+0000","last_undegraded":"2024-09-15T21:55:22.484562+0000","last_fullsized":"2024-09-15T21:55:22.484562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:57.837195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038270+0000","last_change":"2024-09-15T21:55:20.038270+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038270+0000","last_undegraded":"2024-09-15T21:55:20.038270+0000","last_fullsized":"2024-09-15T21:55:20.038270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.055851+0000","last_change":"2024-09-15T21:55:20.051483+0000","last_active":"2024-09-15T21:55:20.055851+0000","last_peered":"2024-09-15T21:55:20.055851+0000","last_clean":"2024-09-15T21:55:20.055851+0000","last_became_active":"2024-09-15T21:55:20.051077+0000","last_became_peered":"2024-09-15T21:55:20.051077+0000","last_unstale":"2024-09-15T21:55:20.055851+0000","last_undegraded":"2024-09-15T21:55:20.055851+0000","last_fullsized":"2024-09-15T21:55:20.055851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038175+0000","last_change":"2024-09-15T21:55:20.038175+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038175+0000","last_undegraded":"2024-09-15T21:55:20.038175+0000","last_fullsized":"2024-09-15T21:55:20.038175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.061377+0000","last_change":"2024-09-15T21:55:20.058425+0000","last_active":"2024-09-15T21:55:20.061377+0000","last_peered":"2024-09-15T21:55:20.061377+0000","last_clean":"2024-09-15T21:55:20.061377+0000","last_became_active":"2024-09-15T21:55:20.057897+0000","last_became_peered":"2024-09-15T21:55:20.057897+0000","last_unstale":"2024-09-15T21:55:20.061377+0000","last_undegraded":"2024-09-15T21:55:20.061377+0000","last_fullsized":"2024-09-15T21:55:20.061377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034852+0000","last_change":"2024-09-15T21:55:20.034852+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034852+0000","last_undegraded":"2024-09-15T21:55:20.034852+0000","last_fullsized":"2024-09-15T21:55:20.034852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483454+0000","last_change":"2024-09-15T21:55:20.067341+0000","last_active":"2024-09-15T21:55:22.483454+0000","last_peered":"2024-09-15T21:55:22.483454+0000","last_clean":"2024-09-15T21:55:22.483454+0000","last_became_active":"2024-09-15T21:55:20.066114+0000","last_became_peered":"2024-09-15T21:55:20.066114+0000","last_unstale":"2024-09-15T21:55:22.483454+0000","last_undegraded":"2024-09-15T21:55:22.483454+0000","last_fullsized":"2024-09-15T21:55:22.483454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:54.611870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034522+0000","last_change":"2024-09-15T21:55:20.034522+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034522+0000","last_undegraded":"2024-09-15T21:55:20.034522+0000","last_fullsized":"2024-09-15T21:55:20.034522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058664+0000","last_change":"2024-09-15T21:55:20.057081+0000","last_active":"2024-09-15T21:55:20.058664+0000","last_peered":"2024-09-15T21:55:20.058664+0000","last_clean":"2024-09-15T21:55:20.058664+0000","last_became_active":"2024-09-15T21:55:20.056673+0000","last_became_peered":"2024-09-15T21:55:20.056673+0000","last_unstale":"2024-09-15T21:55:20.058664+0000","last_undegraded":"2024-09-15T21:55:20.058664+0000","last_fullsized":"2024-09-15T21:55:20.058664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:46.832251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.037753+0000","last_change":"2024-09-15T21:55:20.037753+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.037753+0000","last_undegraded":"2024-09-15T21:55:20.037753+0000","last_fullsized":"2024-09-15T21:55:20.037753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.057859+0000","last_change":"2024-09-15T21:55:20.053890+0000","last_active":"2024-09-15T21:55:20.057859+0000","last_peered":"2024-09-15T21:55:20.057859+0000","last_clean":"2024-09-15T21:55:20.057859+0000","last_became_active":"2024-09-15T21:55:20.053359+0000","last_became_peered":"2024-09-15T21:55:20.053359+0000","last_unstale":"2024-09-15T21:55:20.057859+0000","last_undegraded":"2024-09-15T21:55:20.057859+0000","last_fullsized":"2024-09-15T21:55:20.057859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.039942+0000","last_change":"2024-09-15T21:55:20.039942+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.039942+0000","last_undegraded":"2024-09-15T21:55:20.039942+0000","last_fullsized":"2024-09-15T21:55:20.039942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484372+0000","last_change":"2024-09-15T21:55:20.066502+0000","last_active":"2024-09-15T21:55:22.484372+0000","last_peered":"2024-09-15T21:55:22.484372+0000","last_clean":"2024-09-15T21:55:22.484372+0000","last_became_active":"2024-09-15T21:55:20.066143+0000","last_became_peered":"2024-09-15T21:55:20.066143+0000","last_unstale":"2024-09-15T21:55:22.484372+0000","last_undegraded":"2024-09-15T21:55:22.484372+0000","last_fullsized":"2024-09-15T21:55:22.484372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:26.132589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035058+0000","last_change":"2024-09-15T21:55:20.035058+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035058+0000","last_undegraded":"2024-09-15T21:55:20.035058+0000","last_fullsized":"2024-09-15T21:55:20.035058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044376+0000","last_change":"2024-09-15T21:55:20.044376+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044376+0000","last_undegraded":"2024-09-15T21:55:20.044376+0000","last_fullsized":"2024-09-15T21:55:20.044376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483812+0000","last_change":"2024-09-15T21:55:20.069937+0000","last_active":"2024-09-15T21:55:22.483812+0000","last_peered":"2024-09-15T21:55:22.483812+0000","last_clean":"2024-09-15T21:55:22.483812+0000","last_became_active":"2024-09-15T21:55:20.069454+0000","last_became_peered":"2024-09-15T21:55:20.069454+0000","last_unstale":"2024-09-15T21:55:22.483812+0000","last_undegraded":"2024-09-15T21:55:22.483812+0000","last_fullsized":"2024-09-15T21:55:22.483812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:40.942879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040551+0000","last_change":"2024-09-15T21:55:20.040551+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040551+0000","last_undegraded":"2024-09-15T21:55:20.040551+0000","last_fullsized":"2024-09-15T21:55:20.040551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484270+0000","last_change":"2024-09-15T21:55:20.068019+0000","last_active":"2024-09-15T21:55:22.484270+0000","last_peered":"2024-09-15T21:55:22.484270+0000","last_clean":"2024-09-15T21:55:22.484270+0000","last_became_active":"2024-09-15T21:55:20.067127+0000","last_became_peered":"2024-09-15T21:55:20.067127+0000","last_unstale":"2024-09-15T21:55:22.484270+0000","last_undegraded":"2024-09-15T21:55:22.484270+0000","last_fullsized":"2024-09-15T21:55:22.484270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:10.484227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044136+0000","last_change":"2024-09-15T21:55:20.044136+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044136+0000","last_undegraded":"2024-09-15T21:55:20.044136+0000","last_fullsized":"2024-09-15T21:55:20.044136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.063582+0000","last_change":"2024-09-15T21:55:20.055671+0000","last_active":"2024-09-15T21:55:20.063582+0000","last_peered":"2024-09-15T21:55:20.063582+0000","last_clean":"2024-09-15T21:55:20.063582+0000","last_became_active":"2024-09-15T21:55:20.054385+0000","last_became_peered":"2024-09-15T21:55:20.054385+0000","last_unstale":"2024-09-15T21:55:20.063582+0000","last_undegraded":"2024-09-15T21:55:20.063582+0000","last_fullsized":"2024-09-15T21:55:20.063582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:50.157193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036713+0000","last_change":"2024-09-15T21:55:20.036713+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036713+0000","last_undegraded":"2024-09-15T21:55:20.036713+0000","last_fullsized":"2024-09-15T21:55:20.036713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.060487+0000","last_change":"2024-09-15T21:55:20.057739+0000","last_active":"2024-09-15T21:55:20.060487+0000","last_peered":"2024-09-15T21:55:20.060487+0000","last_clean":"2024-09-15T21:55:20.060487+0000","last_became_active":"2024-09-15T21:55:20.056988+0000","last_became_peered":"2024-09-15T21:55:20.056988+0000","last_unstale":"2024-09-15T21:55:20.060487+0000","last_undegraded":"2024-09-15T21:55:20.060487+0000","last_fullsized":"2024-09-15T21:55:20.060487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509443,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:55:25.834 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-15T21:55:25.834 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.037857+0000', 'last_change': '2024-09-15T21:55:20.037857+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.037857+0000', 'last_undegraded': '2024-09-15T21:55:20.037857+0000', 'last_fullsized': '2024-09-15T21:55:20.037857+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:55:25.835 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-15T21:55:25.835 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.045680+0000', 'last_change': '2024-09-15T21:55:20.045680+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.045680+0000', 'last_undegraded': '2024-09-15T21:55:20.045680+0000', 'last_fullsized': '2024-09-15T21:55:20.045680+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:55:25.835 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-15T21:55:25.835 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.041645+0000', 'last_change': '2024-09-15T21:55:20.041645+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.041645+0000', 'last_undegraded': '2024-09-15T21:55:20.041645+0000', 'last_fullsized': '2024-09-15T21:55:20.041645+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:55:25.835 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-15T21:55:25.835 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.048263+0000', 'last_change': '2024-09-15T21:55:20.048263+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.048263+0000', 'last_undegraded': '2024-09-15T21:55:20.048263+0000', 'last_fullsized': '2024-09-15T21:55:20.048263+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:55:25.835 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-15T21:55:25.835 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.049532+0000', 'last_change': '2024-09-15T21:55:20.049532+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.049532+0000', 'last_undegraded': '2024-09-15T21:55:20.049532+0000', 'last_fullsized': '2024-09-15T21:55:20.049532+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:55:25.835 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-15T21:55:25.835 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.036035+0000', 'last_change': '2024-09-15T21:55:20.036035+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.036035+0000', 'last_undegraded': '2024-09-15T21:55:20.036035+0000', 'last_fullsized': '2024-09-15T21:55:20.036035+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T21:55:25.835 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-15T21:55:25.836 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.033278+0000', 'last_change': '2024-09-15T21:55:20.033278+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.033278+0000', 'last_undegraded': '2024-09-15T21:55:20.033278+0000', 'last_fullsized': '2024-09-15T21:55:20.033278+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T21:55:25.836 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-15T21:55:25.836 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.037108+0000', 'last_change': '2024-09-15T21:55:20.037108+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.037108+0000', 'last_undegraded': '2024-09-15T21:55:20.037108+0000', 'last_fullsized': '2024-09-15T21:55:20.037108+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T21:55:25.836 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-15T21:55:25.836 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.041091+0000', 'last_change': '2024-09-15T21:55:20.041091+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.041091+0000', 'last_undegraded': '2024-09-15T21:55:20.041091+0000', 'last_fullsized': '2024-09-15T21:55:20.041091+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:55:25.836 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-15T21:55:25.836 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.045050+0000', 'last_change': '2024-09-15T21:55:20.045050+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.045050+0000', 'last_undegraded': '2024-09-15T21:55:20.045050+0000', 'last_fullsized': '2024-09-15T21:55:20.045050+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:55:25.836 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-15T21:55:25.836 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.038764+0000', 'last_change': '2024-09-15T21:55:20.038764+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.038764+0000', 'last_undegraded': '2024-09-15T21:55:20.038764+0000', 'last_fullsized': '2024-09-15T21:55:20.038764+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:55:25.836 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-15T21:55:25.836 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.045788+0000', 'last_change': '2024-09-15T21:55:20.045788+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.045788+0000', 'last_undegraded': '2024-09-15T21:55:20.045788+0000', 'last_fullsized': '2024-09-15T21:55:20.045788+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:55:25.836 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-15T21:55:25.836 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.044531+0000', 'last_change': '2024-09-15T21:55:20.044531+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.044531+0000', 'last_undegraded': '2024-09-15T21:55:20.044531+0000', 'last_fullsized': '2024-09-15T21:55:20.044531+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:55:25.837 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-15T21:55:25.837 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.033749+0000', 'last_change': '2024-09-15T21:55:20.033749+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.033749+0000', 'last_undegraded': '2024-09-15T21:55:20.033749+0000', 'last_fullsized': '2024-09-15T21:55:20.033749+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T21:55:25.837 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-15T21:55:25.837 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.047119+0000', 'last_change': '2024-09-15T21:55:20.047119+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.047119+0000', 'last_undegraded': '2024-09-15T21:55:20.047119+0000', 'last_fullsized': '2024-09-15T21:55:20.047119+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:55:25.837 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-15T21:55:25.837 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.046658+0000', 'last_change': '2024-09-15T21:55:20.046658+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.046658+0000', 'last_undegraded': '2024-09-15T21:55:20.046658+0000', 'last_fullsized': '2024-09-15T21:55:20.046658+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:55:25.837 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-15T21:55:25.837 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.040720+0000', 'last_change': '2024-09-15T21:55:20.040720+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.040720+0000', 'last_undegraded': '2024-09-15T21:55:20.040720+0000', 'last_fullsized': '2024-09-15T21:55:20.040720+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:55:25.837 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-15T21:55:25.837 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.042262+0000', 'last_change': '2024-09-15T21:55:20.042262+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.042262+0000', 'last_undegraded': '2024-09-15T21:55:20.042262+0000', 'last_fullsized': '2024-09-15T21:55:20.042262+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:55:25.837 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-15T21:55:25.837 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.038892+0000', 'last_change': '2024-09-15T21:55:20.038892+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.038892+0000', 'last_undegraded': '2024-09-15T21:55:20.038892+0000', 'last_fullsized': '2024-09-15T21:55:20.038892+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:55:25.838 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-15T21:55:25.838 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.033476+0000', 'last_change': '2024-09-15T21:55:20.033476+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.033476+0000', 'last_undegraded': '2024-09-15T21:55:20.033476+0000', 'last_fullsized': '2024-09-15T21:55:20.033476+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T21:55:25.838 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-15T21:55:25.838 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.038591+0000', 'last_change': '2024-09-15T21:55:20.038591+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.038591+0000', 'last_undegraded': '2024-09-15T21:55:20.038591+0000', 'last_fullsized': '2024-09-15T21:55:20.038591+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:55:25.838 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-15T21:55:25.838 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.041805+0000', 'last_change': '2024-09-15T21:55:20.041805+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.041805+0000', 'last_undegraded': '2024-09-15T21:55:20.041805+0000', 'last_fullsized': '2024-09-15T21:55:20.041805+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:55:25.838 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-15T21:55:25.838 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.040398+0000', 'last_change': '2024-09-15T21:55:20.040398+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.040398+0000', 'last_undegraded': '2024-09-15T21:55:20.040398+0000', 'last_fullsized': '2024-09-15T21:55:20.040398+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:55:25.838 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-15T21:55:25.838 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.044672+0000', 'last_change': '2024-09-15T21:55:20.044672+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.044672+0000', 'last_undegraded': '2024-09-15T21:55:20.044672+0000', 'last_fullsized': '2024-09-15T21:55:20.044672+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:55:25.838 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-15T21:55:25.838 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.035371+0000', 'last_change': '2024-09-15T21:55:20.035371+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.035371+0000', 'last_undegraded': '2024-09-15T21:55:20.035371+0000', 'last_fullsized': '2024-09-15T21:55:20.035371+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T21:55:25.839 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-15T21:55:25.839 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.036019+0000', 'last_change': '2024-09-15T21:55:20.036019+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.036019+0000', 'last_undegraded': '2024-09-15T21:55:20.036019+0000', 'last_fullsized': '2024-09-15T21:55:20.036019+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T21:55:25.839 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-15T21:55:25.839 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.036377+0000', 'last_change': '2024-09-15T21:55:20.036377+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.036377+0000', 'last_undegraded': '2024-09-15T21:55:20.036377+0000', 'last_fullsized': '2024-09-15T21:55:20.036377+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:55:25.839 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-15T21:55:25.839 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.040547+0000', 'last_change': '2024-09-15T21:55:20.040547+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.040547+0000', 'last_undegraded': '2024-09-15T21:55:20.040547+0000', 'last_fullsized': '2024-09-15T21:55:20.040547+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:55:25.839 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-15T21:55:25.839 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.045423+0000', 'last_change': '2024-09-15T21:55:20.045423+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.045423+0000', 'last_undegraded': '2024-09-15T21:55:20.045423+0000', 'last_fullsized': '2024-09-15T21:55:20.045423+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:55:25.839 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-15T21:55:25.839 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.045646+0000', 'last_change': '2024-09-15T21:55:20.045646+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.045646+0000', 'last_undegraded': '2024-09-15T21:55:20.045646+0000', 'last_fullsized': '2024-09-15T21:55:20.045646+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:55:25.839 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-15T21:55:25.840 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.040720+0000', 'last_change': '2024-09-15T21:55:20.040720+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.040720+0000', 'last_undegraded': '2024-09-15T21:55:20.040720+0000', 'last_fullsized': '2024-09-15T21:55:20.040720+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:55:25.840 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-15T21:55:25.840 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.035990+0000', 'last_change': '2024-09-15T21:55:20.035990+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.035990+0000', 'last_undegraded': '2024-09-15T21:55:20.035990+0000', 'last_fullsized': '2024-09-15T21:55:20.035990+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T21:55:25.840 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-15T21:55:25.840 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.034751+0000', 'last_change': '2024-09-15T21:55:20.034751+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.034751+0000', 'last_undegraded': '2024-09-15T21:55:20.034751+0000', 'last_fullsized': '2024-09-15T21:55:20.034751+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:55:25.840 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-15T21:55:25.840 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.033086+0000', 'last_change': '2024-09-15T21:55:20.033086+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.033086+0000', 'last_undegraded': '2024-09-15T21:55:20.033086+0000', 'last_fullsized': '2024-09-15T21:55:20.033086+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T21:55:25.840 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-15T21:55:25.840 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.039420+0000', 'last_change': '2024-09-15T21:55:20.039420+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.039420+0000', 'last_undegraded': '2024-09-15T21:55:20.039420+0000', 'last_fullsized': '2024-09-15T21:55:20.039420+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:55:25.840 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-15T21:55:25.840 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.035398+0000', 'last_change': '2024-09-15T21:55:20.035398+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.035398+0000', 'last_undegraded': '2024-09-15T21:55:20.035398+0000', 'last_fullsized': '2024-09-15T21:55:20.035398+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:55:25.840 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-15T21:55:25.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.035193+0000', 'last_change': '2024-09-15T21:55:20.035193+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.035193+0000', 'last_undegraded': '2024-09-15T21:55:20.035193+0000', 'last_fullsized': '2024-09-15T21:55:20.035193+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:55:25.841 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-15T21:55:25.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.035772+0000', 'last_change': '2024-09-15T21:55:20.035772+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.035772+0000', 'last_undegraded': '2024-09-15T21:55:20.035772+0000', 'last_fullsized': '2024-09-15T21:55:20.035772+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:55:25.841 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-15T21:55:25.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.034206+0000', 'last_change': '2024-09-15T21:55:20.034206+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.034206+0000', 'last_undegraded': '2024-09-15T21:55:20.034206+0000', 'last_fullsized': '2024-09-15T21:55:20.034206+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T21:55:25.841 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-15T21:55:25.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.043515+0000', 'last_change': '2024-09-15T21:55:20.043515+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.043515+0000', 'last_undegraded': '2024-09-15T21:55:20.043515+0000', 'last_fullsized': '2024-09-15T21:55:20.043515+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:55:25.841 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-15T21:55:25.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.038270+0000', 'last_change': '2024-09-15T21:55:20.038270+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.038270+0000', 'last_undegraded': '2024-09-15T21:55:20.038270+0000', 'last_fullsized': '2024-09-15T21:55:20.038270+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:55:25.841 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-15T21:55:25.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.038175+0000', 'last_change': '2024-09-15T21:55:20.038175+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.038175+0000', 'last_undegraded': '2024-09-15T21:55:20.038175+0000', 'last_fullsized': '2024-09-15T21:55:20.038175+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:55:25.841 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-15T21:55:25.841 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.034852+0000', 'last_change': '2024-09-15T21:55:20.034852+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.034852+0000', 'last_undegraded': '2024-09-15T21:55:20.034852+0000', 'last_fullsized': '2024-09-15T21:55:20.034852+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:55:25.842 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-15T21:55:25.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.034522+0000', 'last_change': '2024-09-15T21:55:20.034522+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.034522+0000', 'last_undegraded': '2024-09-15T21:55:20.034522+0000', 'last_fullsized': '2024-09-15T21:55:20.034522+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T21:55:25.842 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-15T21:55:25.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.037753+0000', 'last_change': '2024-09-15T21:55:20.037753+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.037753+0000', 'last_undegraded': '2024-09-15T21:55:20.037753+0000', 'last_fullsized': '2024-09-15T21:55:20.037753+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:55:25.842 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-15T21:55:25.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.039942+0000', 'last_change': '2024-09-15T21:55:20.039942+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.039942+0000', 'last_undegraded': '2024-09-15T21:55:20.039942+0000', 'last_fullsized': '2024-09-15T21:55:20.039942+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:55:25.842 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-15T21:55:25.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.035058+0000', 'last_change': '2024-09-15T21:55:20.035058+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.035058+0000', 'last_undegraded': '2024-09-15T21:55:20.035058+0000', 'last_fullsized': '2024-09-15T21:55:20.035058+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T21:55:25.842 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-15T21:55:25.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.044376+0000', 'last_change': '2024-09-15T21:55:20.044376+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.044376+0000', 'last_undegraded': '2024-09-15T21:55:20.044376+0000', 'last_fullsized': '2024-09-15T21:55:20.044376+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:55:25.842 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-15T21:55:25.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.040551+0000', 'last_change': '2024-09-15T21:55:20.040551+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.040551+0000', 'last_undegraded': '2024-09-15T21:55:20.040551+0000', 'last_fullsized': '2024-09-15T21:55:20.040551+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:55:25.843 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-15T21:55:25.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.044136+0000', 'last_change': '2024-09-15T21:55:20.044136+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.044136+0000', 'last_undegraded': '2024-09-15T21:55:20.044136+0000', 'last_fullsized': '2024-09-15T21:55:20.044136+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:55:25.843 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-15T21:55:25.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:20.036713+0000', 'last_change': '2024-09-15T21:55:20.036713+0000', 'last_active': '2024-09-15T21:55:20.015969+0000', 'last_peered': '2024-09-15T21:55:20.015969+0000', 'last_clean': '2024-09-15T21:55:20.015969+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:20.036713+0000', 'last_undegraded': '2024-09-15T21:55:20.036713+0000', 'last_fullsized': '2024-09-15T21:55:20.036713+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:20.015969+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:55:25.843 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T21:55:25.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.989+0000 7ff7d4ffc640 1 Processor -- start 2024-09-15T21:55:25.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.989+0000 7ff7d4ffc640 1 -- start start 2024-09-15T21:55:25.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.989+0000 7ff7d4ffc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff7d00b6120 0x7ff7d014b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.989+0000 7ff7d4ffc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff7d01480c0 0x7ff7d01413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.989+0000 7ff7d4ffc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7d0148520 0x7ff7d01418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:25.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.989+0000 7ff7d4ffc640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7ff7d00b6500 con 0x7ff7d01480c0 2024-09-15T21:55:25.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.989+0000 7ff7d4ffc640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7ff7d014bc60 con 0x7ff7d00b6120 2024-09-15T21:55:25.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.989+0000 7ff7d4ffc640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d0147ba0 con 0x7ff7d0148520 2024-09-15T21:55:25.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7cdd9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff7d01480c0 0x7ff7d01413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7cdd9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff7d01480c0 0x7ff7d01413b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34626/0 (socket says 172.21.15.1:34626) 2024-09-15T21:55:25.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7cdd9b640 1 -- 172.21.15.1:0/378868093 learned_addr learned my addr 172.21.15.1:0/378868093 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:25.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7ce59c640 1 --2- 172.21.15.1:0/378868093 >> v2:172.21.15.70:3300/0 conn(0x7ff7d00b6120 0x7ff7d014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7ced9d640 1 --2- 172.21.15.1:0/378868093 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7d0148520 0x7ff7d01418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:25.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7cdd9b640 1 -- 172.21.15.1:0/378868093 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7d0148520 msgr2=0x7ff7d01418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:25.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7cdd9b640 1 --2- 172.21.15.1:0/378868093 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7d0148520 0x7ff7d01418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7cdd9b640 1 -- 172.21.15.1:0/378868093 >> v2:172.21.15.70:3300/0 conn(0x7ff7d00b6120 msgr2=0x7ff7d014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:25.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7cdd9b640 1 --2- 172.21.15.1:0/378868093 >> v2:172.21.15.70:3300/0 conn(0x7ff7d00b6120 0x7ff7d014b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:25.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7cdd9b640 1 -- 172.21.15.1:0/378868093 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d00b76c0 con 0x7ff7d01480c0 2024-09-15T21:55:25.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7ced9d640 1 --2- 172.21.15.1:0/378868093 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7d0148520 0x7ff7d01418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:25.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7cdd9b640 1 --2- 172.21.15.1:0/378868093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7d01480c0 0x7ff7d01413b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff7d006d260 tx=0x7ff7c001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af66abe9bda8ef1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:25.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7cd59a640 1 -- 172.21.15.1:0/378868093 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00a55e0 con 0x7ff7d01480c0 2024-09-15T21:55:25.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7cd59a640 1 -- 172.21.15.1:0/378868093 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c00a5780 con 0x7ff7d01480c0 2024-09-15T21:55:25.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7cd59a640 1 -- 172.21.15.1:0/378868093 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c00a5b50 con 0x7ff7d01480c0 2024-09-15T21:55:25.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/378868093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7d01480c0 msgr2=0x7ff7d01413b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:25.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7d4ffc640 1 --2- 172.21.15.1:0/378868093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7d01480c0 0x7ff7d01413b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff7d006d260 tx=0x7ff7c001c960 comp rx=0 tx=0).stop 2024-09-15T21:55:25.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/378868093 shutdown_connections 2024-09-15T21:55:25.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7d4ffc640 1 --2- 172.21.15.1:0/378868093 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7d0148520 0x7ff7d01418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7d4ffc640 1 --2- 172.21.15.1:0/378868093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7d01480c0 0x7ff7d01413b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7d4ffc640 1 --2- 172.21.15.1:0/378868093 >> v2:172.21.15.70:3300/0 conn(0x7ff7d00b6120 0x7ff7d014b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/378868093 >> 172.21.15.1:0/378868093 conn(0x7ff7d00bd2f0 msgr2=0x7ff7d00bd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:26.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/378868093 shutdown_connections 2024-09-15T21:55:26.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.993+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/378868093 wait complete. 2024-09-15T21:55:26.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7d4ffc640 1 Processor -- start 2024-09-15T21:55:26.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7d4ffc640 1 -- start start 2024-09-15T21:55:26.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7d4ffc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d00b6120 0x7ff7d014aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:26.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7d4ffc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7d01480c0 0x7ff7d01e3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:26.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7d4ffc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7d0148520 0x7ff7d01e3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:26.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7d4ffc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d00b5460 con 0x7ff7d0148520 2024-09-15T21:55:26.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7d4ffc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d00b52e0 con 0x7ff7d00b6120 2024-09-15T21:55:26.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7d4ffc640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d00b55e0 con 0x7ff7d01480c0 2024-09-15T21:55:26.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7ced9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7d0148520 0x7ff7d01e3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7ced9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7d0148520 0x7ff7d01e3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34628/0 (socket says 172.21.15.1:34628) 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7ced9d640 1 -- 172.21.15.1:0/1412644008 learned_addr learned my addr 172.21.15.1:0/1412644008 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7ce59c640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d00b6120 0x7ff7d014aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7cdd9b640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7d01480c0 0x7ff7d01e3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7ced9d640 1 -- 172.21.15.1:0/1412644008 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7d01480c0 msgr2=0x7ff7d01e3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7ced9d640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7d01480c0 0x7ff7d01e3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7ced9d640 1 -- 172.21.15.1:0/1412644008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d00b6120 msgr2=0x7ff7d014aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7ced9d640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d00b6120 0x7ff7d014aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7ced9d640 1 -- 172.21.15.1:0/1412644008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d01438f0 con 0x7ff7d0148520 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7ced9d640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7d0148520 0x7ff7d01e3d70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800c5c0 tx=0x7ff7c800ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7beffd640 1 -- 172.21.15.1:0/1412644008 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8015070 con 0x7ff7d0148520 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7beffd640 1 -- 172.21.15.1:0/1412644008 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c8004240 con 0x7ff7d0148520 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/1412644008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d014a0b0 con 0x7ff7d0148520 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7beffd640 1 -- 172.21.15.1:0/1412644008 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8003620 con 0x7ff7d0148520 2024-09-15T21:55:26.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/1412644008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d0143610 con 0x7ff7d0148520 2024-09-15T21:55:26.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/1412644008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7d014b320 con 0x7ff7d0148520 2024-09-15T21:55:26.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7beffd640 1 -- 172.21.15.1:0/1412644008 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7c80037c0 con 0x7ff7d0148520 2024-09-15T21:55:26.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7beffd640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff7b00678c0 0x7ff7b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:26.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7ce59c640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff7b00678c0 0x7ff7b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:26.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:25.997+0000 7ff7beffd640 1 -- 172.21.15.1:0/1412644008 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff7c8085a30 con 0x7ff7d0148520 2024-09-15T21:55:26.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.001+0000 7ff7ce59c640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff7b00678c0 0x7ff7b0069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0142260 tx=0x7ff7c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:26.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.005+0000 7ff7beffd640 1 -- 172.21.15.1:0/1412644008 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff7c8056580 con 0x7ff7d0148520 2024-09-15T21:55:26.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.225+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/1412644008 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff7d00691c0 con 0x7ff7d0148520 2024-09-15T21:55:26.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.225+0000 7ff7beffd640 1 -- 172.21.15.1:0/1412644008 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1136 (secure 0 0 0) 0x7ff7c8055e80 con 0x7ff7d0148520 2024-09-15T21:55:26.231 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:26.231 INFO:teuthology.orchestra.run.smithi001.stdout:{"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1726437309,"num_in_osds":8,"osd_in_since":1726437299,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":51},{"state_name":"active+clean","count":46}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":590368,"bytes_used":262402048,"bytes_avail":772831711232,"bytes_total":773094113280,"inactive_pgs_ratio":0.52577316761016846,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":8,"btime":"2024-09-15T21:55:24:061270+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4245}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-15T21:54:56.304483+0000","services":{}},"progress_events":{}} 2024-09-15T21:55:26.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.229+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/1412644008 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff7b00678c0 msgr2=0x7ff7b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:26.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.229+0000 7ff7d4ffc640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff7b00678c0 0x7ff7b0069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0142260 tx=0x7ff7c4008040 comp rx=0 tx=0).stop 2024-09-15T21:55:26.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.229+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/1412644008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7d0148520 msgr2=0x7ff7d01e3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:26.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.229+0000 7ff7d4ffc640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7d0148520 0x7ff7d01e3d70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800c5c0 tx=0x7ff7c800ca80 comp rx=0 tx=0).stop 2024-09-15T21:55:26.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.229+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/1412644008 shutdown_connections 2024-09-15T21:55:26.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.229+0000 7ff7d4ffc640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7d0148520 0x7ff7d01e3d70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.229+0000 7ff7d4ffc640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7d01480c0 0x7ff7d01e3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.229+0000 7ff7d4ffc640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff7b00678c0 0x7ff7b0069d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.229+0000 7ff7d4ffc640 1 --2- 172.21.15.1:0/1412644008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7d00b6120 0x7ff7d014aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.229+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/1412644008 >> 172.21.15.1:0/1412644008 conn(0x7ff7d00bd2f0 msgr2=0x7ff7d00bb660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:26.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.229+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/1412644008 shutdown_connections 2024-09-15T21:55:26.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.229+0000 7ff7d4ffc640 1 -- 172.21.15.1:0/1412644008 wait complete. 2024-09-15T21:55:26.247 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T21:55:26.248 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:55:26.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.357+0000 7efc560d6640 1 Processor -- start 2024-09-15T21:55:26.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.357+0000 7efc560d6640 1 -- start start 2024-09-15T21:55:26.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.357+0000 7efc560d6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efc500b1d80 0x7efc500b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:26.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.357+0000 7efc560d6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efc50145ad0 0x7efc50145f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:26.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.357+0000 7efc560d6640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc500b6c80 con 0x7efc5006f580 2024-09-15T21:55:26.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.357+0000 7efc560d6640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7efc500b79e0 con 0x7efc500b1d80 2024-09-15T21:55:26.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.357+0000 7efc560d6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7efc5006f960 con 0x7efc50145ad0 2024-09-15T21:55:26.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4f7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7efc5006f580 0x7efc500b5d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46076/0 (socket says 172.21.15.1:46076) 2024-09-15T21:55:26.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4f7fe640 1 -- 172.21.15.1:0/3333810389 learned_addr learned my addr 172.21.15.1:0/3333810389 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:26.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4effd640 1 --2- 172.21.15.1:0/3333810389 >> v2:172.21.15.1:3300/0 conn(0x7efc500b1d80 0x7efc500b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:26.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4e7fc640 1 -- 172.21.15.1:0/3333810389 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 294824847 0 0) 0x7efc40001120 con 0x7efc5006f580 2024-09-15T21:55:26.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4ffff640 1 --2- 172.21.15.1:0/3333810389 >> v2:172.21.15.70:3300/0 conn(0x7efc50145ad0 0x7efc50145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:26.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4e7fc640 1 -- 172.21.15.1:0/3333810389 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc38003530 con 0x7efc5006f580 2024-09-15T21:55:26.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4effd640 1 -- 172.21.15.1:0/3333810389 >> v2:172.21.15.70:3300/0 conn(0x7efc50145ad0 msgr2=0x7efc50145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:26.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4effd640 1 --2- 172.21.15.1:0/3333810389 >> v2:172.21.15.70:3300/0 conn(0x7efc50145ad0 0x7efc50145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4effd640 1 -- 172.21.15.1:0/3333810389 >> v1:172.21.15.1:6789/0 conn(0x7efc5006f580 legacy=0x7efc500b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:26.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4effd640 1 -- 172.21.15.1:0/3333810389 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc50146440 con 0x7efc500b1d80 2024-09-15T21:55:26.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4effd640 1 --2- 172.21.15.1:0/3333810389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc500b1d80 0x7efc500b21f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efc500a1820 tx=0x7efc4401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a933abd659f465f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:26.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4e7fc640 1 -- 172.21.15.1:0/3333810389 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc440b1070 con 0x7efc500b1d80 2024-09-15T21:55:26.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4e7fc640 1 -- 172.21.15.1:0/3333810389 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc440ac620 con 0x7efc500b1d80 2024-09-15T21:55:26.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.361+0000 7efc4e7fc640 1 -- 172.21.15.1:0/3333810389 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc440ac9f0 con 0x7efc500b1d80 2024-09-15T21:55:26.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 -- 172.21.15.1:0/3333810389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc500b1d80 msgr2=0x7efc500b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:26.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 --2- 172.21.15.1:0/3333810389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc500b1d80 0x7efc500b21f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efc500a1820 tx=0x7efc4401c3c0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 -- 172.21.15.1:0/3333810389 shutdown_connections 2024-09-15T21:55:26.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 --2- 172.21.15.1:0/3333810389 >> v2:172.21.15.70:3300/0 conn(0x7efc50145ad0 0x7efc50145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 --2- 172.21.15.1:0/3333810389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc500b1d80 0x7efc500b21f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 -- 172.21.15.1:0/3333810389 >> 172.21.15.1:0/3333810389 conn(0x7efc500bb340 msgr2=0x7efc500bb750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:26.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 -- 172.21.15.1:0/3333810389 shutdown_connections 2024-09-15T21:55:26.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 -- 172.21.15.1:0/3333810389 wait complete. 2024-09-15T21:55:26.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 Processor -- start 2024-09-15T21:55:26.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 -- start start 2024-09-15T21:55:26.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5006f580 0x7efc5009c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:26.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc500b1d80 0x7efc5009d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:26.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efc50145ad0 0x7efc500b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:26.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efc50152950 con 0x7efc500b1d80 2024-09-15T21:55:26.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efc501527d0 con 0x7efc5006f580 2024-09-15T21:55:26.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7efc50152ad0 con 0x7efc50145ad0 2024-09-15T21:55:26.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc4effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc500b1d80 0x7efc5009d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:26.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc4effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc500b1d80 0x7efc5009d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34648/0 (socket says 172.21.15.1:34648) 2024-09-15T21:55:26.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc4effd640 1 -- 172.21.15.1:0/3974300943 learned_addr learned my addr 172.21.15.1:0/3974300943 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:26.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc4f7fe640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5006f580 0x7efc5009c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:26.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc4ffff640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efc50145ad0 0x7efc500b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:26.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc4effd640 1 -- 172.21.15.1:0/3974300943 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efc50145ad0 msgr2=0x7efc500b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:26.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc4effd640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efc50145ad0 0x7efc500b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc4effd640 1 -- 172.21.15.1:0/3974300943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5006f580 msgr2=0x7efc5009c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:26.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc4effd640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5006f580 0x7efc5009c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc4effd640 1 -- 172.21.15.1:0/3974300943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc500b2e50 con 0x7efc500b1d80 2024-09-15T21:55:26.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc4ffff640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efc50145ad0 0x7efc500b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:26.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc4effd640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc500b1d80 0x7efc5009d380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efc440af040 tx=0x7efc44019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:26.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc37fff640 1 -- 172.21.15.1:0/3974300943 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc440b9020 con 0x7efc500b1d80 2024-09-15T21:55:26.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc37fff640 1 -- 172.21.15.1:0/3974300943 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc440b5410 con 0x7efc500b1d80 2024-09-15T21:55:26.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 -- 172.21.15.1:0/3974300943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc500b4db0 con 0x7efc500b1d80 2024-09-15T21:55:26.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc37fff640 1 -- 172.21.15.1:0/3974300943 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc440b1040 con 0x7efc500b1d80 2024-09-15T21:55:26.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.365+0000 7efc560d6640 1 -- 172.21.15.1:0/3974300943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc5009cec0 con 0x7efc500b1d80 2024-09-15T21:55:26.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.369+0000 7efc560d6640 1 -- 172.21.15.1:0/3974300943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc500b3020 con 0x7efc500b1d80 2024-09-15T21:55:26.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.369+0000 7efc37fff640 1 -- 172.21.15.1:0/3974300943 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efc440bc020 con 0x7efc500b1d80 2024-09-15T21:55:26.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.369+0000 7efc37fff640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efc3c0678c0 0x7efc3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:26.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.369+0000 7efc37fff640 1 -- 172.21.15.1:0/3974300943 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efc4411fca0 con 0x7efc500b1d80 2024-09-15T21:55:26.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.369+0000 7efc4f7fe640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efc3c0678c0 0x7efc3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:26.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.369+0000 7efc4f7fe640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efc3c0678c0 0x7efc3c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efc40005890 tx=0x7efc40009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:26.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.373+0000 7efc37fff640 1 -- 172.21.15.1:0/3974300943 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efc440c3030 con 0x7efc500b1d80 2024-09-15T21:55:26.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.525+0000 7efc560d6640 1 -- 172.21.15.1:0/3974300943 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc50145f00 con 0x7efc3c0678c0 2024-09-15T21:55:26.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.537+0000 7efc37fff640 1 -- 172.21.15.1:0/3974300943 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247717 (secure 0 0 0) 0x7efc50145f00 con 0x7efc3c0678c0 2024-09-15T21:55:26.542 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:26.543 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:55:26.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.537+0000 7efc560d6640 1 -- 172.21.15.1:0/3974300943 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efc3c0678c0 msgr2=0x7efc3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:26.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.537+0000 7efc560d6640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efc3c0678c0 0x7efc3c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efc40005890 tx=0x7efc40009040 comp rx=0 tx=0).stop 2024-09-15T21:55:26.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.537+0000 7efc560d6640 1 -- 172.21.15.1:0/3974300943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc500b1d80 msgr2=0x7efc5009d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:26.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.537+0000 7efc560d6640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc500b1d80 0x7efc5009d380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efc440af040 tx=0x7efc44019160 comp rx=0 tx=0).stop 2024-09-15T21:55:26.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.537+0000 7efc560d6640 1 -- 172.21.15.1:0/3974300943 shutdown_connections 2024-09-15T21:55:26.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.537+0000 7efc560d6640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efc50145ad0 0x7efc500b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.537+0000 7efc560d6640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc500b1d80 0x7efc5009d380 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.537+0000 7efc560d6640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efc3c0678c0 0x7efc3c069d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.537+0000 7efc560d6640 1 --2- 172.21.15.1:0/3974300943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc5006f580 0x7efc5009c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:26.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.537+0000 7efc560d6640 1 -- 172.21.15.1:0/3974300943 >> 172.21.15.1:0/3974300943 conn(0x7efc500bb340 msgr2=0x7efc50144310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:26.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.537+0000 7efc560d6640 1 -- 172.21.15.1:0/3974300943 shutdown_connections 2024-09-15T21:55:26.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:26.537+0000 7efc560d6640 1 -- 172.21.15.1:0/3974300943 wait complete. 2024-09-15T21:55:26.558 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-15T21:55:25.079422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256252,"kb_used_data":2580,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754718468,"statfs":{"total":773094113280,"available":772831711232,"internally_reserved":0,"allocated":2641920,"data_stored":1647194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.016188"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484762+0000","last_change":"2024-09-15T21:55:21.088474+0000","last_active":"2024-09-15T21:55:22.484762+0000","last_peered":"2024-09-15T21:55:22.484762+0000","last_clean":"2024-09-15T21:55:22.484762+0000","last_became_active":"2024-09-15T21:55:21.088066+0000","last_became_peered":"2024-09-15T21:55:21.088066+0000","last_unstale":"2024-09-15T21:55:22.484762+0000","last_undegraded":"2024-09-15T21:55:22.484762+0000","last_fullsized":"2024-09-15T21:55:22.484762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:35.421317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.037857+0000","last_change":"2024-09-15T21:55:20.037857+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.037857+0000","last_undegraded":"2024-09-15T21:55:20.037857+0000","last_fullsized":"2024-09-15T21:55:20.037857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045680+0000","last_change":"2024-09-15T21:55:20.045680+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045680+0000","last_undegraded":"2024-09-15T21:55:20.045680+0000","last_fullsized":"2024-09-15T21:55:20.045680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.041645+0000","last_change":"2024-09-15T21:55:20.041645+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.041645+0000","last_undegraded":"2024-09-15T21:55:20.041645+0000","last_fullsized":"2024-09-15T21:55:20.041645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484114+0000","last_change":"2024-09-15T21:55:21.081320+0000","last_active":"2024-09-15T21:55:22.484114+0000","last_peered":"2024-09-15T21:55:22.484114+0000","last_clean":"2024-09-15T21:55:22.484114+0000","last_became_active":"2024-09-15T21:55:21.080501+0000","last_became_peered":"2024-09-15T21:55:21.080501+0000","last_unstale":"2024-09-15T21:55:22.484114+0000","last_undegraded":"2024-09-15T21:55:22.484114+0000","last_fullsized":"2024-09-15T21:55:22.484114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:24.528185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.048263+0000","last_change":"2024-09-15T21:55:20.048263+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.048263+0000","last_undegraded":"2024-09-15T21:55:20.048263+0000","last_fullsized":"2024-09-15T21:55:20.048263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483929+0000","last_change":"2024-09-15T21:55:21.081625+0000","last_active":"2024-09-15T21:55:22.483929+0000","last_peered":"2024-09-15T21:55:22.483929+0000","last_clean":"2024-09-15T21:55:22.483929+0000","last_became_active":"2024-09-15T21:55:21.081233+0000","last_became_peered":"2024-09-15T21:55:21.081233+0000","last_unstale":"2024-09-15T21:55:22.483929+0000","last_undegraded":"2024-09-15T21:55:22.483929+0000","last_fullsized":"2024-09-15T21:55:22.483929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:56.638597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.049532+0000","last_change":"2024-09-15T21:55:20.049532+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.049532+0000","last_undegraded":"2024-09-15T21:55:20.049532+0000","last_fullsized":"2024-09-15T21:55:20.049532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485001+0000","last_change":"2024-09-15T21:55:21.094131+0000","last_active":"2024-09-15T21:55:22.485001+0000","last_peered":"2024-09-15T21:55:22.485001+0000","last_clean":"2024-09-15T21:55:22.485001+0000","last_became_active":"2024-09-15T21:55:21.093635+0000","last_became_peered":"2024-09-15T21:55:21.093635+0000","last_unstale":"2024-09-15T21:55:22.485001+0000","last_undegraded":"2024-09-15T21:55:22.485001+0000","last_fullsized":"2024-09-15T21:55:22.485001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.303590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036035+0000","last_change":"2024-09-15T21:55:20.036035+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036035+0000","last_undegraded":"2024-09-15T21:55:20.036035+0000","last_fullsized":"2024-09-15T21:55:20.036035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033278+0000","last_change":"2024-09-15T21:55:20.033278+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033278+0000","last_undegraded":"2024-09-15T21:55:20.033278+0000","last_fullsized":"2024-09-15T21:55:20.033278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.037108+0000","last_change":"2024-09-15T21:55:20.037108+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.037108+0000","last_undegraded":"2024-09-15T21:55:20.037108+0000","last_fullsized":"2024-09-15T21:55:20.037108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.041091+0000","last_change":"2024-09-15T21:55:20.041091+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.041091+0000","last_undegraded":"2024-09-15T21:55:20.041091+0000","last_fullsized":"2024-09-15T21:55:20.041091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045050+0000","last_change":"2024-09-15T21:55:20.045050+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045050+0000","last_undegraded":"2024-09-15T21:55:20.045050+0000","last_fullsized":"2024-09-15T21:55:20.045050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038764+0000","last_change":"2024-09-15T21:55:20.038764+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038764+0000","last_undegraded":"2024-09-15T21:55:20.038764+0000","last_fullsized":"2024-09-15T21:55:20.038764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045788+0000","last_change":"2024-09-15T21:55:20.045788+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045788+0000","last_undegraded":"2024-09-15T21:55:20.045788+0000","last_fullsized":"2024-09-15T21:55:20.045788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044531+0000","last_change":"2024-09-15T21:55:20.044531+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044531+0000","last_undegraded":"2024-09-15T21:55:20.044531+0000","last_fullsized":"2024-09-15T21:55:20.044531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.225030+0000","last_change":"2024-09-15T21:55:21.056138+0000","last_active":"2024-09-15T21:55:22.225030+0000","last_peered":"2024-09-15T21:55:22.225030+0000","last_clean":"2024-09-15T21:55:22.225030+0000","last_became_active":"2024-09-15T21:55:21.055873+0000","last_became_peered":"2024-09-15T21:55:21.055873+0000","last_unstale":"2024-09-15T21:55:22.225030+0000","last_undegraded":"2024-09-15T21:55:22.225030+0000","last_fullsized":"2024-09-15T21:55:22.225030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:11.494691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484459+0000","last_change":"2024-09-15T21:55:21.088654+0000","last_active":"2024-09-15T21:55:22.484459+0000","last_peered":"2024-09-15T21:55:22.484459+0000","last_clean":"2024-09-15T21:55:22.484459+0000","last_became_active":"2024-09-15T21:55:21.087902+0000","last_became_peered":"2024-09-15T21:55:21.087902+0000","last_unstale":"2024-09-15T21:55:22.484459+0000","last_undegraded":"2024-09-15T21:55:22.484459+0000","last_fullsized":"2024-09-15T21:55:22.484459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:40.823067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033749+0000","last_change":"2024-09-15T21:55:20.033749+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033749+0000","last_undegraded":"2024-09-15T21:55:20.033749+0000","last_fullsized":"2024-09-15T21:55:20.033749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.047119+0000","last_change":"2024-09-15T21:55:20.047119+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.047119+0000","last_undegraded":"2024-09-15T21:55:20.047119+0000","last_fullsized":"2024-09-15T21:55:20.047119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.046658+0000","last_change":"2024-09-15T21:55:20.046658+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.046658+0000","last_undegraded":"2024-09-15T21:55:20.046658+0000","last_fullsized":"2024-09-15T21:55:20.046658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040720+0000","last_change":"2024-09-15T21:55:20.040720+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040720+0000","last_undegraded":"2024-09-15T21:55:20.040720+0000","last_fullsized":"2024-09-15T21:55:20.040720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.042262+0000","last_change":"2024-09-15T21:55:20.042262+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.042262+0000","last_undegraded":"2024-09-15T21:55:20.042262+0000","last_fullsized":"2024-09-15T21:55:20.042262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038892+0000","last_change":"2024-09-15T21:55:20.038892+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038892+0000","last_undegraded":"2024-09-15T21:55:20.038892+0000","last_fullsized":"2024-09-15T21:55:20.038892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033476+0000","last_change":"2024-09-15T21:55:20.033476+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033476+0000","last_undegraded":"2024-09-15T21:55:20.033476+0000","last_fullsized":"2024-09-15T21:55:20.033476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038591+0000","last_change":"2024-09-15T21:55:20.038591+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038591+0000","last_undegraded":"2024-09-15T21:55:20.038591+0000","last_fullsized":"2024-09-15T21:55:20.038591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.041805+0000","last_change":"2024-09-15T21:55:20.041805+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.041805+0000","last_undegraded":"2024-09-15T21:55:20.041805+0000","last_fullsized":"2024-09-15T21:55:20.041805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040398+0000","last_change":"2024-09-15T21:55:20.040398+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040398+0000","last_undegraded":"2024-09-15T21:55:20.040398+0000","last_fullsized":"2024-09-15T21:55:20.040398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044672+0000","last_change":"2024-09-15T21:55:20.044672+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044672+0000","last_undegraded":"2024-09-15T21:55:20.044672+0000","last_fullsized":"2024-09-15T21:55:20.044672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224741+0000","last_change":"2024-09-15T21:55:21.084544+0000","last_active":"2024-09-15T21:55:22.224741+0000","last_peered":"2024-09-15T21:55:22.224741+0000","last_clean":"2024-09-15T21:55:22.224741+0000","last_became_active":"2024-09-15T21:55:21.084180+0000","last_became_peered":"2024-09-15T21:55:21.084180+0000","last_unstale":"2024-09-15T21:55:22.224741+0000","last_undegraded":"2024-09-15T21:55:22.224741+0000","last_fullsized":"2024-09-15T21:55:22.224741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:41.953343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035371+0000","last_change":"2024-09-15T21:55:20.035371+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035371+0000","last_undegraded":"2024-09-15T21:55:20.035371+0000","last_fullsized":"2024-09-15T21:55:20.035371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036019+0000","last_change":"2024-09-15T21:55:20.036019+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036019+0000","last_undegraded":"2024-09-15T21:55:20.036019+0000","last_fullsized":"2024-09-15T21:55:20.036019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.067335+0000","last_change":"2024-09-15T21:55:20.066836+0000","last_active":"2024-09-15T21:55:20.067335+0000","last_peered":"2024-09-15T21:55:20.067335+0000","last_clean":"2024-09-15T21:55:20.067335+0000","last_became_active":"2024-09-15T21:55:20.066434+0000","last_became_peered":"2024-09-15T21:55:20.066434+0000","last_unstale":"2024-09-15T21:55:20.067335+0000","last_undegraded":"2024-09-15T21:55:20.067335+0000","last_fullsized":"2024-09-15T21:55:20.067335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036377+0000","last_change":"2024-09-15T21:55:20.036377+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036377+0000","last_undegraded":"2024-09-15T21:55:20.036377+0000","last_fullsized":"2024-09-15T21:55:20.036377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.056086+0000","last_change":"2024-09-15T21:55:20.049677+0000","last_active":"2024-09-15T21:55:20.056086+0000","last_peered":"2024-09-15T21:55:20.056086+0000","last_clean":"2024-09-15T21:55:20.056086+0000","last_became_active":"2024-09-15T21:55:20.046329+0000","last_became_peered":"2024-09-15T21:55:20.046329+0000","last_unstale":"2024-09-15T21:55:20.056086+0000","last_undegraded":"2024-09-15T21:55:20.056086+0000","last_fullsized":"2024-09-15T21:55:20.056086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.063529+0000","last_change":"2024-09-15T21:55:20.056808+0000","last_active":"2024-09-15T21:55:20.063529+0000","last_peered":"2024-09-15T21:55:20.063529+0000","last_clean":"2024-09-15T21:55:20.063529+0000","last_became_active":"2024-09-15T21:55:20.055774+0000","last_became_peered":"2024-09-15T21:55:20.055774+0000","last_unstale":"2024-09-15T21:55:20.063529+0000","last_undegraded":"2024-09-15T21:55:20.063529+0000","last_fullsized":"2024-09-15T21:55:20.063529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040547+0000","last_change":"2024-09-15T21:55:20.040547+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040547+0000","last_undegraded":"2024-09-15T21:55:20.040547+0000","last_fullsized":"2024-09-15T21:55:20.040547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.056445+0000","last_change":"2024-09-15T21:55:20.052880+0000","last_active":"2024-09-15T21:55:20.056445+0000","last_peered":"2024-09-15T21:55:20.056445+0000","last_clean":"2024-09-15T21:55:20.056445+0000","last_became_active":"2024-09-15T21:55:20.052076+0000","last_became_peered":"2024-09-15T21:55:20.052076+0000","last_unstale":"2024-09-15T21:55:20.056445+0000","last_undegraded":"2024-09-15T21:55:20.056445+0000","last_fullsized":"2024-09-15T21:55:20.056445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045423+0000","last_change":"2024-09-15T21:55:20.045423+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045423+0000","last_undegraded":"2024-09-15T21:55:20.045423+0000","last_fullsized":"2024-09-15T21:55:20.045423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.057146+0000","last_change":"2024-09-15T21:55:20.054769+0000","last_active":"2024-09-15T21:55:20.057146+0000","last_peered":"2024-09-15T21:55:20.057146+0000","last_clean":"2024-09-15T21:55:20.057146+0000","last_became_active":"2024-09-15T21:55:20.053983+0000","last_became_peered":"2024-09-15T21:55:20.053983+0000","last_unstale":"2024-09-15T21:55:20.057146+0000","last_undegraded":"2024-09-15T21:55:20.057146+0000","last_fullsized":"2024-09-15T21:55:20.057146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.045646+0000","last_change":"2024-09-15T21:55:20.045646+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.045646+0000","last_undegraded":"2024-09-15T21:55:20.045646+0000","last_fullsized":"2024-09-15T21:55:20.045646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058304+0000","last_change":"2024-09-15T21:55:20.055173+0000","last_active":"2024-09-15T21:55:20.058304+0000","last_peered":"2024-09-15T21:55:20.058304+0000","last_clean":"2024-09-15T21:55:20.058304+0000","last_became_active":"2024-09-15T21:55:20.054689+0000","last_became_peered":"2024-09-15T21:55:20.054689+0000","last_unstale":"2024-09-15T21:55:20.058304+0000","last_undegraded":"2024-09-15T21:55:20.058304+0000","last_fullsized":"2024-09-15T21:55:20.058304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040720+0000","last_change":"2024-09-15T21:55:20.040720+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040720+0000","last_undegraded":"2024-09-15T21:55:20.040720+0000","last_fullsized":"2024-09-15T21:55:20.040720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058047+0000","last_change":"2024-09-15T21:55:20.054045+0000","last_active":"2024-09-15T21:55:20.058047+0000","last_peered":"2024-09-15T21:55:20.058047+0000","last_clean":"2024-09-15T21:55:20.058047+0000","last_became_active":"2024-09-15T21:55:20.053600+0000","last_became_peered":"2024-09-15T21:55:20.053600+0000","last_unstale":"2024-09-15T21:55:20.058047+0000","last_undegraded":"2024-09-15T21:55:20.058047+0000","last_fullsized":"2024-09-15T21:55:20.058047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035990+0000","last_change":"2024-09-15T21:55:20.035990+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035990+0000","last_undegraded":"2024-09-15T21:55:20.035990+0000","last_fullsized":"2024-09-15T21:55:20.035990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.057003+0000","last_change":"2024-09-15T21:55:20.053664+0000","last_active":"2024-09-15T21:55:20.057003+0000","last_peered":"2024-09-15T21:55:20.057003+0000","last_clean":"2024-09-15T21:55:20.057003+0000","last_became_active":"2024-09-15T21:55:20.051430+0000","last_became_peered":"2024-09-15T21:55:20.051430+0000","last_unstale":"2024-09-15T21:55:20.057003+0000","last_undegraded":"2024-09-15T21:55:20.057003+0000","last_fullsized":"2024-09-15T21:55:20.057003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483958+0000","last_change":"2024-09-15T21:55:21.081085+0000","last_active":"2024-09-15T21:55:22.483958+0000","last_peered":"2024-09-15T21:55:22.483958+0000","last_clean":"2024-09-15T21:55:22.483958+0000","last_became_active":"2024-09-15T21:55:21.080302+0000","last_became_peered":"2024-09-15T21:55:21.080302+0000","last_unstale":"2024-09-15T21:55:22.483958+0000","last_undegraded":"2024-09-15T21:55:22.483958+0000","last_fullsized":"2024-09-15T21:55:22.483958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:35.161272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.054999+0000","last_change":"2024-09-15T21:55:20.050298+0000","last_active":"2024-09-15T21:55:20.054999+0000","last_peered":"2024-09-15T21:55:20.054999+0000","last_clean":"2024-09-15T21:55:20.054999+0000","last_became_active":"2024-09-15T21:55:20.049086+0000","last_became_peered":"2024-09-15T21:55:20.049086+0000","last_unstale":"2024-09-15T21:55:20.054999+0000","last_undegraded":"2024-09-15T21:55:20.054999+0000","last_fullsized":"2024-09-15T21:55:20.054999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034751+0000","last_change":"2024-09-15T21:55:20.034751+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034751+0000","last_undegraded":"2024-09-15T21:55:20.034751+0000","last_fullsized":"2024-09-15T21:55:20.034751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.070744+0000","last_change":"2024-09-15T21:55:20.067348+0000","last_active":"2024-09-15T21:55:20.070744+0000","last_peered":"2024-09-15T21:55:20.070744+0000","last_clean":"2024-09-15T21:55:20.070744+0000","last_became_active":"2024-09-15T21:55:20.066912+0000","last_became_peered":"2024-09-15T21:55:20.066912+0000","last_unstale":"2024-09-15T21:55:20.070744+0000","last_undegraded":"2024-09-15T21:55:20.070744+0000","last_fullsized":"2024-09-15T21:55:20.070744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484340+0000","last_change":"2024-09-15T21:55:21.092869+0000","last_active":"2024-09-15T21:55:22.484340+0000","last_peered":"2024-09-15T21:55:22.484340+0000","last_clean":"2024-09-15T21:55:22.484340+0000","last_became_active":"2024-09-15T21:55:21.092360+0000","last_became_peered":"2024-09-15T21:55:21.092360+0000","last_unstale":"2024-09-15T21:55:22.484340+0000","last_undegraded":"2024-09-15T21:55:22.484340+0000","last_fullsized":"2024-09-15T21:55:22.484340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:08.584649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.056104+0000","last_change":"2024-09-15T21:55:20.046741+0000","last_active":"2024-09-15T21:55:20.056104+0000","last_peered":"2024-09-15T21:55:20.056104+0000","last_clean":"2024-09-15T21:55:20.056104+0000","last_became_active":"2024-09-15T21:55:20.044504+0000","last_became_peered":"2024-09-15T21:55:20.044504+0000","last_unstale":"2024-09-15T21:55:20.056104+0000","last_undegraded":"2024-09-15T21:55:20.056104+0000","last_fullsized":"2024-09-15T21:55:20.056104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.033086+0000","last_change":"2024-09-15T21:55:20.033086+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.033086+0000","last_undegraded":"2024-09-15T21:55:20.033086+0000","last_fullsized":"2024-09-15T21:55:20.033086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224516+0000","last_change":"2024-09-15T21:55:20.045879+0000","last_active":"2024-09-15T21:55:22.224516+0000","last_peered":"2024-09-15T21:55:22.224516+0000","last_clean":"2024-09-15T21:55:22.224516+0000","last_became_active":"2024-09-15T21:55:20.045166+0000","last_became_peered":"2024-09-15T21:55:20.045166+0000","last_unstale":"2024-09-15T21:55:22.224516+0000","last_undegraded":"2024-09-15T21:55:22.224516+0000","last_fullsized":"2024-09-15T21:55:22.224516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:27.871582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484582+0000","last_change":"2024-09-15T21:55:21.091543+0000","last_active":"2024-09-15T21:55:22.484582+0000","last_peered":"2024-09-15T21:55:22.484582+0000","last_clean":"2024-09-15T21:55:22.484582+0000","last_became_active":"2024-09-15T21:55:21.088040+0000","last_became_peered":"2024-09-15T21:55:21.088040+0000","last_unstale":"2024-09-15T21:55:22.484582+0000","last_undegraded":"2024-09-15T21:55:22.484582+0000","last_fullsized":"2024-09-15T21:55:22.484582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:58.437513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.064056+0000","last_change":"2024-09-15T21:55:20.060882+0000","last_active":"2024-09-15T21:55:20.064056+0000","last_peered":"2024-09-15T21:55:20.064056+0000","last_clean":"2024-09-15T21:55:20.064056+0000","last_became_active":"2024-09-15T21:55:20.059856+0000","last_became_peered":"2024-09-15T21:55:20.059856+0000","last_unstale":"2024-09-15T21:55:20.064056+0000","last_undegraded":"2024-09-15T21:55:20.064056+0000","last_fullsized":"2024-09-15T21:55:20.064056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484517+0000","last_change":"2024-09-15T21:55:21.088545+0000","last_active":"2024-09-15T21:55:22.484517+0000","last_peered":"2024-09-15T21:55:22.484517+0000","last_clean":"2024-09-15T21:55:22.484517+0000","last_became_active":"2024-09-15T21:55:21.080729+0000","last_became_peered":"2024-09-15T21:55:21.080729+0000","last_unstale":"2024-09-15T21:55:22.484517+0000","last_undegraded":"2024-09-15T21:55:22.484517+0000","last_fullsized":"2024-09-15T21:55:22.484517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:10.451575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224968+0000","last_change":"2024-09-15T21:55:20.053774+0000","last_active":"2024-09-15T21:55:22.224968+0000","last_peered":"2024-09-15T21:55:22.224968+0000","last_clean":"2024-09-15T21:55:22.224968+0000","last_became_active":"2024-09-15T21:55:20.053417+0000","last_became_peered":"2024-09-15T21:55:20.053417+0000","last_unstale":"2024-09-15T21:55:22.224968+0000","last_undegraded":"2024-09-15T21:55:22.224968+0000","last_fullsized":"2024-09-15T21:55:22.224968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:42:50.046558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484974+0000","last_change":"2024-09-15T21:55:21.088812+0000","last_active":"2024-09-15T21:55:22.484974+0000","last_peered":"2024-09-15T21:55:22.484974+0000","last_clean":"2024-09-15T21:55:22.484974+0000","last_became_active":"2024-09-15T21:55:21.088403+0000","last_became_peered":"2024-09-15T21:55:21.088403+0000","last_unstale":"2024-09-15T21:55:22.484974+0000","last_undegraded":"2024-09-15T21:55:22.484974+0000","last_fullsized":"2024-09-15T21:55:22.484974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:53:46.896732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.051966+0000","last_change":"2024-09-15T21:55:20.049155+0000","last_active":"2024-09-15T21:55:20.051966+0000","last_peered":"2024-09-15T21:55:20.051966+0000","last_clean":"2024-09-15T21:55:20.051966+0000","last_became_active":"2024-09-15T21:55:20.048758+0000","last_became_peered":"2024-09-15T21:55:20.048758+0000","last_unstale":"2024-09-15T21:55:20.051966+0000","last_undegraded":"2024-09-15T21:55:20.051966+0000","last_fullsized":"2024-09-15T21:55:20.051966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:12.667610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.039420+0000","last_change":"2024-09-15T21:55:20.039420+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.039420+0000","last_undegraded":"2024-09-15T21:55:20.039420+0000","last_fullsized":"2024-09-15T21:55:20.039420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224802+0000","last_change":"2024-09-15T21:55:20.057638+0000","last_active":"2024-09-15T21:55:22.224802+0000","last_peered":"2024-09-15T21:55:22.224802+0000","last_clean":"2024-09-15T21:55:22.224802+0000","last_became_active":"2024-09-15T21:55:20.057104+0000","last_became_peered":"2024-09-15T21:55:20.057104+0000","last_unstale":"2024-09-15T21:55:22.224802+0000","last_undegraded":"2024-09-15T21:55:22.224802+0000","last_fullsized":"2024-09-15T21:55:22.224802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:46.407918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484034+0000","last_change":"2024-09-15T21:55:21.092764+0000","last_active":"2024-09-15T21:55:22.484034+0000","last_peered":"2024-09-15T21:55:22.484034+0000","last_clean":"2024-09-15T21:55:22.484034+0000","last_became_active":"2024-09-15T21:55:21.092278+0000","last_became_peered":"2024-09-15T21:55:21.092278+0000","last_unstale":"2024-09-15T21:55:22.484034+0000","last_undegraded":"2024-09-15T21:55:22.484034+0000","last_fullsized":"2024-09-15T21:55:22.484034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:16.853013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483633+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:22.483633+0000","last_peered":"2024-09-15T21:55:22.483633+0000","last_clean":"2024-09-15T21:55:22.483633+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:22.483633+0000","last_undegraded":"2024-09-15T21:55:22.483633+0000","last_fullsized":"2024-09-15T21:55:22.483633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.063634+0000","last_change":"2024-09-15T21:55:20.062164+0000","last_active":"2024-09-15T21:55:20.063634+0000","last_peered":"2024-09-15T21:55:20.063634+0000","last_clean":"2024-09-15T21:55:20.063634+0000","last_became_active":"2024-09-15T21:55:20.061451+0000","last_became_peered":"2024-09-15T21:55:20.061451+0000","last_unstale":"2024-09-15T21:55:20.063634+0000","last_undegraded":"2024-09-15T21:55:20.063634+0000","last_fullsized":"2024-09-15T21:55:20.063634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035398+0000","last_change":"2024-09-15T21:55:20.035398+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035398+0000","last_undegraded":"2024-09-15T21:55:20.035398+0000","last_fullsized":"2024-09-15T21:55:20.035398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483452+0000","last_change":"2024-09-15T21:55:20.067427+0000","last_active":"2024-09-15T21:55:22.483452+0000","last_peered":"2024-09-15T21:55:22.483452+0000","last_clean":"2024-09-15T21:55:22.483452+0000","last_became_active":"2024-09-15T21:55:20.066778+0000","last_became_peered":"2024-09-15T21:55:20.066778+0000","last_unstale":"2024-09-15T21:55:22.483452+0000","last_undegraded":"2024-09-15T21:55:22.483452+0000","last_fullsized":"2024-09-15T21:55:22.483452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:26.867497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035193+0000","last_change":"2024-09-15T21:55:20.035193+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035193+0000","last_undegraded":"2024-09-15T21:55:20.035193+0000","last_fullsized":"2024-09-15T21:55:20.035193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224713+0000","last_change":"2024-09-15T21:55:20.064316+0000","last_active":"2024-09-15T21:55:22.224713+0000","last_peered":"2024-09-15T21:55:22.224713+0000","last_clean":"2024-09-15T21:55:22.224713+0000","last_became_active":"2024-09-15T21:55:20.064010+0000","last_became_peered":"2024-09-15T21:55:20.064010+0000","last_unstale":"2024-09-15T21:55:22.224713+0000","last_undegraded":"2024-09-15T21:55:22.224713+0000","last_fullsized":"2024-09-15T21:55:22.224713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:55.450682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035772+0000","last_change":"2024-09-15T21:55:20.035772+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035772+0000","last_undegraded":"2024-09-15T21:55:20.035772+0000","last_fullsized":"2024-09-15T21:55:20.035772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058366+0000","last_change":"2024-09-15T21:55:20.053996+0000","last_active":"2024-09-15T21:55:20.058366+0000","last_peered":"2024-09-15T21:55:20.058366+0000","last_clean":"2024-09-15T21:55:20.058366+0000","last_became_active":"2024-09-15T21:55:20.053487+0000","last_became_peered":"2024-09-15T21:55:20.053487+0000","last_unstale":"2024-09-15T21:55:20.058366+0000","last_undegraded":"2024-09-15T21:55:20.058366+0000","last_fullsized":"2024-09-15T21:55:20.058366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034206+0000","last_change":"2024-09-15T21:55:20.034206+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034206+0000","last_undegraded":"2024-09-15T21:55:20.034206+0000","last_fullsized":"2024-09-15T21:55:20.034206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058016+0000","last_change":"2024-09-15T21:55:20.055656+0000","last_active":"2024-09-15T21:55:20.058016+0000","last_peered":"2024-09-15T21:55:20.058016+0000","last_clean":"2024-09-15T21:55:20.058016+0000","last_became_active":"2024-09-15T21:55:20.055168+0000","last_became_peered":"2024-09-15T21:55:20.055168+0000","last_unstale":"2024-09-15T21:55:20.058016+0000","last_undegraded":"2024-09-15T21:55:20.058016+0000","last_fullsized":"2024-09-15T21:55:20.058016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.043515+0000","last_change":"2024-09-15T21:55:20.043515+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.043515+0000","last_undegraded":"2024-09-15T21:55:20.043515+0000","last_fullsized":"2024-09-15T21:55:20.043515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484562+0000","last_change":"2024-09-15T21:55:20.067021+0000","last_active":"2024-09-15T21:55:22.484562+0000","last_peered":"2024-09-15T21:55:22.484562+0000","last_clean":"2024-09-15T21:55:22.484562+0000","last_became_active":"2024-09-15T21:55:20.066354+0000","last_became_peered":"2024-09-15T21:55:20.066354+0000","last_unstale":"2024-09-15T21:55:22.484562+0000","last_undegraded":"2024-09-15T21:55:22.484562+0000","last_fullsized":"2024-09-15T21:55:22.484562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:57.837195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038270+0000","last_change":"2024-09-15T21:55:20.038270+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038270+0000","last_undegraded":"2024-09-15T21:55:20.038270+0000","last_fullsized":"2024-09-15T21:55:20.038270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.055851+0000","last_change":"2024-09-15T21:55:20.051483+0000","last_active":"2024-09-15T21:55:20.055851+0000","last_peered":"2024-09-15T21:55:20.055851+0000","last_clean":"2024-09-15T21:55:20.055851+0000","last_became_active":"2024-09-15T21:55:20.051077+0000","last_became_peered":"2024-09-15T21:55:20.051077+0000","last_unstale":"2024-09-15T21:55:20.055851+0000","last_undegraded":"2024-09-15T21:55:20.055851+0000","last_fullsized":"2024-09-15T21:55:20.055851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.038175+0000","last_change":"2024-09-15T21:55:20.038175+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.038175+0000","last_undegraded":"2024-09-15T21:55:20.038175+0000","last_fullsized":"2024-09-15T21:55:20.038175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.061377+0000","last_change":"2024-09-15T21:55:20.058425+0000","last_active":"2024-09-15T21:55:20.061377+0000","last_peered":"2024-09-15T21:55:20.061377+0000","last_clean":"2024-09-15T21:55:20.061377+0000","last_became_active":"2024-09-15T21:55:20.057897+0000","last_became_peered":"2024-09-15T21:55:20.057897+0000","last_unstale":"2024-09-15T21:55:20.061377+0000","last_undegraded":"2024-09-15T21:55:20.061377+0000","last_fullsized":"2024-09-15T21:55:20.061377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034852+0000","last_change":"2024-09-15T21:55:20.034852+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034852+0000","last_undegraded":"2024-09-15T21:55:20.034852+0000","last_fullsized":"2024-09-15T21:55:20.034852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483454+0000","last_change":"2024-09-15T21:55:20.067341+0000","last_active":"2024-09-15T21:55:22.483454+0000","last_peered":"2024-09-15T21:55:22.483454+0000","last_clean":"2024-09-15T21:55:22.483454+0000","last_became_active":"2024-09-15T21:55:20.066114+0000","last_became_peered":"2024-09-15T21:55:20.066114+0000","last_unstale":"2024-09-15T21:55:22.483454+0000","last_undegraded":"2024-09-15T21:55:22.483454+0000","last_fullsized":"2024-09-15T21:55:22.483454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:54.611870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.034522+0000","last_change":"2024-09-15T21:55:20.034522+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.034522+0000","last_undegraded":"2024-09-15T21:55:20.034522+0000","last_fullsized":"2024-09-15T21:55:20.034522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.058664+0000","last_change":"2024-09-15T21:55:20.057081+0000","last_active":"2024-09-15T21:55:20.058664+0000","last_peered":"2024-09-15T21:55:20.058664+0000","last_clean":"2024-09-15T21:55:20.058664+0000","last_became_active":"2024-09-15T21:55:20.056673+0000","last_became_peered":"2024-09-15T21:55:20.056673+0000","last_unstale":"2024-09-15T21:55:20.058664+0000","last_undegraded":"2024-09-15T21:55:20.058664+0000","last_fullsized":"2024-09-15T21:55:20.058664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:46.832251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.037753+0000","last_change":"2024-09-15T21:55:20.037753+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.037753+0000","last_undegraded":"2024-09-15T21:55:20.037753+0000","last_fullsized":"2024-09-15T21:55:20.037753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.057859+0000","last_change":"2024-09-15T21:55:20.053890+0000","last_active":"2024-09-15T21:55:20.057859+0000","last_peered":"2024-09-15T21:55:20.057859+0000","last_clean":"2024-09-15T21:55:20.057859+0000","last_became_active":"2024-09-15T21:55:20.053359+0000","last_became_peered":"2024-09-15T21:55:20.053359+0000","last_unstale":"2024-09-15T21:55:20.057859+0000","last_undegraded":"2024-09-15T21:55:20.057859+0000","last_fullsized":"2024-09-15T21:55:20.057859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.039942+0000","last_change":"2024-09-15T21:55:20.039942+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.039942+0000","last_undegraded":"2024-09-15T21:55:20.039942+0000","last_fullsized":"2024-09-15T21:55:20.039942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484372+0000","last_change":"2024-09-15T21:55:20.066502+0000","last_active":"2024-09-15T21:55:22.484372+0000","last_peered":"2024-09-15T21:55:22.484372+0000","last_clean":"2024-09-15T21:55:22.484372+0000","last_became_active":"2024-09-15T21:55:20.066143+0000","last_became_peered":"2024-09-15T21:55:20.066143+0000","last_unstale":"2024-09-15T21:55:22.484372+0000","last_undegraded":"2024-09-15T21:55:22.484372+0000","last_fullsized":"2024-09-15T21:55:22.484372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:26.132589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.035058+0000","last_change":"2024-09-15T21:55:20.035058+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.035058+0000","last_undegraded":"2024-09-15T21:55:20.035058+0000","last_fullsized":"2024-09-15T21:55:20.035058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044376+0000","last_change":"2024-09-15T21:55:20.044376+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044376+0000","last_undegraded":"2024-09-15T21:55:20.044376+0000","last_fullsized":"2024-09-15T21:55:20.044376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483812+0000","last_change":"2024-09-15T21:55:20.069937+0000","last_active":"2024-09-15T21:55:22.483812+0000","last_peered":"2024-09-15T21:55:22.483812+0000","last_clean":"2024-09-15T21:55:22.483812+0000","last_became_active":"2024-09-15T21:55:20.069454+0000","last_became_peered":"2024-09-15T21:55:20.069454+0000","last_unstale":"2024-09-15T21:55:22.483812+0000","last_undegraded":"2024-09-15T21:55:22.483812+0000","last_fullsized":"2024-09-15T21:55:22.483812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:40.942879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.040551+0000","last_change":"2024-09-15T21:55:20.040551+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.040551+0000","last_undegraded":"2024-09-15T21:55:20.040551+0000","last_fullsized":"2024-09-15T21:55:20.040551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484270+0000","last_change":"2024-09-15T21:55:20.068019+0000","last_active":"2024-09-15T21:55:22.484270+0000","last_peered":"2024-09-15T21:55:22.484270+0000","last_clean":"2024-09-15T21:55:22.484270+0000","last_became_active":"2024-09-15T21:55:20.067127+0000","last_became_peered":"2024-09-15T21:55:20.067127+0000","last_unstale":"2024-09-15T21:55:22.484270+0000","last_undegraded":"2024-09-15T21:55:22.484270+0000","last_fullsized":"2024-09-15T21:55:22.484270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:10.484227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.044136+0000","last_change":"2024-09-15T21:55:20.044136+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.044136+0000","last_undegraded":"2024-09-15T21:55:20.044136+0000","last_fullsized":"2024-09-15T21:55:20.044136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.063582+0000","last_change":"2024-09-15T21:55:20.055671+0000","last_active":"2024-09-15T21:55:20.063582+0000","last_peered":"2024-09-15T21:55:20.063582+0000","last_clean":"2024-09-15T21:55:20.063582+0000","last_became_active":"2024-09-15T21:55:20.054385+0000","last_became_peered":"2024-09-15T21:55:20.054385+0000","last_unstale":"2024-09-15T21:55:20.063582+0000","last_undegraded":"2024-09-15T21:55:20.063582+0000","last_fullsized":"2024-09-15T21:55:20.063582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:50.157193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T21:55:20.036713+0000","last_change":"2024-09-15T21:55:20.036713+0000","last_active":"2024-09-15T21:55:20.015969+0000","last_peered":"2024-09-15T21:55:20.015969+0000","last_clean":"2024-09-15T21:55:20.015969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:20.036713+0000","last_undegraded":"2024-09-15T21:55:20.036713+0000","last_fullsized":"2024-09-15T21:55:20.036713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-15T21:55:20.060487+0000","last_change":"2024-09-15T21:55:20.057739+0000","last_active":"2024-09-15T21:55:20.060487+0000","last_peered":"2024-09-15T21:55:20.060487+0000","last_clean":"2024-09-15T21:55:20.060487+0000","last_became_active":"2024-09-15T21:55:20.056988+0000","last_became_peered":"2024-09-15T21:55:20.056988+0000","last_unstale":"2024-09-15T21:55:20.060487+0000","last_undegraded":"2024-09-15T21:55:20.060487+0000","last_fullsized":"2024-09-15T21:55:20.060487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":172032,"data_stored":53397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509443,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":643765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:55:29.564 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:55:29.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cf5a22640 1 Processor -- start 2024-09-15T21:55:29.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cf5a22640 1 -- start start 2024-09-15T21:55:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cf5a22640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf009b540 0x7f0cf00af170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cf5a22640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0cf0144ab0 0x7f0cf00b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cf5a22640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cf009b920 con 0x7f0cf00b3b40 2024-09-15T21:55:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cf5a22640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f0cf00b44a0 con 0x7f0cf0144ab0 2024-09-15T21:55:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cf5a22640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf00ae380 con 0x7f0cf009b540 2024-09-15T21:55:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cee7fc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0cf00b3b40 0x7f0cf01443a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49638/0 (socket says 172.21.15.1:49638) 2024-09-15T21:55:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cee7fc640 1 -- 172.21.15.1:0/4294754934 learned_addr learned my addr 172.21.15.1:0/4294754934 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cef7fe640 1 --2- 172.21.15.1:0/4294754934 >> v2:172.21.15.70:3300/0 conn(0x7f0cf0144ab0 0x7f0cf00b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0ceeffd640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf009b540 0x7f0cf00af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932372439 0 0) 0x7f0cf009b920 con 0x7f0cf00b3b40 2024-09-15T21:55:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cd8003530 con 0x7f0cf00b3b40 2024-09-15T21:55:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4127487586 0 0) 0x7f0cd8003530 con 0x7f0cf00b3b40 2024-09-15T21:55:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf009b540 msgr2=0x7f0cf00af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf009b540 0x7f0cf00af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 >> v2:172.21.15.70:3300/0 conn(0x7f0cf0144ab0 msgr2=0x7f0cf00b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 --2- 172.21.15.1:0/4294754934 >> v2:172.21.15.70:3300/0 conn(0x7f0cf0144ab0 0x7f0cf00b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf00af7d0 con 0x7f0cf00b3b40 2024-09-15T21:55:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f0ce4001680 con 0x7f0cf00b3b40 2024-09-15T21:55:29.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cef7fe640 1 --2- 172.21.15.1:0/4294754934 >> v2:172.21.15.70:3300/0 conn(0x7f0cf0144ab0 0x7f0cf00b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:55:29.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0ceeffd640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf009b540 0x7f0cf00af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:55:29.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 >> v1:172.21.15.1:6789/0 conn(0x7f0cf00b3b40 legacy=0x7f0cf01443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:29.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cd80039c0 0x7f0cd8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:29.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cd8004810 0x7f0cd8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:29.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf009b540 0x7f0cd80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:29.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf00b44a0 con 0x7f0cd80039c0 2024-09-15T21:55:29.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf00ae380 con 0x7f0cd8004810 2024-09-15T21:55:29.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd800ba80 con 0x7f0cf009b540 2024-09-15T21:55:29.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0ceeffd640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cd80039c0 0x7f0cd8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:29.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cee7fc640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cd8004810 0x7f0cd8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:29.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cef7fe640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf009b540 0x7f0cd80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:29.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0ceeffd640 1 -- 172.21.15.1:0/4294754934 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf009b540 msgr2=0x7f0cd80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:29.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0ceeffd640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf009b540 0x7f0cd80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:29.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0ceeffd640 1 -- 172.21.15.1:0/4294754934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cd8004810 msgr2=0x7f0cd8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:29.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0ceeffd640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cd8004810 0x7f0cd8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:29.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0ceeffd640 1 -- 172.21.15.1:0/4294754934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd8003530 con 0x7f0cd80039c0 2024-09-15T21:55:29.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.697+0000 7f0cee7fc640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cd8004810 0x7f0cd8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:29.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.701+0000 7f0ceeffd640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cd80039c0 0x7f0cd8003de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009c80 tx=0x7f0ce001caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e85efe85c965f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:29.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.701+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0009880 con 0x7f0cd80039c0 2024-09-15T21:55:29.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.701+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce00a6520 con 0x7f0cd80039c0 2024-09-15T21:55:29.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.701+0000 7f0cedffb640 1 -- 172.21.15.1:0/4294754934 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00a6910 con 0x7f0cd80039c0 2024-09-15T21:55:29.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.701+0000 7f0cf5a22640 1 -- 172.21.15.1:0/4294754934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cd80039c0 msgr2=0x7f0cd8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.701+0000 7f0cf5a22640 1 --2- 172.21.15.1:0/4294754934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cd80039c0 0x7f0cd8003de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009c80 tx=0x7f0ce001caf0 comp rx=0 tx=0).stop 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.701+0000 7f0cef7fe640 1 -- 172.21.15.1:0/4294754934 reap_dead start 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.701+0000 7f0cf5a22640 1 -- 172.21.15.1:0/4294754934 shutdown_connections 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.701+0000 7f0cf5a22640 1 -- 172.21.15.1:0/4294754934 >> 172.21.15.1:0/4294754934 conn(0x7f0cf00b5c40 msgr2=0x7f0cf00b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.701+0000 7f0cf5a22640 1 -- 172.21.15.1:0/4294754934 shutdown_connections 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.701+0000 7f0cf5a22640 1 -- 172.21.15.1:0/4294754934 wait complete. 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.701+0000 7f0cf5a22640 1 Processor -- start 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.701+0000 7f0cf5a22640 1 -- start start 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cf5a22640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cd80039c0 0x7f0cf01e3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cf5a22640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf014ed20 0x7f0cf00b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cf5a22640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf0072c60 0x7f0cf00730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cf5a22640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf00ae660 con 0x7f0cd80039c0 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cf5a22640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf00aead0 con 0x7f0cf014ed20 2024-09-15T21:55:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cf5a22640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0cf014f7b0 con 0x7f0cf0072c60 2024-09-15T21:55:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0ceeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cd80039c0 0x7f0cf01e3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0ceeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cd80039c0 0x7f0cf01e3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60238/0 (socket says 172.21.15.1:60238) 2024-09-15T21:55:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0ceeffd640 1 -- 172.21.15.1:0/3358865234 learned_addr learned my addr 172.21.15.1:0/3358865234 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cee7fc640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf014ed20 0x7f0cf00b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cef7fe640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf0072c60 0x7f0cf00730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0ceeffd640 1 -- 172.21.15.1:0/3358865234 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf0072c60 msgr2=0x7f0cf00730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0ceeffd640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf0072c60 0x7f0cf00730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0ceeffd640 1 -- 172.21.15.1:0/3358865234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf014ed20 msgr2=0x7f0cf00b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0ceeffd640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf014ed20 0x7f0cf00b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0ceeffd640 1 -- 172.21.15.1:0/3358865234 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf009d5d0 con 0x7f0cd80039c0 2024-09-15T21:55:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0ceeffd640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cd80039c0 0x7f0cf01e3e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00982f0 tx=0x7f0cd8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cd7fff640 1 -- 172.21.15.1:0/3358865234 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0009880 con 0x7f0cd80039c0 2024-09-15T21:55:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cd7fff640 1 -- 172.21.15.1:0/3358865234 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce0009400 con 0x7f0cd80039c0 2024-09-15T21:55:29.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cd7fff640 1 -- 172.21.15.1:0/3358865234 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00a6e60 con 0x7f0cd80039c0 2024-09-15T21:55:29.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cf5a22640 1 -- 172.21.15.1:0/3358865234 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf00b2260 con 0x7f0cd80039c0 2024-09-15T21:55:29.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cf5a22640 1 -- 172.21.15.1:0/3358865234 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf00b1520 con 0x7f0cd80039c0 2024-09-15T21:55:29.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cf5a22640 1 -- 172.21.15.1:0/3358865234 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf00b3f60 con 0x7f0cd80039c0 2024-09-15T21:55:29.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cd7fff640 1 -- 172.21.15.1:0/3358865234 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ce0005be0 con 0x7f0cd80039c0 2024-09-15T21:55:29.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cd7fff640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0cdc0678f0 0x7f0cdc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:29.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cd7fff640 1 -- 172.21.15.1:0/3358865234 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0ce011fc90 con 0x7f0cd80039c0 2024-09-15T21:55:29.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cee7fc640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0cdc0678f0 0x7f0cdc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:29.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.705+0000 7f0cee7fc640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0cdc0678f0 0x7f0cdc069db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4001130 tx=0x7f0ce4000f60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:29.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.709+0000 7f0cd7fff640 1 -- 172.21.15.1:0/3358865234 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0ce00c0060 con 0x7f0cd80039c0 2024-09-15T21:55:29.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.869+0000 7f0cf5a22640 1 -- 172.21.15.1:0/3358865234 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0cf00ae160 con 0x7f0cdc0678f0 2024-09-15T21:55:29.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.877+0000 7f0cd7fff640 1 -- 172.21.15.1:0/3358865234 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251924 (secure 0 0 0) 0x7f0cf00ae160 con 0x7f0cdc0678f0 2024-09-15T21:55:29.882 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:29.884 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:55:29.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.877+0000 7f0cf5a22640 1 -- 172.21.15.1:0/3358865234 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0cdc0678f0 msgr2=0x7f0cdc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:29.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.877+0000 7f0cf5a22640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0cdc0678f0 0x7f0cdc069db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4001130 tx=0x7f0ce4000f60 comp rx=0 tx=0).stop 2024-09-15T21:55:29.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.877+0000 7f0cf5a22640 1 -- 172.21.15.1:0/3358865234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cd80039c0 msgr2=0x7f0cf01e3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:29.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.877+0000 7f0cf5a22640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cd80039c0 0x7f0cf01e3e00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00982f0 tx=0x7f0cd8005840 comp rx=0 tx=0).stop 2024-09-15T21:55:29.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.877+0000 7f0cf5a22640 1 -- 172.21.15.1:0/3358865234 shutdown_connections 2024-09-15T21:55:29.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.877+0000 7f0cf5a22640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cf0072c60 0x7f0cf00730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:29.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.877+0000 7f0cf5a22640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0cdc0678f0 0x7f0cdc069db0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:29.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.877+0000 7f0cf5a22640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf014ed20 0x7f0cf00b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:29.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.877+0000 7f0cf5a22640 1 --2- 172.21.15.1:0/3358865234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cd80039c0 0x7f0cf01e3e00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:29.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.881+0000 7f0cf5a22640 1 -- 172.21.15.1:0/3358865234 >> 172.21.15.1:0/3358865234 conn(0x7f0cf00b5c40 msgr2=0x7f0cf0145600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:29.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.881+0000 7f0cf5a22640 1 -- 172.21.15.1:0/3358865234 shutdown_connections 2024-09-15T21:55:29.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:29.881+0000 7f0cf5a22640 1 -- 172.21.15.1:0/3358865234 wait complete. 2024-09-15T21:55:29.899 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-15T21:55:29.080800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256568,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754718152,"statfs":{"total":773094113280,"available":772831387648,"internally_reserved":0,"allocated":2924544,"data_stored":1767532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.050896"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484762+0000","last_change":"2024-09-15T21:55:21.088474+0000","last_active":"2024-09-15T21:55:22.484762+0000","last_peered":"2024-09-15T21:55:22.484762+0000","last_clean":"2024-09-15T21:55:22.484762+0000","last_became_active":"2024-09-15T21:55:21.088066+0000","last_became_peered":"2024-09-15T21:55:21.088066+0000","last_unstale":"2024-09-15T21:55:22.484762+0000","last_undegraded":"2024-09-15T21:55:22.484762+0000","last_fullsized":"2024-09-15T21:55:22.484762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:35.421317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034618+0000","last_change":"2024-09-15T21:55:21.057377+0000","last_active":"2024-09-15T21:55:22.034618+0000","last_peered":"2024-09-15T21:55:22.034618+0000","last_clean":"2024-09-15T21:55:22.034618+0000","last_became_active":"2024-09-15T21:55:21.057035+0000","last_became_peered":"2024-09-15T21:55:21.057035+0000","last_unstale":"2024-09-15T21:55:22.034618+0000","last_undegraded":"2024-09-15T21:55:22.034618+0000","last_fullsized":"2024-09-15T21:55:22.034618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484551+0000","last_change":"2024-09-15T21:55:21.055398+0000","last_active":"2024-09-15T21:55:22.484551+0000","last_peered":"2024-09-15T21:55:22.484551+0000","last_clean":"2024-09-15T21:55:22.484551+0000","last_became_active":"2024-09-15T21:55:21.055039+0000","last_became_peered":"2024-09-15T21:55:21.055039+0000","last_unstale":"2024-09-15T21:55:22.484551+0000","last_undegraded":"2024-09-15T21:55:22.484551+0000","last_fullsized":"2024-09-15T21:55:22.484551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:45.407449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038690+0000","last_change":"2024-09-15T21:55:21.083779+0000","last_active":"2024-09-15T21:55:22.038690+0000","last_peered":"2024-09-15T21:55:22.038690+0000","last_clean":"2024-09-15T21:55:22.038690+0000","last_became_active":"2024-09-15T21:55:21.081667+0000","last_became_peered":"2024-09-15T21:55:21.081667+0000","last_unstale":"2024-09-15T21:55:22.038690+0000","last_undegraded":"2024-09-15T21:55:22.038690+0000","last_fullsized":"2024-09-15T21:55:22.038690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:44.705672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484114+0000","last_change":"2024-09-15T21:55:21.081320+0000","last_active":"2024-09-15T21:55:22.484114+0000","last_peered":"2024-09-15T21:55:22.484114+0000","last_clean":"2024-09-15T21:55:22.484114+0000","last_became_active":"2024-09-15T21:55:21.080501+0000","last_became_peered":"2024-09-15T21:55:21.080501+0000","last_unstale":"2024-09-15T21:55:22.484114+0000","last_undegraded":"2024-09-15T21:55:22.484114+0000","last_fullsized":"2024-09-15T21:55:22.484114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:24.528185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038584+0000","last_change":"2024-09-15T21:55:21.085688+0000","last_active":"2024-09-15T21:55:22.038584+0000","last_peered":"2024-09-15T21:55:22.038584+0000","last_clean":"2024-09-15T21:55:22.038584+0000","last_became_active":"2024-09-15T21:55:21.085166+0000","last_became_peered":"2024-09-15T21:55:21.085166+0000","last_unstale":"2024-09-15T21:55:22.038584+0000","last_undegraded":"2024-09-15T21:55:22.038584+0000","last_fullsized":"2024-09-15T21:55:22.038584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:56.272087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483929+0000","last_change":"2024-09-15T21:55:21.081625+0000","last_active":"2024-09-15T21:55:22.483929+0000","last_peered":"2024-09-15T21:55:22.483929+0000","last_clean":"2024-09-15T21:55:22.483929+0000","last_became_active":"2024-09-15T21:55:21.081233+0000","last_became_peered":"2024-09-15T21:55:21.081233+0000","last_unstale":"2024-09-15T21:55:22.483929+0000","last_undegraded":"2024-09-15T21:55:22.483929+0000","last_fullsized":"2024-09-15T21:55:22.483929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:56.638597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482172+0000","last_change":"2024-09-15T21:55:21.084462+0000","last_active":"2024-09-15T21:55:22.482172+0000","last_peered":"2024-09-15T21:55:22.482172+0000","last_clean":"2024-09-15T21:55:22.482172+0000","last_became_active":"2024-09-15T21:55:21.083916+0000","last_became_peered":"2024-09-15T21:55:21.083916+0000","last_unstale":"2024-09-15T21:55:22.482172+0000","last_undegraded":"2024-09-15T21:55:22.482172+0000","last_fullsized":"2024-09-15T21:55:22.482172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:29.617932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485001+0000","last_change":"2024-09-15T21:55:21.094131+0000","last_active":"2024-09-15T21:55:22.485001+0000","last_peered":"2024-09-15T21:55:22.485001+0000","last_clean":"2024-09-15T21:55:22.485001+0000","last_became_active":"2024-09-15T21:55:21.093635+0000","last_became_peered":"2024-09-15T21:55:21.093635+0000","last_unstale":"2024-09-15T21:55:22.485001+0000","last_undegraded":"2024-09-15T21:55:22.485001+0000","last_fullsized":"2024-09-15T21:55:22.485001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.303590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038217+0000","last_change":"2024-09-15T21:55:21.084425+0000","last_active":"2024-09-15T21:55:22.038217+0000","last_peered":"2024-09-15T21:55:22.038217+0000","last_clean":"2024-09-15T21:55:22.038217+0000","last_became_active":"2024-09-15T21:55:21.083265+0000","last_became_peered":"2024-09-15T21:55:21.083265+0000","last_unstale":"2024-09-15T21:55:22.038217+0000","last_undegraded":"2024-09-15T21:55:22.038217+0000","last_fullsized":"2024-09-15T21:55:22.038217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037906+0000","last_change":"2024-09-15T21:55:21.085602+0000","last_active":"2024-09-15T21:55:22.037906+0000","last_peered":"2024-09-15T21:55:22.037906+0000","last_clean":"2024-09-15T21:55:22.037906+0000","last_became_active":"2024-09-15T21:55:21.085179+0000","last_became_peered":"2024-09-15T21:55:21.085179+0000","last_unstale":"2024-09-15T21:55:22.037906+0000","last_undegraded":"2024-09-15T21:55:22.037906+0000","last_fullsized":"2024-09-15T21:55:22.037906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:18:48.546913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472313+0000","last_change":"2024-09-15T21:55:21.073952+0000","last_active":"2024-09-15T21:55:22.472313+0000","last_peered":"2024-09-15T21:55:22.472313+0000","last_clean":"2024-09-15T21:55:22.472313+0000","last_became_active":"2024-09-15T21:55:21.066880+0000","last_became_peered":"2024-09-15T21:55:21.066880+0000","last_unstale":"2024-09-15T21:55:22.472313+0000","last_undegraded":"2024-09-15T21:55:22.472313+0000","last_fullsized":"2024-09-15T21:55:22.472313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:04.142503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483336+0000","last_change":"2024-09-15T21:55:21.055609+0000","last_active":"2024-09-15T21:55:22.483336+0000","last_peered":"2024-09-15T21:55:22.483336+0000","last_clean":"2024-09-15T21:55:22.483336+0000","last_became_active":"2024-09-15T21:55:21.055327+0000","last_became_peered":"2024-09-15T21:55:21.055327+0000","last_unstale":"2024-09-15T21:55:22.483336+0000","last_undegraded":"2024-09-15T21:55:22.483336+0000","last_fullsized":"2024-09-15T21:55:22.483336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483575+0000","last_change":"2024-09-15T21:55:21.051382+0000","last_active":"2024-09-15T21:55:22.483575+0000","last_peered":"2024-09-15T21:55:22.483575+0000","last_clean":"2024-09-15T21:55:22.483575+0000","last_became_active":"2024-09-15T21:55:21.048576+0000","last_became_peered":"2024-09-15T21:55:21.048576+0000","last_unstale":"2024-09-15T21:55:22.483575+0000","last_undegraded":"2024-09-15T21:55:22.483575+0000","last_fullsized":"2024-09-15T21:55:22.483575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:32.450086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034843+0000","last_change":"2024-09-15T21:55:21.065866+0000","last_active":"2024-09-15T21:55:22.034843+0000","last_peered":"2024-09-15T21:55:22.034843+0000","last_clean":"2024-09-15T21:55:22.034843+0000","last_became_active":"2024-09-15T21:55:21.065546+0000","last_became_peered":"2024-09-15T21:55:21.065546+0000","last_unstale":"2024-09-15T21:55:22.034843+0000","last_undegraded":"2024-09-15T21:55:22.034843+0000","last_fullsized":"2024-09-15T21:55:22.034843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038027+0000","last_change":"2024-09-15T21:55:21.078929+0000","last_active":"2024-09-15T21:55:22.038027+0000","last_peered":"2024-09-15T21:55:22.038027+0000","last_clean":"2024-09-15T21:55:22.038027+0000","last_became_active":"2024-09-15T21:55:21.078505+0000","last_became_peered":"2024-09-15T21:55:21.078505+0000","last_unstale":"2024-09-15T21:55:22.038027+0000","last_undegraded":"2024-09-15T21:55:22.038027+0000","last_fullsized":"2024-09-15T21:55:22.038027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.040153+0000","last_change":"2024-09-15T21:55:21.093592+0000","last_active":"2024-09-15T21:55:22.040153+0000","last_peered":"2024-09-15T21:55:22.040153+0000","last_clean":"2024-09-15T21:55:22.040153+0000","last_became_active":"2024-09-15T21:55:21.092961+0000","last_became_peered":"2024-09-15T21:55:21.092961+0000","last_unstale":"2024-09-15T21:55:22.040153+0000","last_undegraded":"2024-09-15T21:55:22.040153+0000","last_fullsized":"2024-09-15T21:55:22.040153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:43.789664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.225030+0000","last_change":"2024-09-15T21:55:21.056138+0000","last_active":"2024-09-15T21:55:22.225030+0000","last_peered":"2024-09-15T21:55:22.225030+0000","last_clean":"2024-09-15T21:55:22.225030+0000","last_became_active":"2024-09-15T21:55:21.055873+0000","last_became_peered":"2024-09-15T21:55:21.055873+0000","last_unstale":"2024-09-15T21:55:22.225030+0000","last_undegraded":"2024-09-15T21:55:22.225030+0000","last_fullsized":"2024-09-15T21:55:22.225030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:11.494691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484459+0000","last_change":"2024-09-15T21:55:21.088654+0000","last_active":"2024-09-15T21:55:22.484459+0000","last_peered":"2024-09-15T21:55:22.484459+0000","last_clean":"2024-09-15T21:55:22.484459+0000","last_became_active":"2024-09-15T21:55:21.087902+0000","last_became_peered":"2024-09-15T21:55:21.087902+0000","last_unstale":"2024-09-15T21:55:22.484459+0000","last_undegraded":"2024-09-15T21:55:22.484459+0000","last_fullsized":"2024-09-15T21:55:22.484459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:40.823067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038235+0000","last_change":"2024-09-15T21:55:21.069269+0000","last_active":"2024-09-15T21:55:22.038235+0000","last_peered":"2024-09-15T21:55:22.038235+0000","last_clean":"2024-09-15T21:55:22.038235+0000","last_became_active":"2024-09-15T21:55:21.066006+0000","last_became_peered":"2024-09-15T21:55:21.066006+0000","last_unstale":"2024-09-15T21:55:22.038235+0000","last_undegraded":"2024-09-15T21:55:22.038235+0000","last_fullsized":"2024-09-15T21:55:22.038235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484203+0000","last_change":"2024-09-15T21:55:21.080185+0000","last_active":"2024-09-15T21:55:22.484203+0000","last_peered":"2024-09-15T21:55:22.484203+0000","last_clean":"2024-09-15T21:55:22.484203+0000","last_became_active":"2024-09-15T21:55:21.079797+0000","last_became_peered":"2024-09-15T21:55:21.079797+0000","last_unstale":"2024-09-15T21:55:22.484203+0000","last_undegraded":"2024-09-15T21:55:22.484203+0000","last_fullsized":"2024-09-15T21:55:22.484203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:29.713894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039100+0000","last_change":"2024-09-15T21:55:21.093516+0000","last_active":"2024-09-15T21:55:22.039100+0000","last_peered":"2024-09-15T21:55:22.039100+0000","last_clean":"2024-09-15T21:55:22.039100+0000","last_became_active":"2024-09-15T21:55:21.092809+0000","last_became_peered":"2024-09-15T21:55:21.092809+0000","last_unstale":"2024-09-15T21:55:22.039100+0000","last_undegraded":"2024-09-15T21:55:22.039100+0000","last_fullsized":"2024-09-15T21:55:22.039100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:16:19.534444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482533+0000","last_change":"2024-09-15T21:55:21.064761+0000","last_active":"2024-09-15T21:55:22.482533+0000","last_peered":"2024-09-15T21:55:22.482533+0000","last_clean":"2024-09-15T21:55:22.482533+0000","last_became_active":"2024-09-15T21:55:21.064423+0000","last_became_peered":"2024-09-15T21:55:21.064423+0000","last_unstale":"2024-09-15T21:55:22.482533+0000","last_undegraded":"2024-09-15T21:55:22.482533+0000","last_fullsized":"2024-09-15T21:55:22.482533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:45.407449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037768+0000","last_change":"2024-09-15T21:55:21.076934+0000","last_active":"2024-09-15T21:55:22.037768+0000","last_peered":"2024-09-15T21:55:22.037768+0000","last_clean":"2024-09-15T21:55:22.037768+0000","last_became_active":"2024-09-15T21:55:21.076405+0000","last_became_peered":"2024-09-15T21:55:21.076405+0000","last_unstale":"2024-09-15T21:55:22.037768+0000","last_undegraded":"2024-09-15T21:55:22.037768+0000","last_fullsized":"2024-09-15T21:55:22.037768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484840+0000","last_change":"2024-09-15T21:55:21.060381+0000","last_active":"2024-09-15T21:55:22.484840+0000","last_peered":"2024-09-15T21:55:22.484840+0000","last_clean":"2024-09-15T21:55:22.484840+0000","last_became_active":"2024-09-15T21:55:21.059955+0000","last_became_peered":"2024-09-15T21:55:21.059955+0000","last_unstale":"2024-09-15T21:55:22.484840+0000","last_undegraded":"2024-09-15T21:55:22.484840+0000","last_fullsized":"2024-09-15T21:55:22.484840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:23:53.907941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038576+0000","last_change":"2024-09-15T21:55:21.083854+0000","last_active":"2024-09-15T21:55:22.038576+0000","last_peered":"2024-09-15T21:55:22.038576+0000","last_clean":"2024-09-15T21:55:22.038576+0000","last_became_active":"2024-09-15T21:55:21.082344+0000","last_became_peered":"2024-09-15T21:55:21.082344+0000","last_unstale":"2024-09-15T21:55:22.038576+0000","last_undegraded":"2024-09-15T21:55:22.038576+0000","last_fullsized":"2024-09-15T21:55:22.038576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:56.272087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034198+0000","last_change":"2024-09-15T21:55:21.040261+0000","last_active":"2024-09-15T21:55:22.034198+0000","last_peered":"2024-09-15T21:55:22.034198+0000","last_clean":"2024-09-15T21:55:22.034198+0000","last_became_active":"2024-09-15T21:55:21.039750+0000","last_became_peered":"2024-09-15T21:55:21.039750+0000","last_unstale":"2024-09-15T21:55:22.034198+0000","last_undegraded":"2024-09-15T21:55:22.034198+0000","last_fullsized":"2024-09-15T21:55:22.034198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:29.713894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483285+0000","last_change":"2024-09-15T21:55:21.058179+0000","last_active":"2024-09-15T21:55:22.483285+0000","last_peered":"2024-09-15T21:55:22.483285+0000","last_clean":"2024-09-15T21:55:22.483285+0000","last_became_active":"2024-09-15T21:55:21.057921+0000","last_became_peered":"2024-09-15T21:55:21.057921+0000","last_unstale":"2024-09-15T21:55:22.483285+0000","last_undegraded":"2024-09-15T21:55:22.483285+0000","last_fullsized":"2024-09-15T21:55:22.483285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:18:48.546913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484622+0000","last_change":"2024-09-15T21:55:21.058728+0000","last_active":"2024-09-15T21:55:22.484622+0000","last_peered":"2024-09-15T21:55:22.484622+0000","last_clean":"2024-09-15T21:55:22.484622+0000","last_became_active":"2024-09-15T21:55:21.055629+0000","last_became_peered":"2024-09-15T21:55:21.055629+0000","last_unstale":"2024-09-15T21:55:22.484622+0000","last_undegraded":"2024-09-15T21:55:22.484622+0000","last_fullsized":"2024-09-15T21:55:22.484622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:03:15.769453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039201+0000","last_change":"2024-09-15T21:55:21.088771+0000","last_active":"2024-09-15T21:55:22.039201+0000","last_peered":"2024-09-15T21:55:22.039201+0000","last_clean":"2024-09-15T21:55:22.039201+0000","last_became_active":"2024-09-15T21:55:21.088101+0000","last_became_peered":"2024-09-15T21:55:21.088101+0000","last_unstale":"2024-09-15T21:55:22.039201+0000","last_undegraded":"2024-09-15T21:55:22.039201+0000","last_fullsized":"2024-09-15T21:55:22.039201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:30.828294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224741+0000","last_change":"2024-09-15T21:55:21.084544+0000","last_active":"2024-09-15T21:55:22.224741+0000","last_peered":"2024-09-15T21:55:22.224741+0000","last_clean":"2024-09-15T21:55:22.224741+0000","last_became_active":"2024-09-15T21:55:21.084180+0000","last_became_peered":"2024-09-15T21:55:21.084180+0000","last_unstale":"2024-09-15T21:55:22.224741+0000","last_undegraded":"2024-09-15T21:55:22.224741+0000","last_fullsized":"2024-09-15T21:55:22.224741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:41.953343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037174+0000","last_change":"2024-09-15T21:55:21.064821+0000","last_active":"2024-09-15T21:55:22.037174+0000","last_peered":"2024-09-15T21:55:22.037174+0000","last_clean":"2024-09-15T21:55:22.037174+0000","last_became_active":"2024-09-15T21:55:21.063988+0000","last_became_peered":"2024-09-15T21:55:21.063988+0000","last_unstale":"2024-09-15T21:55:22.037174+0000","last_undegraded":"2024-09-15T21:55:22.037174+0000","last_fullsized":"2024-09-15T21:55:22.037174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:29.713894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.471969+0000","last_change":"2024-09-15T21:55:21.049249+0000","last_active":"2024-09-15T21:55:22.471969+0000","last_peered":"2024-09-15T21:55:22.471969+0000","last_clean":"2024-09-15T21:55:22.471969+0000","last_became_active":"2024-09-15T21:55:21.048017+0000","last_became_peered":"2024-09-15T21:55:21.048017+0000","last_unstale":"2024-09-15T21:55:22.471969+0000","last_undegraded":"2024-09-15T21:55:22.471969+0000","last_fullsized":"2024-09-15T21:55:22.471969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:18.540720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484007+0000","last_change":"2024-09-15T21:55:20.066836+0000","last_active":"2024-09-15T21:55:22.484007+0000","last_peered":"2024-09-15T21:55:22.484007+0000","last_clean":"2024-09-15T21:55:22.484007+0000","last_became_active":"2024-09-15T21:55:20.066434+0000","last_became_peered":"2024-09-15T21:55:20.066434+0000","last_unstale":"2024-09-15T21:55:22.484007+0000","last_undegraded":"2024-09-15T21:55:22.484007+0000","last_fullsized":"2024-09-15T21:55:22.484007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484990+0000","last_change":"2024-09-15T21:55:21.052900+0000","last_active":"2024-09-15T21:55:22.484990+0000","last_peered":"2024-09-15T21:55:22.484990+0000","last_clean":"2024-09-15T21:55:22.484990+0000","last_became_active":"2024-09-15T21:55:21.052626+0000","last_became_peered":"2024-09-15T21:55:21.052626+0000","last_unstale":"2024-09-15T21:55:22.484990+0000","last_undegraded":"2024-09-15T21:55:22.484990+0000","last_fullsized":"2024-09-15T21:55:22.484990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:18:48.546913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037269+0000","last_change":"2024-09-15T21:55:20.049677+0000","last_active":"2024-09-15T21:55:22.037269+0000","last_peered":"2024-09-15T21:55:22.037269+0000","last_clean":"2024-09-15T21:55:22.037269+0000","last_became_active":"2024-09-15T21:55:20.046329+0000","last_became_peered":"2024-09-15T21:55:20.046329+0000","last_unstale":"2024-09-15T21:55:22.037269+0000","last_undegraded":"2024-09-15T21:55:22.037269+0000","last_fullsized":"2024-09-15T21:55:22.037269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:06.723350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482810+0000","last_change":"2024-09-15T21:55:20.056808+0000","last_active":"2024-09-15T21:55:22.482810+0000","last_peered":"2024-09-15T21:55:22.482810+0000","last_clean":"2024-09-15T21:55:22.482810+0000","last_became_active":"2024-09-15T21:55:20.055774+0000","last_became_peered":"2024-09-15T21:55:20.055774+0000","last_unstale":"2024-09-15T21:55:22.482810+0000","last_undegraded":"2024-09-15T21:55:22.482810+0000","last_fullsized":"2024-09-15T21:55:22.482810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:46.832251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482375+0000","last_change":"2024-09-15T21:55:21.059850+0000","last_active":"2024-09-15T21:55:22.482375+0000","last_peered":"2024-09-15T21:55:22.482375+0000","last_clean":"2024-09-15T21:55:22.482375+0000","last_became_active":"2024-09-15T21:55:21.059522+0000","last_became_peered":"2024-09-15T21:55:21.059522+0000","last_unstale":"2024-09-15T21:55:22.482375+0000","last_undegraded":"2024-09-15T21:55:22.482375+0000","last_fullsized":"2024-09-15T21:55:22.482375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:29.713894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038023+0000","last_change":"2024-09-15T21:55:20.052880+0000","last_active":"2024-09-15T21:55:22.038023+0000","last_peered":"2024-09-15T21:55:22.038023+0000","last_clean":"2024-09-15T21:55:22.038023+0000","last_became_active":"2024-09-15T21:55:20.052076+0000","last_became_peered":"2024-09-15T21:55:20.052076+0000","last_unstale":"2024-09-15T21:55:22.038023+0000","last_undegraded":"2024-09-15T21:55:22.038023+0000","last_fullsized":"2024-09-15T21:55:22.038023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.202000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034540+0000","last_change":"2024-09-15T21:55:21.040018+0000","last_active":"2024-09-15T21:55:22.034540+0000","last_peered":"2024-09-15T21:55:22.034540+0000","last_clean":"2024-09-15T21:55:22.034540+0000","last_became_active":"2024-09-15T21:55:21.039694+0000","last_became_peered":"2024-09-15T21:55:21.039694+0000","last_unstale":"2024-09-15T21:55:22.034540+0000","last_undegraded":"2024-09-15T21:55:22.034540+0000","last_fullsized":"2024-09-15T21:55:22.034540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:18:48.546913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037585+0000","last_change":"2024-09-15T21:55:20.054769+0000","last_active":"2024-09-15T21:55:22.037585+0000","last_peered":"2024-09-15T21:55:22.037585+0000","last_clean":"2024-09-15T21:55:22.037585+0000","last_became_active":"2024-09-15T21:55:20.053983+0000","last_became_peered":"2024-09-15T21:55:20.053983+0000","last_unstale":"2024-09-15T21:55:22.037585+0000","last_undegraded":"2024-09-15T21:55:22.037585+0000","last_fullsized":"2024-09-15T21:55:22.037585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:03.132039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.040113+0000","last_change":"2024-09-15T21:55:21.093104+0000","last_active":"2024-09-15T21:55:22.040113+0000","last_peered":"2024-09-15T21:55:22.040113+0000","last_clean":"2024-09-15T21:55:22.040113+0000","last_became_active":"2024-09-15T21:55:21.092699+0000","last_became_peered":"2024-09-15T21:55:21.092699+0000","last_unstale":"2024-09-15T21:55:22.040113+0000","last_undegraded":"2024-09-15T21:55:22.040113+0000","last_fullsized":"2024-09-15T21:55:22.040113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:03.817824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.040096+0000","last_change":"2024-09-15T21:55:20.055173+0000","last_active":"2024-09-15T21:55:22.040096+0000","last_peered":"2024-09-15T21:55:22.040096+0000","last_clean":"2024-09-15T21:55:22.040096+0000","last_became_active":"2024-09-15T21:55:20.054689+0000","last_became_peered":"2024-09-15T21:55:20.054689+0000","last_unstale":"2024-09-15T21:55:22.040096+0000","last_undegraded":"2024-09-15T21:55:22.040096+0000","last_fullsized":"2024-09-15T21:55:22.040096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:06.723350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485031+0000","last_change":"2024-09-15T21:55:21.077556+0000","last_active":"2024-09-15T21:55:22.485031+0000","last_peered":"2024-09-15T21:55:22.485031+0000","last_clean":"2024-09-15T21:55:22.485031+0000","last_became_active":"2024-09-15T21:55:21.077268+0000","last_became_peered":"2024-09-15T21:55:21.077268+0000","last_unstale":"2024-09-15T21:55:22.485031+0000","last_undegraded":"2024-09-15T21:55:22.485031+0000","last_fullsized":"2024-09-15T21:55:22.485031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034287+0000","last_change":"2024-09-15T21:55:20.054045+0000","last_active":"2024-09-15T21:55:22.034287+0000","last_peered":"2024-09-15T21:55:22.034287+0000","last_clean":"2024-09-15T21:55:22.034287+0000","last_became_active":"2024-09-15T21:55:20.053600+0000","last_became_peered":"2024-09-15T21:55:20.053600+0000","last_unstale":"2024-09-15T21:55:22.034287+0000","last_undegraded":"2024-09-15T21:55:22.034287+0000","last_fullsized":"2024-09-15T21:55:22.034287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:03.132039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472660+0000","last_change":"2024-09-15T21:55:21.089526+0000","last_active":"2024-09-15T21:55:22.472660+0000","last_peered":"2024-09-15T21:55:22.472660+0000","last_clean":"2024-09-15T21:55:22.472660+0000","last_became_active":"2024-09-15T21:55:21.088932+0000","last_became_peered":"2024-09-15T21:55:21.088932+0000","last_unstale":"2024-09-15T21:55:22.472660+0000","last_undegraded":"2024-09-15T21:55:22.472660+0000","last_fullsized":"2024-09-15T21:55:22.472660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:25.194521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038442+0000","last_change":"2024-09-15T21:55:20.053664+0000","last_active":"2024-09-15T21:55:22.038442+0000","last_peered":"2024-09-15T21:55:22.038442+0000","last_clean":"2024-09-15T21:55:22.038442+0000","last_became_active":"2024-09-15T21:55:20.051430+0000","last_became_peered":"2024-09-15T21:55:20.051430+0000","last_unstale":"2024-09-15T21:55:22.038442+0000","last_undegraded":"2024-09-15T21:55:22.038442+0000","last_fullsized":"2024-09-15T21:55:22.038442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:17.530256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483958+0000","last_change":"2024-09-15T21:55:21.081085+0000","last_active":"2024-09-15T21:55:22.483958+0000","last_peered":"2024-09-15T21:55:22.483958+0000","last_clean":"2024-09-15T21:55:22.483958+0000","last_became_active":"2024-09-15T21:55:21.080302+0000","last_became_peered":"2024-09-15T21:55:21.080302+0000","last_unstale":"2024-09-15T21:55:22.483958+0000","last_undegraded":"2024-09-15T21:55:22.483958+0000","last_fullsized":"2024-09-15T21:55:22.483958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:35.161272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485141+0000","last_change":"2024-09-15T21:55:20.050298+0000","last_active":"2024-09-15T21:55:22.485141+0000","last_peered":"2024-09-15T21:55:22.485141+0000","last_clean":"2024-09-15T21:55:22.485141+0000","last_became_active":"2024-09-15T21:55:20.049086+0000","last_became_peered":"2024-09-15T21:55:20.049086+0000","last_unstale":"2024-09-15T21:55:22.485141+0000","last_undegraded":"2024-09-15T21:55:22.485141+0000","last_fullsized":"2024-09-15T21:55:22.485141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484009+0000","last_change":"2024-09-15T21:55:21.079944+0000","last_active":"2024-09-15T21:55:22.484009+0000","last_peered":"2024-09-15T21:55:22.484009+0000","last_clean":"2024-09-15T21:55:22.484009+0000","last_became_active":"2024-09-15T21:55:21.079703+0000","last_became_peered":"2024-09-15T21:55:21.079703+0000","last_unstale":"2024-09-15T21:55:22.484009+0000","last_undegraded":"2024-09-15T21:55:22.484009+0000","last_fullsized":"2024-09-15T21:55:22.484009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:17.369451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039261+0000","last_change":"2024-09-15T21:55:20.067348+0000","last_active":"2024-09-15T21:55:22.039261+0000","last_peered":"2024-09-15T21:55:22.039261+0000","last_clean":"2024-09-15T21:55:22.039261+0000","last_became_active":"2024-09-15T21:55:20.066912+0000","last_became_peered":"2024-09-15T21:55:20.066912+0000","last_unstale":"2024-09-15T21:55:22.039261+0000","last_undegraded":"2024-09-15T21:55:22.039261+0000","last_fullsized":"2024-09-15T21:55:22.039261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:03.132039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484340+0000","last_change":"2024-09-15T21:55:21.092869+0000","last_active":"2024-09-15T21:55:22.484340+0000","last_peered":"2024-09-15T21:55:22.484340+0000","last_clean":"2024-09-15T21:55:22.484340+0000","last_became_active":"2024-09-15T21:55:21.092360+0000","last_became_peered":"2024-09-15T21:55:21.092360+0000","last_unstale":"2024-09-15T21:55:22.484340+0000","last_undegraded":"2024-09-15T21:55:22.484340+0000","last_fullsized":"2024-09-15T21:55:22.484340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:08.584649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037252+0000","last_change":"2024-09-15T21:55:20.046741+0000","last_active":"2024-09-15T21:55:22.037252+0000","last_peered":"2024-09-15T21:55:22.037252+0000","last_clean":"2024-09-15T21:55:22.037252+0000","last_became_active":"2024-09-15T21:55:20.044504+0000","last_became_peered":"2024-09-15T21:55:20.044504+0000","last_unstale":"2024-09-15T21:55:22.037252+0000","last_undegraded":"2024-09-15T21:55:22.037252+0000","last_fullsized":"2024-09-15T21:55:22.037252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.202000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037581+0000","last_change":"2024-09-15T21:55:21.065198+0000","last_active":"2024-09-15T21:55:22.037581+0000","last_peered":"2024-09-15T21:55:22.037581+0000","last_clean":"2024-09-15T21:55:22.037581+0000","last_became_active":"2024-09-15T21:55:21.064290+0000","last_became_peered":"2024-09-15T21:55:21.064290+0000","last_unstale":"2024-09-15T21:55:22.037581+0000","last_undegraded":"2024-09-15T21:55:22.037581+0000","last_fullsized":"2024-09-15T21:55:22.037581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:03:15.769453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224516+0000","last_change":"2024-09-15T21:55:20.045879+0000","last_active":"2024-09-15T21:55:22.224516+0000","last_peered":"2024-09-15T21:55:22.224516+0000","last_clean":"2024-09-15T21:55:22.224516+0000","last_became_active":"2024-09-15T21:55:20.045166+0000","last_became_peered":"2024-09-15T21:55:20.045166+0000","last_unstale":"2024-09-15T21:55:22.224516+0000","last_undegraded":"2024-09-15T21:55:22.224516+0000","last_fullsized":"2024-09-15T21:55:22.224516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:27.871582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484582+0000","last_change":"2024-09-15T21:55:21.091543+0000","last_active":"2024-09-15T21:55:22.484582+0000","last_peered":"2024-09-15T21:55:22.484582+0000","last_clean":"2024-09-15T21:55:22.484582+0000","last_became_active":"2024-09-15T21:55:21.088040+0000","last_became_peered":"2024-09-15T21:55:21.088040+0000","last_unstale":"2024-09-15T21:55:22.484582+0000","last_undegraded":"2024-09-15T21:55:22.484582+0000","last_fullsized":"2024-09-15T21:55:22.484582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:58.437513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472663+0000","last_change":"2024-09-15T21:55:20.060882+0000","last_active":"2024-09-15T21:55:22.472663+0000","last_peered":"2024-09-15T21:55:22.472663+0000","last_clean":"2024-09-15T21:55:22.472663+0000","last_became_active":"2024-09-15T21:55:20.059856+0000","last_became_peered":"2024-09-15T21:55:20.059856+0000","last_unstale":"2024-09-15T21:55:22.472663+0000","last_undegraded":"2024-09-15T21:55:22.472663+0000","last_fullsized":"2024-09-15T21:55:22.472663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484517+0000","last_change":"2024-09-15T21:55:21.088545+0000","last_active":"2024-09-15T21:55:22.484517+0000","last_peered":"2024-09-15T21:55:22.484517+0000","last_clean":"2024-09-15T21:55:22.484517+0000","last_became_active":"2024-09-15T21:55:21.080729+0000","last_became_peered":"2024-09-15T21:55:21.080729+0000","last_unstale":"2024-09-15T21:55:22.484517+0000","last_undegraded":"2024-09-15T21:55:22.484517+0000","last_fullsized":"2024-09-15T21:55:22.484517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:10.451575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224968+0000","last_change":"2024-09-15T21:55:20.053774+0000","last_active":"2024-09-15T21:55:22.224968+0000","last_peered":"2024-09-15T21:55:22.224968+0000","last_clean":"2024-09-15T21:55:22.224968+0000","last_became_active":"2024-09-15T21:55:20.053417+0000","last_became_peered":"2024-09-15T21:55:20.053417+0000","last_unstale":"2024-09-15T21:55:22.224968+0000","last_undegraded":"2024-09-15T21:55:22.224968+0000","last_fullsized":"2024-09-15T21:55:22.224968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:42:50.046558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484974+0000","last_change":"2024-09-15T21:55:21.088812+0000","last_active":"2024-09-15T21:55:22.484974+0000","last_peered":"2024-09-15T21:55:22.484974+0000","last_clean":"2024-09-15T21:55:22.484974+0000","last_became_active":"2024-09-15T21:55:21.088403+0000","last_became_peered":"2024-09-15T21:55:21.088403+0000","last_unstale":"2024-09-15T21:55:22.484974+0000","last_undegraded":"2024-09-15T21:55:22.484974+0000","last_fullsized":"2024-09-15T21:55:22.484974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:53:46.896732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034408+0000","last_change":"2024-09-15T21:55:20.049155+0000","last_active":"2024-09-15T21:55:22.034408+0000","last_peered":"2024-09-15T21:55:22.034408+0000","last_clean":"2024-09-15T21:55:22.034408+0000","last_became_active":"2024-09-15T21:55:20.048758+0000","last_became_peered":"2024-09-15T21:55:20.048758+0000","last_unstale":"2024-09-15T21:55:22.034408+0000","last_undegraded":"2024-09-15T21:55:22.034408+0000","last_fullsized":"2024-09-15T21:55:22.034408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:26.853149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039043+0000","last_change":"2024-09-15T21:55:21.080373+0000","last_active":"2024-09-15T21:55:22.039043+0000","last_peered":"2024-09-15T21:55:22.039043+0000","last_clean":"2024-09-15T21:55:22.039043+0000","last_became_active":"2024-09-15T21:55:21.079654+0000","last_became_peered":"2024-09-15T21:55:21.079654+0000","last_unstale":"2024-09-15T21:55:22.039043+0000","last_undegraded":"2024-09-15T21:55:22.039043+0000","last_fullsized":"2024-09-15T21:55:22.039043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:51.738245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224802+0000","last_change":"2024-09-15T21:55:20.057638+0000","last_active":"2024-09-15T21:55:22.224802+0000","last_peered":"2024-09-15T21:55:22.224802+0000","last_clean":"2024-09-15T21:55:22.224802+0000","last_became_active":"2024-09-15T21:55:20.057104+0000","last_became_peered":"2024-09-15T21:55:20.057104+0000","last_unstale":"2024-09-15T21:55:22.224802+0000","last_undegraded":"2024-09-15T21:55:22.224802+0000","last_fullsized":"2024-09-15T21:55:22.224802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:46.407918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484034+0000","last_change":"2024-09-15T21:55:21.092764+0000","last_active":"2024-09-15T21:55:22.484034+0000","last_peered":"2024-09-15T21:55:22.484034+0000","last_clean":"2024-09-15T21:55:22.484034+0000","last_became_active":"2024-09-15T21:55:21.092278+0000","last_became_peered":"2024-09-15T21:55:21.092278+0000","last_unstale":"2024-09-15T21:55:22.484034+0000","last_undegraded":"2024-09-15T21:55:22.484034+0000","last_fullsized":"2024-09-15T21:55:22.484034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:16.853013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483633+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:22.483633+0000","last_peered":"2024-09-15T21:55:22.483633+0000","last_clean":"2024-09-15T21:55:22.483633+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:22.483633+0000","last_undegraded":"2024-09-15T21:55:22.483633+0000","last_fullsized":"2024-09-15T21:55:22.483633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038105+0000","last_change":"2024-09-15T21:55:20.062164+0000","last_active":"2024-09-15T21:55:22.038105+0000","last_peered":"2024-09-15T21:55:22.038105+0000","last_clean":"2024-09-15T21:55:22.038105+0000","last_became_active":"2024-09-15T21:55:20.061451+0000","last_became_peered":"2024-09-15T21:55:20.061451+0000","last_unstale":"2024-09-15T21:55:22.038105+0000","last_undegraded":"2024-09-15T21:55:22.038105+0000","last_fullsized":"2024-09-15T21:55:22.038105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:46.832251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483314+0000","last_change":"2024-09-15T21:55:21.093819+0000","last_active":"2024-09-15T21:55:22.483314+0000","last_peered":"2024-09-15T21:55:22.483314+0000","last_clean":"2024-09-15T21:55:22.483314+0000","last_became_active":"2024-09-15T21:55:21.093514+0000","last_became_peered":"2024-09-15T21:55:21.093514+0000","last_unstale":"2024-09-15T21:55:22.483314+0000","last_undegraded":"2024-09-15T21:55:22.483314+0000","last_fullsized":"2024-09-15T21:55:22.483314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483452+0000","last_change":"2024-09-15T21:55:20.067427+0000","last_active":"2024-09-15T21:55:22.483452+0000","last_peered":"2024-09-15T21:55:22.483452+0000","last_clean":"2024-09-15T21:55:22.483452+0000","last_became_active":"2024-09-15T21:55:20.066778+0000","last_became_peered":"2024-09-15T21:55:20.066778+0000","last_unstale":"2024-09-15T21:55:22.483452+0000","last_undegraded":"2024-09-15T21:55:22.483452+0000","last_fullsized":"2024-09-15T21:55:22.483452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:26.867497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483333+0000","last_change":"2024-09-15T21:55:21.064883+0000","last_active":"2024-09-15T21:55:22.483333+0000","last_peered":"2024-09-15T21:55:22.483333+0000","last_clean":"2024-09-15T21:55:22.483333+0000","last_became_active":"2024-09-15T21:55:21.064565+0000","last_became_peered":"2024-09-15T21:55:21.064565+0000","last_unstale":"2024-09-15T21:55:22.483333+0000","last_undegraded":"2024-09-15T21:55:22.483333+0000","last_fullsized":"2024-09-15T21:55:22.483333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:27.419646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224713+0000","last_change":"2024-09-15T21:55:20.064316+0000","last_active":"2024-09-15T21:55:22.224713+0000","last_peered":"2024-09-15T21:55:22.224713+0000","last_clean":"2024-09-15T21:55:22.224713+0000","last_became_active":"2024-09-15T21:55:20.064010+0000","last_became_peered":"2024-09-15T21:55:20.064010+0000","last_unstale":"2024-09-15T21:55:22.224713+0000","last_undegraded":"2024-09-15T21:55:22.224713+0000","last_fullsized":"2024-09-15T21:55:22.224713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:55.450682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034330+0000","last_change":"2024-09-15T21:55:21.039824+0000","last_active":"2024-09-15T21:55:22.034330+0000","last_peered":"2024-09-15T21:55:22.034330+0000","last_clean":"2024-09-15T21:55:22.034330+0000","last_became_active":"2024-09-15T21:55:21.039532+0000","last_became_peered":"2024-09-15T21:55:21.039532+0000","last_unstale":"2024-09-15T21:55:22.034330+0000","last_undegraded":"2024-09-15T21:55:22.034330+0000","last_fullsized":"2024-09-15T21:55:22.034330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:03:15.769453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039468+0000","last_change":"2024-09-15T21:55:20.053996+0000","last_active":"2024-09-15T21:55:22.039468+0000","last_peered":"2024-09-15T21:55:22.039468+0000","last_clean":"2024-09-15T21:55:22.039468+0000","last_became_active":"2024-09-15T21:55:20.053487+0000","last_became_peered":"2024-09-15T21:55:20.053487+0000","last_unstale":"2024-09-15T21:55:22.039468+0000","last_undegraded":"2024-09-15T21:55:22.039468+0000","last_fullsized":"2024-09-15T21:55:22.039468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:05.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472458+0000","last_change":"2024-09-15T21:55:21.073289+0000","last_active":"2024-09-15T21:55:22.472458+0000","last_peered":"2024-09-15T21:55:22.472458+0000","last_clean":"2024-09-15T21:55:22.472458+0000","last_became_active":"2024-09-15T21:55:21.064508+0000","last_became_peered":"2024-09-15T21:55:21.064508+0000","last_unstale":"2024-09-15T21:55:22.472458+0000","last_undegraded":"2024-09-15T21:55:22.472458+0000","last_fullsized":"2024-09-15T21:55:22.472458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:27.863613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034372+0000","last_change":"2024-09-15T21:55:20.055656+0000","last_active":"2024-09-15T21:55:22.034372+0000","last_peered":"2024-09-15T21:55:22.034372+0000","last_clean":"2024-09-15T21:55:22.034372+0000","last_became_active":"2024-09-15T21:55:20.055168+0000","last_became_peered":"2024-09-15T21:55:20.055168+0000","last_unstale":"2024-09-15T21:55:22.034372+0000","last_undegraded":"2024-09-15T21:55:22.034372+0000","last_fullsized":"2024-09-15T21:55:22.034372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:05.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039815+0000","last_change":"2024-09-15T21:55:21.079617+0000","last_active":"2024-09-15T21:55:22.039815+0000","last_peered":"2024-09-15T21:55:22.039815+0000","last_clean":"2024-09-15T21:55:22.039815+0000","last_became_active":"2024-09-15T21:55:21.078651+0000","last_became_peered":"2024-09-15T21:55:21.078651+0000","last_unstale":"2024-09-15T21:55:22.039815+0000","last_undegraded":"2024-09-15T21:55:22.039815+0000","last_fullsized":"2024-09-15T21:55:22.039815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:13.196570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484562+0000","last_change":"2024-09-15T21:55:20.067021+0000","last_active":"2024-09-15T21:55:22.484562+0000","last_peered":"2024-09-15T21:55:22.484562+0000","last_clean":"2024-09-15T21:55:22.484562+0000","last_became_active":"2024-09-15T21:55:20.066354+0000","last_became_peered":"2024-09-15T21:55:20.066354+0000","last_unstale":"2024-09-15T21:55:22.484562+0000","last_undegraded":"2024-09-15T21:55:22.484562+0000","last_fullsized":"2024-09-15T21:55:22.484562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:57.837195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034197+0000","last_change":"2024-09-15T21:55:21.043432+0000","last_active":"2024-09-15T21:55:22.034197+0000","last_peered":"2024-09-15T21:55:22.034197+0000","last_clean":"2024-09-15T21:55:22.034197+0000","last_became_active":"2024-09-15T21:55:21.043150+0000","last_became_peered":"2024-09-15T21:55:21.043150+0000","last_unstale":"2024-09-15T21:55:22.034197+0000","last_undegraded":"2024-09-15T21:55:22.034197+0000","last_fullsized":"2024-09-15T21:55:22.034197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:45.407449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034641+0000","last_change":"2024-09-15T21:55:20.051483+0000","last_active":"2024-09-15T21:55:22.034641+0000","last_peered":"2024-09-15T21:55:22.034641+0000","last_clean":"2024-09-15T21:55:22.034641+0000","last_became_active":"2024-09-15T21:55:20.051077+0000","last_became_peered":"2024-09-15T21:55:20.051077+0000","last_unstale":"2024-09-15T21:55:22.034641+0000","last_undegraded":"2024-09-15T21:55:22.034641+0000","last_fullsized":"2024-09-15T21:55:22.034641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.202000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484985+0000","last_change":"2024-09-15T21:55:21.090900+0000","last_active":"2024-09-15T21:55:22.484985+0000","last_peered":"2024-09-15T21:55:22.484985+0000","last_clean":"2024-09-15T21:55:22.484985+0000","last_became_active":"2024-09-15T21:55:21.090600+0000","last_became_peered":"2024-09-15T21:55:21.090600+0000","last_unstale":"2024-09-15T21:55:22.484985+0000","last_undegraded":"2024-09-15T21:55:22.484985+0000","last_fullsized":"2024-09-15T21:55:22.484985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:51.738245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037826+0000","last_change":"2024-09-15T21:55:20.058425+0000","last_active":"2024-09-15T21:55:22.037826+0000","last_peered":"2024-09-15T21:55:22.037826+0000","last_clean":"2024-09-15T21:55:22.037826+0000","last_became_active":"2024-09-15T21:55:20.057897+0000","last_became_peered":"2024-09-15T21:55:20.057897+0000","last_unstale":"2024-09-15T21:55:22.037826+0000","last_undegraded":"2024-09-15T21:55:22.037826+0000","last_fullsized":"2024-09-15T21:55:22.037826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:05.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485013+0000","last_change":"2024-09-15T21:55:21.055808+0000","last_active":"2024-09-15T21:55:22.485013+0000","last_peered":"2024-09-15T21:55:22.485013+0000","last_clean":"2024-09-15T21:55:22.485013+0000","last_became_active":"2024-09-15T21:55:21.054995+0000","last_became_peered":"2024-09-15T21:55:21.054995+0000","last_unstale":"2024-09-15T21:55:22.485013+0000","last_undegraded":"2024-09-15T21:55:22.485013+0000","last_fullsized":"2024-09-15T21:55:22.485013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483454+0000","last_change":"2024-09-15T21:55:20.067341+0000","last_active":"2024-09-15T21:55:22.483454+0000","last_peered":"2024-09-15T21:55:22.483454+0000","last_clean":"2024-09-15T21:55:22.483454+0000","last_became_active":"2024-09-15T21:55:20.066114+0000","last_became_peered":"2024-09-15T21:55:20.066114+0000","last_unstale":"2024-09-15T21:55:22.483454+0000","last_undegraded":"2024-09-15T21:55:22.483454+0000","last_fullsized":"2024-09-15T21:55:22.483454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:54.611870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472372+0000","last_change":"2024-09-15T21:55:21.065815+0000","last_active":"2024-09-15T21:55:22.472372+0000","last_peered":"2024-09-15T21:55:22.472372+0000","last_clean":"2024-09-15T21:55:22.472372+0000","last_became_active":"2024-09-15T21:55:21.064866+0000","last_became_peered":"2024-09-15T21:55:21.064866+0000","last_unstale":"2024-09-15T21:55:22.472372+0000","last_undegraded":"2024-09-15T21:55:22.472372+0000","last_fullsized":"2024-09-15T21:55:22.472372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:06.281118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034646+0000","last_change":"2024-09-15T21:55:20.057081+0000","last_active":"2024-09-15T21:55:22.034646+0000","last_peered":"2024-09-15T21:55:22.034646+0000","last_clean":"2024-09-15T21:55:22.034646+0000","last_became_active":"2024-09-15T21:55:20.056673+0000","last_became_peered":"2024-09-15T21:55:20.056673+0000","last_unstale":"2024-09-15T21:55:22.034646+0000","last_undegraded":"2024-09-15T21:55:22.034646+0000","last_fullsized":"2024-09-15T21:55:22.034646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:06.723350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482625+0000","last_change":"2024-09-15T21:55:21.042285+0000","last_active":"2024-09-15T21:55:22.482625+0000","last_peered":"2024-09-15T21:55:22.482625+0000","last_clean":"2024-09-15T21:55:22.482625+0000","last_became_active":"2024-09-15T21:55:21.041896+0000","last_became_peered":"2024-09-15T21:55:21.041896+0000","last_unstale":"2024-09-15T21:55:22.482625+0000","last_undegraded":"2024-09-15T21:55:22.482625+0000","last_fullsized":"2024-09-15T21:55:22.482625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:03:15.769453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034611+0000","last_change":"2024-09-15T21:55:20.053890+0000","last_active":"2024-09-15T21:55:22.034611+0000","last_peered":"2024-09-15T21:55:22.034611+0000","last_clean":"2024-09-15T21:55:22.034611+0000","last_became_active":"2024-09-15T21:55:20.053359+0000","last_became_peered":"2024-09-15T21:55:20.053359+0000","last_unstale":"2024-09-15T21:55:22.034611+0000","last_undegraded":"2024-09-15T21:55:22.034611+0000","last_fullsized":"2024-09-15T21:55:22.034611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:17.530256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483756+0000","last_change":"2024-09-15T21:55:21.060275+0000","last_active":"2024-09-15T21:55:22.483756+0000","last_peered":"2024-09-15T21:55:22.483756+0000","last_clean":"2024-09-15T21:55:22.483756+0000","last_became_active":"2024-09-15T21:55:21.059657+0000","last_became_peered":"2024-09-15T21:55:21.059657+0000","last_unstale":"2024-09-15T21:55:22.483756+0000","last_undegraded":"2024-09-15T21:55:22.483756+0000","last_fullsized":"2024-09-15T21:55:22.483756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:56.272087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484372+0000","last_change":"2024-09-15T21:55:20.066502+0000","last_active":"2024-09-15T21:55:22.484372+0000","last_peered":"2024-09-15T21:55:22.484372+0000","last_clean":"2024-09-15T21:55:22.484372+0000","last_became_active":"2024-09-15T21:55:20.066143+0000","last_became_peered":"2024-09-15T21:55:20.066143+0000","last_unstale":"2024-09-15T21:55:22.484372+0000","last_undegraded":"2024-09-15T21:55:22.484372+0000","last_fullsized":"2024-09-15T21:55:22.484372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:26.132589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037228+0000","last_change":"2024-09-15T21:55:21.056694+0000","last_active":"2024-09-15T21:55:22.037228+0000","last_peered":"2024-09-15T21:55:22.037228+0000","last_clean":"2024-09-15T21:55:22.037228+0000","last_became_active":"2024-09-15T21:55:21.055728+0000","last_became_peered":"2024-09-15T21:55:21.055728+0000","last_unstale":"2024-09-15T21:55:22.037228+0000","last_undegraded":"2024-09-15T21:55:22.037228+0000","last_fullsized":"2024-09-15T21:55:22.037228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:45.407449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039691+0000","last_change":"2024-09-15T21:55:21.083720+0000","last_active":"2024-09-15T21:55:22.039691+0000","last_peered":"2024-09-15T21:55:22.039691+0000","last_clean":"2024-09-15T21:55:22.039691+0000","last_became_active":"2024-09-15T21:55:21.083110+0000","last_became_peered":"2024-09-15T21:55:21.083110+0000","last_unstale":"2024-09-15T21:55:22.039691+0000","last_undegraded":"2024-09-15T21:55:22.039691+0000","last_fullsized":"2024-09-15T21:55:22.039691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:45:22.889914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483812+0000","last_change":"2024-09-15T21:55:20.069937+0000","last_active":"2024-09-15T21:55:22.483812+0000","last_peered":"2024-09-15T21:55:22.483812+0000","last_clean":"2024-09-15T21:55:22.483812+0000","last_became_active":"2024-09-15T21:55:20.069454+0000","last_became_peered":"2024-09-15T21:55:20.069454+0000","last_unstale":"2024-09-15T21:55:22.483812+0000","last_undegraded":"2024-09-15T21:55:22.483812+0000","last_fullsized":"2024-09-15T21:55:22.483812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:40.942879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038724+0000","last_change":"2024-09-15T21:55:21.082991+0000","last_active":"2024-09-15T21:55:22.038724+0000","last_peered":"2024-09-15T21:55:22.038724+0000","last_clean":"2024-09-15T21:55:22.038724+0000","last_became_active":"2024-09-15T21:55:21.082634+0000","last_became_peered":"2024-09-15T21:55:21.082634+0000","last_unstale":"2024-09-15T21:55:22.038724+0000","last_undegraded":"2024-09-15T21:55:22.038724+0000","last_fullsized":"2024-09-15T21:55:22.038724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:23:53.907941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484270+0000","last_change":"2024-09-15T21:55:20.068019+0000","last_active":"2024-09-15T21:55:22.484270+0000","last_peered":"2024-09-15T21:55:22.484270+0000","last_clean":"2024-09-15T21:55:22.484270+0000","last_became_active":"2024-09-15T21:55:20.067127+0000","last_became_peered":"2024-09-15T21:55:20.067127+0000","last_unstale":"2024-09-15T21:55:22.484270+0000","last_undegraded":"2024-09-15T21:55:22.484270+0000","last_fullsized":"2024-09-15T21:55:22.484270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:10.484227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484179+0000","last_change":"2024-09-15T21:55:21.091582+0000","last_active":"2024-09-15T21:55:22.484179+0000","last_peered":"2024-09-15T21:55:22.484179+0000","last_clean":"2024-09-15T21:55:22.484179+0000","last_became_active":"2024-09-15T21:55:21.091286+0000","last_became_peered":"2024-09-15T21:55:21.091286+0000","last_unstale":"2024-09-15T21:55:22.484179+0000","last_undegraded":"2024-09-15T21:55:22.484179+0000","last_fullsized":"2024-09-15T21:55:22.484179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:29.617932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484237+0000","last_change":"2024-09-15T21:55:20.055671+0000","last_active":"2024-09-15T21:55:22.484237+0000","last_peered":"2024-09-15T21:55:22.484237+0000","last_clean":"2024-09-15T21:55:22.484237+0000","last_became_active":"2024-09-15T21:55:20.054385+0000","last_became_peered":"2024-09-15T21:55:20.054385+0000","last_unstale":"2024-09-15T21:55:22.484237+0000","last_undegraded":"2024-09-15T21:55:22.484237+0000","last_fullsized":"2024-09-15T21:55:22.484237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483963+0000","last_change":"2024-09-15T21:55:21.051450+0000","last_active":"2024-09-15T21:55:22.483963+0000","last_peered":"2024-09-15T21:55:22.483963+0000","last_clean":"2024-09-15T21:55:22.483963+0000","last_became_active":"2024-09-15T21:55:21.051151+0000","last_became_peered":"2024-09-15T21:55:21.051151+0000","last_unstale":"2024-09-15T21:55:22.483963+0000","last_undegraded":"2024-09-15T21:55:22.483963+0000","last_fullsized":"2024-09-15T21:55:22.483963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:44.705672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484447+0000","last_change":"2024-09-15T21:55:20.057739+0000","last_active":"2024-09-15T21:55:22.484447+0000","last_peered":"2024-09-15T21:55:22.484447+0000","last_clean":"2024-09-15T21:55:22.484447+0000","last_became_active":"2024-09-15T21:55:20.056988+0000","last_became_peered":"2024-09-15T21:55:20.056988+0000","last_unstale":"2024-09-15T21:55:22.484447+0000","last_undegraded":"2024-09-15T21:55:22.484447+0000","last_fullsized":"2024-09-15T21:55:22.484447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":72837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":663753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:55:29.904 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T21:55:29.904 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T21:55:29.904 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-15T21:55:29.904 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-15T21:55:29.905 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-15T21:55:30.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.061+0000 7fc8a2581640 1 Processor -- start 2024-09-15T21:55:30.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc8a2581640 1 -- start start 2024-09-15T21:55:30.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc8a2581640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b5220 0x7fc89c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc8a2581640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc89c148f20 0x7fc89c1493d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc8a2581640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc89c09f520 con 0x7fc89c0b5600 2024-09-15T21:55:30.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc8a2581640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fc89c09b800 con 0x7fc89c148f20 2024-09-15T21:55:30.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc8a2581640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc89c149910 con 0x7fc89c0b5220 2024-09-15T21:55:30.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89b7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc89c0b5600 0x7fc89c09ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49650/0 (socket says 172.21.15.1:49650) 2024-09-15T21:55:30.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89b7fe640 1 -- 172.21.15.1:0/2076459220 learned_addr learned my addr 172.21.15.1:0/2076459220 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:30.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc8a0b1e640 1 --2- 172.21.15.1:0/2076459220 >> v2:172.21.15.70:3300/0 conn(0x7fc89c148f20 0x7fc89c1493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89bfff640 1 --2- 172.21.15.1:0/2076459220 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b5220 0x7fc89c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135486929 0 0) 0x7fc89c09f520 con 0x7fc89c0b5600 2024-09-15T21:55:30.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc888003530 con 0x7fc89c0b5600 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2471257437 0 0) 0x7fc888003530 con 0x7fc89c0b5600 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b5220 msgr2=0x7fc89c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 --2- 172.21.15.1:0/2076459220 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b5220 0x7fc89c09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 >> v2:172.21.15.70:3300/0 conn(0x7fc89c148f20 msgr2=0x7fc89c1493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 --2- 172.21.15.1:0/2076459220 >> v2:172.21.15.70:3300/0 conn(0x7fc89c148f20 0x7fc89c1493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89c0b6a50 con 0x7fc89c0b5600 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7fc884001680 con 0x7fc89c0b5600 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 >> v1:172.21.15.1:6789/0 conn(0x7fc89c0b5600 legacy=0x7fc89c09ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 --2- 172.21.15.1:0/2076459220 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b5220 0x7fc8880039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 --2- 172.21.15.1:0/2076459220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc888003f40 0x7fc888004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 --2- 172.21.15.1:0/2076459220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc888004d50 0x7fc8880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c09b800 con 0x7fc888004d50 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c149910 con 0x7fc888003f40 2024-09-15T21:55:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc88800bab0 con 0x7fc89c0b5220 2024-09-15T21:55:30.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc8a0b1e640 1 --2- 172.21.15.1:0/2076459220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc888004d50 0x7fc8880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89b7fe640 1 --2- 172.21.15.1:0/2076459220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc888003f40 0x7fc888004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89bfff640 1 --2- 172.21.15.1:0/2076459220 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b5220 0x7fc8880039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc8a0b1e640 1 -- 172.21.15.1:0/2076459220 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b5220 msgr2=0x7fc8880039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:30.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc8a0b1e640 1 --2- 172.21.15.1:0/2076459220 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b5220 0x7fc8880039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc8a0b1e640 1 -- 172.21.15.1:0/2076459220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc888003f40 msgr2=0x7fc888004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:30.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc8a0b1e640 1 --2- 172.21.15.1:0/2076459220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc888003f40 0x7fc888004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc8a0b1e640 1 -- 172.21.15.1:0/2076459220 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc888003530 con 0x7fc888004d50 2024-09-15T21:55:30.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.065+0000 7fc89bfff640 1 --2- 172.21.15.1:0/2076459220 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b5220 0x7fc8880039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:30.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a0b1e640 1 --2- 172.21.15.1:0/2076459220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc888004d50 0x7fc8880051d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009ae0 tx=0x7fc88c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c77a54fd43014c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c0b2070 con 0x7fc888004d50 2024-09-15T21:55:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc88c0a5570 con 0x7fc888004d50 2024-09-15T21:55:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89affd640 1 -- 172.21.15.1:0/2076459220 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c0096b0 con 0x7fc888004d50 2024-09-15T21:55:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 -- 172.21.15.1:0/2076459220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc888004d50 msgr2=0x7fc8880051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 --2- 172.21.15.1:0/2076459220 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc888004d50 0x7fc8880051d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009ae0 tx=0x7fc88c01cab0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a0b1e640 1 -- 172.21.15.1:0/2076459220 reap_dead start 2024-09-15T21:55:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 -- 172.21.15.1:0/2076459220 shutdown_connections 2024-09-15T21:55:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 -- 172.21.15.1:0/2076459220 >> 172.21.15.1:0/2076459220 conn(0x7fc89c0b5c40 msgr2=0x7fc89c0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 -- 172.21.15.1:0/2076459220 shutdown_connections 2024-09-15T21:55:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 -- 172.21.15.1:0/2076459220 wait complete. 2024-09-15T21:55:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 Processor -- start 2024-09-15T21:55:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 -- start start 2024-09-15T21:55:30.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc888004d50 0x7fc89c072610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b1af0 0x7fc89c0af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc89c0afa80 0x7fc89c0b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c150870 con 0x7fc888004d50 2024-09-15T21:55:30.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c1506f0 con 0x7fc89c0afa80 2024-09-15T21:55:30.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc89c1509f0 con 0x7fc89c0b1af0 2024-09-15T21:55:30.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc888004d50 0x7fc89c072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc888004d50 0x7fc89c072610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60248/0 (socket says 172.21.15.1:60248) 2024-09-15T21:55:30.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89bfff640 1 -- 172.21.15.1:0/948622427 learned_addr learned my addr 172.21.15.1:0/948622427 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:30.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a0b1e640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc89c0afa80 0x7fc89c0b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89b7fe640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b1af0 0x7fc89c0af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89bfff640 1 -- 172.21.15.1:0/948622427 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b1af0 msgr2=0x7fc89c0af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89bfff640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b1af0 0x7fc89c0af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89bfff640 1 -- 172.21.15.1:0/948622427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc89c0afa80 msgr2=0x7fc89c0b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89bfff640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc89c0afa80 0x7fc89c0b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89bfff640 1 -- 172.21.15.1:0/948622427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89c0b2b50 con 0x7fc888004d50 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89b7fe640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b1af0 0x7fc89c0af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc89bfff640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc888004d50 0x7fc89c072610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc89400f380 tx=0x7fc89400f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc898ff9640 1 -- 172.21.15.1:0/948622427 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc894003ba0 con 0x7fc888004d50 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc898ff9640 1 -- 172.21.15.1:0/948622427 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc894003d40 con 0x7fc888004d50 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 -- 172.21.15.1:0/948622427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89c0b35c0 con 0x7fc888004d50 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc898ff9640 1 -- 172.21.15.1:0/948622427 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc894004220 con 0x7fc888004d50 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.069+0000 7fc8a2581640 1 -- 172.21.15.1:0/948622427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89c0b2590 con 0x7fc888004d50 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.073+0000 7fc8a2581640 1 -- 172.21.15.1:0/948622427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc89c1493d0 con 0x7fc888004d50 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.073+0000 7fc898ff9640 1 -- 172.21.15.1:0/948622427 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc89401e020 con 0x7fc888004d50 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.073+0000 7fc898ff9640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc87c0678c0 0x7fc87c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.073+0000 7fc898ff9640 1 -- 172.21.15.1:0/948622427 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc894086380 con 0x7fc888004d50 2024-09-15T21:55:30.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.073+0000 7fc89b7fe640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc87c0678c0 0x7fc87c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.073+0000 7fc89b7fe640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc87c0678c0 0x7fc87c069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc884001ec0 tx=0x7fc884001050 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:30.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.077+0000 7fc898ff9640 1 -- 172.21.15.1:0/948622427 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc894012070 con 0x7fc888004d50 2024-09-15T21:55:30.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.281+0000 7fc8a2581640 1 -- 172.21.15.1:0/948622427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc89c0b2e80 con 0x7fc888004d50 2024-09-15T21:55:30.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.289+0000 7fc898ff9640 1 -- 172.21.15.1:0/948622427 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166879 (secure 0 0 0) 0x7fc894056f50 con 0x7fc888004d50 2024-09-15T21:55:30.293 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:30.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.289+0000 7fc8a2581640 1 -- 172.21.15.1:0/948622427 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc87c0678c0 msgr2=0x7fc87c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.289+0000 7fc8a2581640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc87c0678c0 0x7fc87c069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc884001ec0 tx=0x7fc884001050 comp rx=0 tx=0).stop 2024-09-15T21:55:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.289+0000 7fc8a2581640 1 -- 172.21.15.1:0/948622427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc888004d50 msgr2=0x7fc89c072610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.289+0000 7fc8a2581640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc888004d50 0x7fc89c072610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc89400f380 tx=0x7fc89400f840 comp rx=0 tx=0).stop 2024-09-15T21:55:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.289+0000 7fc8a2581640 1 -- 172.21.15.1:0/948622427 shutdown_connections 2024-09-15T21:55:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.289+0000 7fc8a2581640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc87c0678c0 0x7fc87c069d80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.289+0000 7fc8a2581640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc89c0afa80 0x7fc89c0b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.289+0000 7fc8a2581640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc89c0b1af0 0x7fc89c0af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.289+0000 7fc8a2581640 1 --2- 172.21.15.1:0/948622427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc888004d50 0x7fc89c072610 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.289+0000 7fc8a2581640 1 -- 172.21.15.1:0/948622427 >> 172.21.15.1:0/948622427 conn(0x7fc89c0b5c40 msgr2=0x7fc89c06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.293+0000 7fc8a2581640 1 -- 172.21.15.1:0/948622427 shutdown_connections 2024-09-15T21:55:30.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.293+0000 7fc8a2581640 1 -- 172.21.15.1:0/948622427 wait complete. 2024-09-15T21:55:30.312 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":1604983224},{"type":"v1","addr":"172.21.15.1:6809","nonce":1604983224}]},"active_addr":"172.21.15.1:6809/1604983224","active_change":"2024-09-15T21:55:01.053736+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":3035727546}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":3396100005}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":3669455519}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":461220126}]}]} 2024-09-15T21:55:30.315 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-15T21:55:30.315 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T21:55:30.315 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:30.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd75dfa6640 1 Processor -- start 2024-09-15T21:55:30.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd75dfa6640 1 -- start start 2024-09-15T21:55:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd75dfa6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7580b5220 0x7fd75809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd75dfa6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd7580b5600 0x7fd75809ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd75dfa6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd758148f20 0x7fd7581493d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd75dfa6640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fd75809b800 con 0x7fd758148f20 2024-09-15T21:55:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd75dfa6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fd758149910 con 0x7fd7580b5600 2024-09-15T21:55:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd75dfa6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd7580b4dd0 con 0x7fd7580b5220 2024-09-15T21:55:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd757fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd758148f20 0x7fd7581493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd757fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd758148f20 0x7fd7581493d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60264/0 (socket says 172.21.15.1:60264) 2024-09-15T21:55:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd757fff640 1 -- 172.21.15.1:0/1408617696 learned_addr learned my addr 172.21.15.1:0/1408617696 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd756ffd640 1 --2- 172.21.15.1:0/1408617696 >> v2:172.21.15.70:3300/0 conn(0x7fd7580b5600 0x7fd75809ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd7577fe640 1 --2- 172.21.15.1:0/1408617696 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7580b5220 0x7fd75809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd757fff640 1 -- 172.21.15.1:0/1408617696 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7580b5220 msgr2=0x7fd75809aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd757fff640 1 --2- 172.21.15.1:0/1408617696 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7580b5220 0x7fd75809aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd757fff640 1 -- 172.21.15.1:0/1408617696 >> v2:172.21.15.70:3300/0 conn(0x7fd7580b5600 msgr2=0x7fd75809ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd757fff640 1 --2- 172.21.15.1:0/1408617696 >> v2:172.21.15.70:3300/0 conn(0x7fd7580b5600 0x7fd75809ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd757fff640 1 -- 172.21.15.1:0/1408617696 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7580b6a50 con 0x7fd758148f20 2024-09-15T21:55:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.433+0000 7fd756ffd640 1 --2- 172.21.15.1:0/1408617696 >> v2:172.21.15.70:3300/0 conn(0x7fd7580b5600 0x7fd75809ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:30.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.437+0000 7fd757fff640 1 --2- 172.21.15.1:0/1408617696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd758148f20 0x7fd7581493d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd75806ea00 tx=0x7fd75001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb90ccce90e603d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:30.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.437+0000 7fd7567fc640 1 -- 172.21.15.1:0/1408617696 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7500b1070 con 0x7fd758148f20 2024-09-15T21:55:30.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.437+0000 7fd7567fc640 1 -- 172.21.15.1:0/1408617696 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7500ac620 con 0x7fd758148f20 2024-09-15T21:55:30.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.437+0000 7fd7567fc640 1 -- 172.21.15.1:0/1408617696 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7500ac9f0 con 0x7fd758148f20 2024-09-15T21:55:30.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.437+0000 7fd75dfa6640 1 -- 172.21.15.1:0/1408617696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd758148f20 msgr2=0x7fd7581493d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.437+0000 7fd75dfa6640 1 --2- 172.21.15.1:0/1408617696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd758148f20 0x7fd7581493d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd75806ea00 tx=0x7fd75001c400 comp rx=0 tx=0).stop 2024-09-15T21:55:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.437+0000 7fd75dfa6640 1 -- 172.21.15.1:0/1408617696 shutdown_connections 2024-09-15T21:55:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.437+0000 7fd75dfa6640 1 --2- 172.21.15.1:0/1408617696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd758148f20 0x7fd7581493d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.437+0000 7fd75dfa6640 1 --2- 172.21.15.1:0/1408617696 >> v2:172.21.15.70:3300/0 conn(0x7fd7580b5600 0x7fd75809ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.437+0000 7fd75dfa6640 1 --2- 172.21.15.1:0/1408617696 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7580b5220 0x7fd75809aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.437+0000 7fd75dfa6640 1 -- 172.21.15.1:0/1408617696 >> 172.21.15.1:0/1408617696 conn(0x7fd7580b5c40 msgr2=0x7fd7580b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.437+0000 7fd75dfa6640 1 -- 172.21.15.1:0/1408617696 shutdown_connections 2024-09-15T21:55:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.437+0000 7fd75dfa6640 1 -- 172.21.15.1:0/1408617696 wait complete. 2024-09-15T21:55:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd75dfa6640 1 Processor -- start 2024-09-15T21:55:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd75dfa6640 1 -- start start 2024-09-15T21:55:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd75dfa6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580b5220 0x7fd758141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd75dfa6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7580b5600 0x7fd7580ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd75dfa6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd758148f20 0x7fd7581df540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd75dfa6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd75809f4d0 con 0x7fd7580b5220 2024-09-15T21:55:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd75dfa6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd75809f350 con 0x7fd758148f20 2024-09-15T21:55:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd75dfa6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd7580b4350 con 0x7fd7580b5600 2024-09-15T21:55:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd7577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580b5220 0x7fd758141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd7577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580b5220 0x7fd758141f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60266/0 (socket says 172.21.15.1:60266) 2024-09-15T21:55:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd7577fe640 1 -- 172.21.15.1:0/3798661065 learned_addr learned my addr 172.21.15.1:0/3798661065 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd756ffd640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7580b5600 0x7fd7580ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd757fff640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd758148f20 0x7fd7581df540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd7577fe640 1 -- 172.21.15.1:0/3798661065 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7580b5600 msgr2=0x7fd7580ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd7577fe640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7580b5600 0x7fd7580ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd7577fe640 1 -- 172.21.15.1:0/3798661065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd758148f20 msgr2=0x7fd7581df540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd7577fe640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd758148f20 0x7fd7581df540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd7577fe640 1 -- 172.21.15.1:0/3798661065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7580aee10 con 0x7fd7580b5220 2024-09-15T21:55:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd757fff640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd758148f20 0x7fd7581df540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd7577fe640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580b5220 0x7fd758141f90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd74800d5f0 tx=0x7fd74800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd73ffff640 1 -- 172.21.15.1:0/3798661065 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7480125f0 con 0x7fd7580b5220 2024-09-15T21:55:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd73ffff640 1 -- 172.21.15.1:0/3798661065 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd748019070 con 0x7fd7580b5220 2024-09-15T21:55:30.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd73ffff640 1 -- 172.21.15.1:0/3798661065 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7480129b0 con 0x7fd7580b5220 2024-09-15T21:55:30.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd75dfa6640 1 -- 172.21.15.1:0/3798661065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7580af0e0 con 0x7fd7580b5220 2024-09-15T21:55:30.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd75dfa6640 1 -- 172.21.15.1:0/3798661065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd758142c80 con 0x7fd7580b5220 2024-09-15T21:55:30.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd75dfa6640 1 -- 172.21.15.1:0/3798661065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7580af7f0 con 0x7fd7580b5220 2024-09-15T21:55:30.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd73ffff640 1 -- 172.21.15.1:0/3798661065 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd748012b50 con 0x7fd7580b5220 2024-09-15T21:55:30.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd73ffff640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd7440678c0 0x7fd744069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd73ffff640 1 -- 172.21.15.1:0/3798661065 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd748086040 con 0x7fd7580b5220 2024-09-15T21:55:30.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.441+0000 7fd756ffd640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd7440678c0 0x7fd744069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.445+0000 7fd756ffd640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd7440678c0 0x7fd744069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0095c0 tx=0x7fd74c0094f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:30.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.445+0000 7fd73ffff640 1 -- 172.21.15.1:0/3798661065 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd748056c10 con 0x7fd7580b5220 2024-09-15T21:55:30.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.605+0000 7fd75dfa6640 1 -- 172.21.15.1:0/3798661065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7580b4710 con 0x7fd7580b5220 2024-09-15T21:55:30.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.609+0000 7fd73ffff640 1 -- 172.21.15.1:0/3798661065 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16593 (secure 0 0 0) 0x7fd748056510 con 0x7fd7580b5220 2024-09-15T21:55:30.612 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:30.612 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:22.028149+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:18.271646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:19.444906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:30.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.609+0000 7fd75dfa6640 1 -- 172.21.15.1:0/3798661065 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd7440678c0 msgr2=0x7fd744069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.609+0000 7fd75dfa6640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd7440678c0 0x7fd744069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0095c0 tx=0x7fd74c0094f0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.609+0000 7fd75dfa6640 1 -- 172.21.15.1:0/3798661065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580b5220 msgr2=0x7fd758141f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.609+0000 7fd75dfa6640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580b5220 0x7fd758141f90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd74800d5f0 tx=0x7fd74800dab0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.609+0000 7fd75dfa6640 1 -- 172.21.15.1:0/3798661065 shutdown_connections 2024-09-15T21:55:30.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.609+0000 7fd75dfa6640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd7440678c0 0x7fd744069d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.609+0000 7fd75dfa6640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd758148f20 0x7fd7581df540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.609+0000 7fd75dfa6640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7580b5600 0x7fd7580ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.609+0000 7fd75dfa6640 1 --2- 172.21.15.1:0/3798661065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7580b5220 0x7fd758141f90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.609+0000 7fd75dfa6640 1 -- 172.21.15.1:0/3798661065 >> 172.21.15.1:0/3798661065 conn(0x7fd7580b5c40 msgr2=0x7fd7580b6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:30.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.609+0000 7fd75dfa6640 1 -- 172.21.15.1:0/3798661065 shutdown_connections 2024-09-15T21:55:30.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.609+0000 7fd75dfa6640 1 -- 172.21.15.1:0/3798661065 wait complete. 2024-09-15T21:55:30.630 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T21:55:30.630 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:30.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.733+0000 7fc4bafc6640 1 Processor -- start 2024-09-15T21:55:30.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.733+0000 7fc4bafc6640 1 -- start start 2024-09-15T21:55:30.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4bafc6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc4b40b5220 0x7fc4b409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4bafc6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc4b40b5600 0x7fc4b409ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4bafc6640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b40b6a50 con 0x7fc4b4148f20 2024-09-15T21:55:30.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4bafc6640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b409b800 con 0x7fc4b40b5220 2024-09-15T21:55:30.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4bafc6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b40b4dd0 con 0x7fc4b40b5600 2024-09-15T21:55:30.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b8d62640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc4b40b5220 0x7fc4b409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b9563640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc4b4148f20 0x7fc4b4149370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49660/0 (socket says 172.21.15.1:49660) 2024-09-15T21:55:30.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b9563640 1 -- 172.21.15.1:0/2047787366 learned_addr learned my addr 172.21.15.1:0/2047787366 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:30.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b8d62640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc4b40b5220 0x7fc4b409aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60276/0 (socket says 172.21.15.1:60276) 2024-09-15T21:55:30.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b3fff640 1 --2- 172.21.15.1:0/2047787366 >> v2:172.21.15.70:3300/0 conn(0x7fc4b40b5600 0x7fc4b409ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b8d62640 1 -- 172.21.15.1:0/2047787366 >> v2:172.21.15.70:3300/0 conn(0x7fc4b40b5600 msgr2=0x7fc4b409ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:30.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b8d62640 1 --2- 172.21.15.1:0/2047787366 >> v2:172.21.15.70:3300/0 conn(0x7fc4b40b5600 0x7fc4b409ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b8d62640 1 -- 172.21.15.1:0/2047787366 >> v1:172.21.15.1:6789/0 conn(0x7fc4b4148f20 legacy=0x7fc4b4149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b37fe640 1 -- 172.21.15.1:0/2047787366 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071787692 0 0) 0x7fc4b40b6a50 con 0x7fc4b4148f20 2024-09-15T21:55:30.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b8d62640 1 -- 172.21.15.1:0/2047787366 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b409af90 con 0x7fc4b40b5220 2024-09-15T21:55:30.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b3fff640 1 --2- 172.21.15.1:0/2047787366 >> v2:172.21.15.70:3300/0 conn(0x7fc4b40b5600 0x7fc4b409ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:30.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b8d62640 1 --2- 172.21.15.1:0/2047787366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4b40b5220 0x7fc4b409aa50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc4b406e530 tx=0x7fc4a401c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5885e31999eb1345 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:30.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b37fe640 1 -- 172.21.15.1:0/2047787366 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40b2070 con 0x7fc4b40b5220 2024-09-15T21:55:30.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b37fe640 1 -- 172.21.15.1:0/2047787366 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a40a58a0 con 0x7fc4b40b5220 2024-09-15T21:55:30.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.737+0000 7fc4b37fe640 1 -- 172.21.15.1:0/2047787366 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40a5c70 con 0x7fc4b40b5220 2024-09-15T21:55:30.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 -- 172.21.15.1:0/2047787366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4b40b5220 msgr2=0x7fc4b409aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 --2- 172.21.15.1:0/2047787366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4b40b5220 0x7fc4b409aa50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc4b406e530 tx=0x7fc4a401c7e0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 -- 172.21.15.1:0/2047787366 shutdown_connections 2024-09-15T21:55:30.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 --2- 172.21.15.1:0/2047787366 >> v2:172.21.15.70:3300/0 conn(0x7fc4b40b5600 0x7fc4b409ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 --2- 172.21.15.1:0/2047787366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4b40b5220 0x7fc4b409aa50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 -- 172.21.15.1:0/2047787366 >> 172.21.15.1:0/2047787366 conn(0x7fc4b40b5c40 msgr2=0x7fc4b40b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:30.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 -- 172.21.15.1:0/2047787366 shutdown_connections 2024-09-15T21:55:30.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 -- 172.21.15.1:0/2047787366 wait complete. 2024-09-15T21:55:30.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 Processor -- start 2024-09-15T21:55:30.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 -- start start 2024-09-15T21:55:30.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4b40b5220 0x7fc4b4143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40b5600 0x7fc4b40b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4b4148f20 0x7fc4b41417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b4152700 con 0x7fc4b40b5220 2024-09-15T21:55:30.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b4152880 con 0x7fc4b40b5600 2024-09-15T21:55:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b4152a00 con 0x7fc4b4148f20 2024-09-15T21:55:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b8d62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4b40b5220 0x7fc4b4143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b8d62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4b40b5220 0x7fc4b4143710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60288/0 (socket says 172.21.15.1:60288) 2024-09-15T21:55:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b8d62640 1 -- 172.21.15.1:0/4165509466 learned_addr learned my addr 172.21.15.1:0/4165509466 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b3fff640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40b5600 0x7fc4b40b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b9563640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4b4148f20 0x7fc4b41417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b8d62640 1 -- 172.21.15.1:0/4165509466 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4b4148f20 msgr2=0x7fc4b41417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b8d62640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4b4148f20 0x7fc4b41417c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b8d62640 1 -- 172.21.15.1:0/4165509466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40b5600 msgr2=0x7fc4b40b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b8d62640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40b5600 0x7fc4b40b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b8d62640 1 -- 172.21.15.1:0/4165509466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b41454e0 con 0x7fc4b40b5220 2024-09-15T21:55:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b8d62640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4b40b5220 0x7fc4b4143710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40193f0 tx=0x7fc4a4019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:30.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b17fa640 1 -- 172.21.15.1:0/4165509466 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40b2050 con 0x7fc4b40b5220 2024-09-15T21:55:30.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b17fa640 1 -- 172.21.15.1:0/4165509466 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a40be070 con 0x7fc4b40b5220 2024-09-15T21:55:30.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4b17fa640 1 -- 172.21.15.1:0/4165509466 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40ada70 con 0x7fc4b40b5220 2024-09-15T21:55:30.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.741+0000 7fc4bafc6640 1 -- 172.21.15.1:0/4165509466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b41457c0 con 0x7fc4b40b5220 2024-09-15T21:55:30.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.745+0000 7fc4bafc6640 1 -- 172.21.15.1:0/4165509466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b40b1f00 con 0x7fc4b40b5220 2024-09-15T21:55:30.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.745+0000 7fc4bafc6640 1 -- 172.21.15.1:0/4165509466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b409aa50 con 0x7fc4b40b5220 2024-09-15T21:55:30.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.745+0000 7fc4b17fa640 1 -- 172.21.15.1:0/4165509466 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4a40adc10 con 0x7fc4b40b5220 2024-09-15T21:55:30.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.745+0000 7fc4b17fa640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc4a00678c0 0x7fc4a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:30.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.745+0000 7fc4b17fa640 1 -- 172.21.15.1:0/4165509466 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc4a4120ec0 con 0x7fc4b40b5220 2024-09-15T21:55:30.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.745+0000 7fc4b3fff640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc4a00678c0 0x7fc4a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:30.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.745+0000 7fc4b3fff640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc4a00678c0 0x7fc4a0069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4073290 tx=0x7fc4a8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:30.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.749+0000 7fc4b17fa640 1 -- 172.21.15.1:0/4165509466 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc4a4016520 con 0x7fc4b40b5220 2024-09-15T21:55:30.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.909+0000 7fc4bafc6640 1 -- 172.21.15.1:0/4165509466 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4b414f280 con 0x7fc4b40b5220 2024-09-15T21:55:30.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.913+0000 7fc4b17fa640 1 -- 172.21.15.1:0/4165509466 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16593 (secure 0 0 0) 0x7fc4a40ab340 con 0x7fc4b40b5220 2024-09-15T21:55:30.918 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:30.918 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:22.028149+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:18.271646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:19.444906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:30.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.917+0000 7fc4bafc6640 1 -- 172.21.15.1:0/4165509466 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc4a00678c0 msgr2=0x7fc4a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.917+0000 7fc4bafc6640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc4a00678c0 0x7fc4a0069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4073290 tx=0x7fc4a8008040 comp rx=0 tx=0).stop 2024-09-15T21:55:30.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.917+0000 7fc4bafc6640 1 -- 172.21.15.1:0/4165509466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4b40b5220 msgr2=0x7fc4b4143710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:30.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.917+0000 7fc4bafc6640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4b40b5220 0x7fc4b4143710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40193f0 tx=0x7fc4a4019580 comp rx=0 tx=0).stop 2024-09-15T21:55:30.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.917+0000 7fc4bafc6640 1 -- 172.21.15.1:0/4165509466 shutdown_connections 2024-09-15T21:55:30.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.917+0000 7fc4bafc6640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc4b4148f20 0x7fc4b41417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.917+0000 7fc4bafc6640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc4a00678c0 0x7fc4a0069d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.917+0000 7fc4bafc6640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4b40b5600 0x7fc4b40b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.917+0000 7fc4bafc6640 1 --2- 172.21.15.1:0/4165509466 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4b40b5220 0x7fc4b4143710 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:30.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.917+0000 7fc4bafc6640 1 -- 172.21.15.1:0/4165509466 >> 172.21.15.1:0/4165509466 conn(0x7fc4b40b5c40 msgr2=0x7fc4b4149330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:30.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.917+0000 7fc4bafc6640 1 -- 172.21.15.1:0/4165509466 shutdown_connections 2024-09-15T21:55:30.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:30.917+0000 7fc4bafc6640 1 -- 172.21.15.1:0/4165509466 wait complete. 2024-09-15T21:55:30.937 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T21:55:30.937 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T21:55:30.937 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T21:55:30.938 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-15T21:55:30.938 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-15T21:55:30.939 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-15T21:55:30.939 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-15T21:55:30.940 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-15T21:55:31.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff836f94640 1 Processor -- start 2024-09-15T21:55:31.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff836f94640 1 -- start start 2024-09-15T21:55:31.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff836f94640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff828006a70 0x7ff828009c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff836f94640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff8280cb6a0 0x7ff8280c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff836f94640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff82801ab10 0x7ff8280c8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff836f94640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7ff8280cbbc0 con 0x7ff828006a70 2024-09-15T21:55:31.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff836f94640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7ff8280cbea0 con 0x7ff82801ab10 2024-09-15T21:55:31.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff836f94640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff8280cc180 con 0x7ff8280cb6a0 2024-09-15T21:55:31.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff835f92640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff828006a70 0x7ff828009c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7f940d262640 1 Processor -- start 2024-09-15T21:55:31.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff835791640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff8280cb6a0 0x7ff8280c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7f940d262640 1 -- start start 2024-09-15T21:55:31.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff835791640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff8280cb6a0 0x7ff8280c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:34276/0 (socket says 172.21.15.1:34276) 2024-09-15T21:55:31.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff836793640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff82801ab10 0x7ff8280c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff835791640 1 -- 172.21.15.1:0/3647101635 learned_addr learned my addr 172.21.15.1:0/3647101635 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7ff835f92640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff828006a70 0x7ff828009c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60300/0 (socket says 172.21.15.1:60300) 2024-09-15T21:55:31.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7f49d9bcf640 1 Processor -- start 2024-09-15T21:55:31.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.117+0000 7f49d9bcf640 1 -- start start 2024-09-15T21:55:31.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a7a755640 1 Processor -- start 2024-09-15T21:55:31.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a7a755640 1 -- start start 2024-09-15T21:55:31.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f940d262640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f94000cc1b0 0x7f94000cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f940d262640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f940000a000 con 0x7f94000d4820 2024-09-15T21:55:31.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f940d262640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94000ccb30 con 0x7f9400009c20 2024-09-15T21:55:31.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f940d262640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f94000cfa10 con 0x7f94000cc1b0 2024-09-15T21:55:31.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f49d9bcf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f49cc0cba90 0x7f49cc01f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f49d9bcf640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49cc0cc410 con 0x7f49cc01b040 2024-09-15T21:55:31.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f49d9bcf640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49cc0cc6f0 con 0x7f49cc0cbee0 2024-09-15T21:55:31.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f49d9bcf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f49cc007180 con 0x7f49cc0cba90 2024-09-15T21:55:31.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f940ca61640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f94000d4820 0x7f94000d6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49668/0 (socket says 172.21.15.1:49668) 2024-09-15T21:55:31.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f940ca61640 1 -- 172.21.15.1:0/2665626713 learned_addr learned my addr 172.21.15.1:0/2665626713 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:31.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7ff835f92640 1 -- 172.21.15.1:0/3647101635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff8280cb6a0 msgr2=0x7ff8280c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7ff835f92640 1 --2- 172.21.15.1:0/3647101635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff8280cb6a0 0x7ff8280c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7ff835f92640 1 -- 172.21.15.1:0/3647101635 >> v2:172.21.15.70:3300/0 conn(0x7ff82801ab10 msgr2=0x7ff8280c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7ff835f92640 1 --2- 172.21.15.1:0/3647101635 >> v2:172.21.15.70:3300/0 conn(0x7ff82801ab10 0x7ff8280c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7ff835f92640 1 -- 172.21.15.1:0/3647101635 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82801d880 con 0x7ff828006a70 2024-09-15T21:55:31.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7ff836793640 1 --2- 172.21.15.1:0/3647101635 >> v2:172.21.15.70:3300/0 conn(0x7ff82801ab10 0x7ff8280c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:55:31.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f49d3fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f49cc0cba90 0x7f49cc01f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f49d3fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f49cc0cba90 0x7f49cc01f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:42318/0 (socket says 172.21.15.1:42318) 2024-09-15T21:55:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f49d3fff640 1 -- 172.21.15.1:0/2158555181 learned_addr learned my addr 172.21.15.1:0/2158555181 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a7a755640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2a7409b230 0x7f2a7414ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a7a755640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a7414b150 0x7f2a74151f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a7a755640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a740b9d80 con 0x7f2a740b99a0 2024-09-15T21:55:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a7a755640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f2a740b4800 con 0x7f2a7409b230 2024-09-15T21:55:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a7a755640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2a740b3ed0 con 0x7f2a7414b150 2024-09-15T21:55:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f94077fe640 1 --2- 172.21.15.1:0/2665626713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f94000cc1b0 0x7f94000cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7fb92c71e640 1 Processor -- start 2024-09-15T21:55:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7fb92c71e640 1 -- start start 2024-09-15T21:55:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f49d3fff640 1 -- 172.21.15.1:0/2158555181 >> v1:172.21.15.70:6789/0 conn(0x7f49cc0cbee0 legacy=0x7f49cc0c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f49d3fff640 1 -- 172.21.15.1:0/2158555181 >> v1:172.21.15.1:6789/0 conn(0x7f49cc01b040 legacy=0x7f49cc006a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f49d3fff640 1 -- 172.21.15.1:0/2158555181 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49cc01b420 con 0x7f49cc0cba90 2024-09-15T21:55:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a73fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2a740b99a0 0x7f2a740af8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49694/0 (socket says 172.21.15.1:49694) 2024-09-15T21:55:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a73fff640 1 -- 172.21.15.1:0/148634255 learned_addr learned my addr 172.21.15.1:0/148634255 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a78cf2640 1 --2- 172.21.15.1:0/148634255 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a7414b150 0x7f2a74151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f94077fe640 1 -- 172.21.15.1:0/2665626713 >> v1:172.21.15.70:6789/0 conn(0x7f9400009c20 legacy=0x7f94000c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f94077fe640 1 -- 172.21.15.1:0/2665626713 >> v1:172.21.15.1:6789/0 conn(0x7f94000d4820 legacy=0x7f94000d6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f94077fe640 1 -- 172.21.15.1:0/2665626713 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94000cfc60 con 0x7f94000cc1b0 2024-09-15T21:55:31.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a737fe640 1 --2- 172.21.15.1:0/148634255 >> v2:172.21.15.70:3300/0 conn(0x7f2a7409b230 0x7f2a7414ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f29f47c2640 1 Processor -- start 2024-09-15T21:55:31.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f29f47c2640 1 -- start start 2024-09-15T21:55:31.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a737fe640 1 -- 172.21.15.1:0/148634255 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a7414b150 msgr2=0x7f2a74151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a737fe640 1 --2- 172.21.15.1:0/148634255 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a7414b150 0x7f2a74151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a737fe640 1 -- 172.21.15.1:0/148634255 >> v1:172.21.15.1:6789/0 conn(0x7f2a740b99a0 legacy=0x7f2a740af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7fb92c71e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb91c0cc940 0x7fb91c03f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7fb92c71e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb91c041470 0x7fb91c0c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7fb92c71e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91c00e000 con 0x7fb91c00d860 2024-09-15T21:55:31.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7fb92c71e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fb91c00e370 con 0x7fb91c0cc940 2024-09-15T21:55:31.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7fb92c71e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb91c041920 con 0x7fb91c041470 2024-09-15T21:55:31.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f2a737fe640 1 -- 172.21.15.1:0/148634255 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a740b41b0 con 0x7f2a7409b230 2024-09-15T21:55:31.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7fb92a4ba640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb91c00d860 0x7fb91c0cc230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.1:58990/0 (socket says 172.21.15.1:58990) 2024-09-15T21:55:31.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7fb92a4ba640 1 -- 172.21.15.1:0/2841487840 learned_addr learned my addr 172.21.15.1:0/2841487840 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:31.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7fb92b4bc640 1 --2- 172.21.15.1:0/2841487840 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb91c041470 0x7fb91c0c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7fb929cb9640 1 --2- 172.21.15.1:0/2841487840 >> v2:172.21.15.70:3300/0 conn(0x7fb91c0cc940 0x7fb91c03f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f29f47c2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f29e4009df0 0x7f29e401ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f9406ffd640 1 -- 172.21.15.1:0/2665626713 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 406944250 0 0) 0x7f940000a000 con 0x7f94000d4820 2024-09-15T21:55:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f29f47c2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f29e40cf5c0 0x7f29e401f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f47c2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f29e40cfa00 0x7f29e4038030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f47c2640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f29e401c460 con 0x7f29e40cf5c0 2024-09-15T21:55:31.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f47c2640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f29e401b240 con 0x7f29e40cfa00 2024-09-15T21:55:31.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f47c2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f29e400a1d0 con 0x7f29e4009df0 2024-09-15T21:55:31.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f1d5d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f29e40cf5c0 0x7f29e401f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7ff835f92640 1 --2- 172.21.15.1:0/3647101635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff828006a70 0x7ff828009c20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff828038f20 tx=0x7ff82c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207f8ad028e734c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f1dce0f6640 1 Processor -- start 2024-09-15T21:55:31.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f1dce0f6640 1 -- start start 2024-09-15T21:55:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f1dce0f6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1dc80b6190 0x7f1dc80b5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f1dce0f6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1dc8157e50 0x7f1dc8158300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f1dce0f6640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dc80b6570 con 0x7f1dc80ae580 2024-09-15T21:55:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f1dce0f6640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f1dc80b4680 con 0x7f1dc8157e50 2024-09-15T21:55:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f1dce0f6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc80ae0f0 con 0x7f1dc80b6190 2024-09-15T21:55:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f1dc7fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1dc8157e50 0x7f1dc8158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f1dc7fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1dc8157e50 0x7f1dc8158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60304/0 (socket says 172.21.15.1:60304) 2024-09-15T21:55:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f1dc7fff640 1 -- 172.21.15.1:0/3343865046 learned_addr learned my addr 172.21.15.1:0/3343865046 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7fb929cb9640 1 -- 172.21.15.1:0/2841487840 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb91c041470 msgr2=0x7fb91c0c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7fb929cb9640 1 --2- 172.21.15.1:0/2841487840 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb91c041470 0x7fb91c0c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7fb929cb9640 1 -- 172.21.15.1:0/2841487840 >> v1:172.21.15.70:6789/0 conn(0x7fb91c00d860 legacy=0x7fb91c0cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f1d5d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f29e40cf5c0 0x7f29e401f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60306/0 (socket says 172.21.15.1:60306) 2024-09-15T21:55:31.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f1d5d640 1 -- 172.21.15.1:0/2994735946 learned_addr learned my addr 172.21.15.1:0/2994735946 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7fb929cb9640 1 -- 172.21.15.1:0/2841487840 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91c00dc40 con 0x7fb91c0cc940 2024-09-15T21:55:31.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f255e640 1 --2- 172.21.15.1:0/2994735946 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f29e4009df0 0x7f29e401ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f1dc6ffd640 1 --1- 172.21.15.1:0/3343865046 >> v1:172.21.15.1:6789/0 conn(0x7f1dc80ae580 0x7f1dc80ae980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49698/0 (socket says 172.21.15.1:49698) 2024-09-15T21:55:31.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f1dc7fff640 1 -- 172.21.15.1:0/3343865046 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1dc80b6190 msgr2=0x7f1dc80b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff834f90640 1 -- 172.21.15.1:0/3647101635 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0b0070 con 0x7ff828006a70 2024-09-15T21:55:31.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff834f90640 1 -- 172.21.15.1:0/3647101635 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff82c0ab600 con 0x7ff828006a70 2024-09-15T21:55:31.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff834f90640 1 -- 172.21.15.1:0/3647101635 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0ab9d0 con 0x7ff828006a70 2024-09-15T21:55:31.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f3560640 1 --2- 172.21.15.1:0/2994735946 >> v2:172.21.15.70:3300/0 conn(0x7f29e40cfa00 0x7f29e4038030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f1d5d640 1 -- 172.21.15.1:0/2994735946 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f29e4009df0 msgr2=0x7f29e401ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f1d5d640 1 --2- 172.21.15.1:0/2994735946 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f29e4009df0 0x7f29e401ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f1d5d640 1 -- 172.21.15.1:0/2994735946 >> v2:172.21.15.70:3300/0 conn(0x7f29e40cfa00 msgr2=0x7f29e4038030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f1d5d640 1 --2- 172.21.15.1:0/2994735946 >> v2:172.21.15.70:3300/0 conn(0x7f29e40cfa00 0x7f29e4038030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f1d5d640 1 -- 172.21.15.1:0/2994735946 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e401c180 con 0x7f29e40cf5c0 2024-09-15T21:55:31.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f49d3fff640 1 --2- 172.21.15.1:0/2158555181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49cc0cba90 0x7f49cc01f6c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f49d402dd60 tx=0x7f49d4098340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c8a60b06f7ca039 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.121+0000 7f1dc77fe640 1 --2- 172.21.15.1:0/3343865046 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1dc80b6190 0x7f1dc80b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f1dc7fff640 1 --2- 172.21.15.1:0/3343865046 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1dc80b6190 0x7f1dc80b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f1dc7fff640 1 -- 172.21.15.1:0/3343865046 >> v1:172.21.15.1:6789/0 conn(0x7f1dc80ae580 legacy=0x7f1dc80ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f1dc7fff640 1 -- 172.21.15.1:0/3343865046 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc80b4030 con 0x7f1dc8157e50 2024-09-15T21:55:31.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f49d37fe640 1 -- 172.21.15.1:0/2158555181 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4128440 con 0x7f49cc0cba90 2024-09-15T21:55:31.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 -- 172.21.15.1:0/3647101635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff828006a70 msgr2=0x7ff828009c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 --2- 172.21.15.1:0/3647101635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff828006a70 0x7ff828009c20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff828038f20 tx=0x7ff82c01c4a0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 -- 172.21.15.1:0/3647101635 shutdown_connections 2024-09-15T21:55:31.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 --2- 172.21.15.1:0/3647101635 >> v2:172.21.15.70:3300/0 conn(0x7ff82801ab10 0x7ff8280c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 --2- 172.21.15.1:0/3647101635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff8280cb6a0 0x7ff8280c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 --2- 172.21.15.1:0/3647101635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff828006a70 0x7ff828009c20 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff828038f20 tx=0x7ff82c01c4a0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 -- 172.21.15.1:0/3647101635 >> 172.21.15.1:0/3647101635 conn(0x7ff828008ea0 msgr2=0x7ff8280092b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f94077fe640 1 --2- 172.21.15.1:0/2665626713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f94000cc1b0 0x7f94000cc5f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0097f0 tx=0x7f93fc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b7211b9ce0db8c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 -- 172.21.15.1:0/3647101635 shutdown_connections 2024-09-15T21:55:31.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 -- 172.21.15.1:0/3647101635 wait complete. 2024-09-15T21:55:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f49d37fe640 1 -- 172.21.15.1:0/2158555181 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d406de50 con 0x7f49cc0cba90 2024-09-15T21:55:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f49d37fe640 1 -- 172.21.15.1:0/2158555181 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d41288a0 con 0x7f49cc0cba90 2024-09-15T21:55:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f49d9bcf640 1 -- 172.21.15.1:0/2158555181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49cc0cba90 msgr2=0x7f49cc01f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f49d9bcf640 1 --2- 172.21.15.1:0/2158555181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49cc0cba90 0x7f49cc01f6c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f49d402dd60 tx=0x7f49d4098340 comp rx=0 tx=0).stop 2024-09-15T21:55:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f49d9bcf640 1 -- 172.21.15.1:0/2158555181 shutdown_connections 2024-09-15T21:55:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f49d9bcf640 1 --2- 172.21.15.1:0/2158555181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49cc0cba90 0x7f49cc01f6c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f49d9bcf640 1 -- 172.21.15.1:0/2158555181 >> 172.21.15.1:0/2158555181 conn(0x7f49cc0092a0 msgr2=0x7f49cc0096b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f49d9bcf640 1 -- 172.21.15.1:0/2158555181 shutdown_connections 2024-09-15T21:55:31.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 Processor -- start 2024-09-15T21:55:31.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f9406ffd640 1 -- 172.21.15.1:0/2665626713 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc0b0070 con 0x7f94000cc1b0 2024-09-15T21:55:31.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f1d5d640 1 --2- 172.21.15.1:0/2994735946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e40cf5c0 0x7f29e401f200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f29e4039ff0 tx=0x7f29dc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202a7aef09307a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7fb929cb9640 1 --2- 172.21.15.1:0/2841487840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb91c0cc940 0x7fb91c03f950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb92406ab00 tx=0x7fb924098330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c70f48db5cb67cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f9406ffd640 1 -- 172.21.15.1:0/2665626713 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93fc0a4e50 con 0x7f94000cc1b0 2024-09-15T21:55:31.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 -- start start 2024-09-15T21:55:31.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f155c640 1 -- 172.21.15.1:0/2994735946 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc0b1070 con 0x7f29e40cf5c0 2024-09-15T21:55:31.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f155c640 1 -- 172.21.15.1:0/2994735946 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29dc0ac620 con 0x7f29e40cf5c0 2024-09-15T21:55:31.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f29f155c640 1 -- 172.21.15.1:0/2994735946 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc0ac9f0 con 0x7f29e40cf5c0 2024-09-15T21:55:31.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7fb9294b8640 1 -- 172.21.15.1:0/2841487840 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb924128440 con 0x7fb91c0cc940 2024-09-15T21:55:31.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f9406ffd640 1 -- 172.21.15.1:0/2665626713 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc0ab820 con 0x7f94000cc1b0 2024-09-15T21:55:31.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f29f47c2640 1 -- 172.21.15.1:0/2994735946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e40cf5c0 msgr2=0x7f29e401f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f29f47c2640 1 --2- 172.21.15.1:0/2994735946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e40cf5c0 0x7f29e401f200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f29e4039ff0 tx=0x7f29dc01c400 comp rx=0 tx=0).stop 2024-09-15T21:55:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7f49d9bcf640 1 -- 172.21.15.1:0/2158555181 wait complete. 2024-09-15T21:55:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d9bcf640 1 Processor -- start 2024-09-15T21:55:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff82801ab10 0x7ff8280cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8280cb6a0 0x7ff82802f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8280ccc30 0x7ff82802fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff828037e60 con 0x7ff8280cb6a0 2024-09-15T21:55:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff82801faf0 con 0x7ff8280ccc30 2024-09-15T21:55:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.125+0000 7ff836f94640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff828037fe0 con 0x7ff82801ab10 2024-09-15T21:55:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff835791640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8280cb6a0 0x7ff82802f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff835791640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8280cb6a0 0x7ff82802f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60314/0 (socket says 172.21.15.1:60314) 2024-09-15T21:55:31.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff835791640 1 -- 172.21.15.1:0/812216186 learned_addr learned my addr 172.21.15.1:0/812216186 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff835f92640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff82801ab10 0x7ff8280cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff836793640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8280ccc30 0x7ff82802fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff835791640 1 -- 172.21.15.1:0/812216186 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff82801ab10 msgr2=0x7ff8280cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff835791640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff82801ab10 0x7ff8280cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff835791640 1 -- 172.21.15.1:0/812216186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8280ccc30 msgr2=0x7ff82802fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff835791640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8280ccc30 0x7ff82802fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff835791640 1 -- 172.21.15.1:0/812216186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff828036d10 con 0x7ff8280cb6a0 2024-09-15T21:55:31.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f1dc7fff640 1 --2- 172.21.15.1:0/3343865046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dc8157e50 0x7f1dc8158300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0007eb0 tx=0x7f1dc001eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6e660ab6217eff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fb9294b8640 1 -- 172.21.15.1:0/2841487840 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb92406de50 con 0x7fb91c0cc940 2024-09-15T21:55:31.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f940d262640 1 -- 172.21.15.1:0/2665626713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f94000cc1b0 msgr2=0x7f94000cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f940d262640 1 --2- 172.21.15.1:0/2665626713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f94000cc1b0 0x7f94000cc5f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0097f0 tx=0x7f93fc01c3c0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f1dc77fe640 1 --2- 172.21.15.1:0/3343865046 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1dc80b6190 0x7f1dc80b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:31.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fb9294b8640 1 -- 172.21.15.1:0/2841487840 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9241288a0 con 0x7fb91c0cc940 2024-09-15T21:55:31.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fb92c71e640 1 -- 172.21.15.1:0/2841487840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb91c0cc940 msgr2=0x7fb91c03f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fb92c71e640 1 --2- 172.21.15.1:0/2841487840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb91c0cc940 0x7fb91c03f950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb92406ab00 tx=0x7fb924098330 comp rx=0 tx=0).stop 2024-09-15T21:55:31.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff835791640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8280cb6a0 0x7ff82802f6e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8300657c0 tx=0x7ff830069810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f1dc67fc640 1 -- 172.21.15.1:0/3343865046 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00b3070 con 0x7f1dc8157e50 2024-09-15T21:55:31.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f1dc67fc640 1 -- 172.21.15.1:0/3343865046 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc00ae600 con 0x7f1dc8157e50 2024-09-15T21:55:31.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f1dc67fc640 1 -- 172.21.15.1:0/3343865046 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00ae9d0 con 0x7f1dc8157e50 2024-09-15T21:55:31.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fb92c71e640 1 -- 172.21.15.1:0/2841487840 shutdown_connections 2024-09-15T21:55:31.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fb92c71e640 1 --2- 172.21.15.1:0/2841487840 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb91c041470 0x7fb91c0c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fb92c71e640 1 --2- 172.21.15.1:0/2841487840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb91c0cc940 0x7fb91c03f950 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fb92c71e640 1 -- 172.21.15.1:0/2841487840 >> 172.21.15.1:0/2841487840 conn(0x7fb91c041b70 msgr2=0x7fb91c041f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f940d262640 1 -- 172.21.15.1:0/2665626713 shutdown_connections 2024-09-15T21:55:31.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f940d262640 1 --2- 172.21.15.1:0/2665626713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f94000cc1b0 0x7f94000cc5f0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0097f0 tx=0x7f93fc01c3c0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f940d262640 1 -- 172.21.15.1:0/2665626713 >> 172.21.15.1:0/2665626713 conn(0x7f9400008ea0 msgr2=0x7f94000092b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fd9b3100640 1 Processor -- start 2024-09-15T21:55:31.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff8267fc640 1 -- 172.21.15.1:0/812216186 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff830091070 con 0x7ff8280cb6a0 2024-09-15T21:55:31.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fd9b3100640 1 -- start start 2024-09-15T21:55:31.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d9bcf640 1 -- start start 2024-09-15T21:55:31.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f2a737fe640 1 --2- 172.21.15.1:0/148634255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a7409b230 0x7f2a7414ac10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009d90 tx=0x7f2a6c01c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6668ab692a33ab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d9bcf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49cc01b040 0x7f49cc0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d9bcf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f49cc0cba90 0x7f49cc0c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d9bcf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49cc0cbee0 0x7f49cc031580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d9bcf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc0cc9d0 con 0x7f49cc0cbee0 2024-09-15T21:55:31.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d9bcf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc030850 con 0x7f49cc01b040 2024-09-15T21:55:31.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d9bcf640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f49cc0daf10 con 0x7f49cc0cba90 2024-09-15T21:55:31.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f940d262640 1 -- 172.21.15.1:0/2665626713 shutdown_connections 2024-09-15T21:55:31.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d93ce640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49cc0cbee0 0x7f49cc031580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d8bcd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49cc01b040 0x7f49cc0c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d93ce640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49cc0cbee0 0x7f49cc031580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60324/0 (socket says 172.21.15.1:60324) 2024-09-15T21:55:31.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d8bcd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49cc01b040 0x7f49cc0c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:42348/0 (socket says 172.21.15.1:42348) 2024-09-15T21:55:31.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d93ce640 1 -- 172.21.15.1:0/3699374085 learned_addr learned my addr 172.21.15.1:0/3699374085 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fb92c71e640 1 -- 172.21.15.1:0/2841487840 shutdown_connections 2024-09-15T21:55:31.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d3fff640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f49cc0cba90 0x7f49cc0c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f2a72ffd640 1 -- 172.21.15.1:0/148634255 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0b2070 con 0x7f2a7409b230 2024-09-15T21:55:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f2a72ffd640 1 -- 172.21.15.1:0/148634255 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a6c0a57a0 con 0x7f2a7409b230 2024-09-15T21:55:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f2a72ffd640 1 -- 172.21.15.1:0/148634255 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0a5b70 con 0x7f2a7409b230 2024-09-15T21:55:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f1dce0f6640 1 -- 172.21.15.1:0/3343865046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dc8157e50 msgr2=0x7f1dc8158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f1dce0f6640 1 --2- 172.21.15.1:0/3343865046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dc8157e50 0x7f1dc8158300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0007eb0 tx=0x7f1dc001eeb0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f1dce0f6640 1 -- 172.21.15.1:0/3343865046 shutdown_connections 2024-09-15T21:55:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f1dce0f6640 1 --2- 172.21.15.1:0/3343865046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dc8157e50 0x7f1dc8158300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f1dce0f6640 1 --2- 172.21.15.1:0/3343865046 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1dc80b6190 0x7f1dc80b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f1dce0f6640 1 -- 172.21.15.1:0/3343865046 >> 172.21.15.1:0/3343865046 conn(0x7f1dc806c0c0 msgr2=0x7f1dc806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d8bcd640 1 -- 172.21.15.1:0/3699374085 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f49cc0cba90 msgr2=0x7f49cc0c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff836f94640 1 -- 172.21.15.1:0/812216186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff828035890 con 0x7ff8280cb6a0 2024-09-15T21:55:31.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff836f94640 1 -- 172.21.15.1:0/812216186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8280cd110 con 0x7ff8280cb6a0 2024-09-15T21:55:31.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff8267fc640 1 -- 172.21.15.1:0/812216186 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83006de50 con 0x7ff8280cb6a0 2024-09-15T21:55:31.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff8267fc640 1 -- 172.21.15.1:0/812216186 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff830075a80 con 0x7ff8280cb6a0 2024-09-15T21:55:31.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7ff836f94640 1 -- 172.21.15.1:0/812216186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff828009c20 con 0x7ff8280cb6a0 2024-09-15T21:55:31.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f2a7a755640 1 -- 172.21.15.1:0/148634255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a7409b230 msgr2=0x7f2a7414ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f2a7a755640 1 --2- 172.21.15.1:0/148634255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a7409b230 0x7f2a7414ac10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009d90 tx=0x7f2a6c01c900 comp rx=0 tx=0).stop 2024-09-15T21:55:31.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f2a7a755640 1 -- 172.21.15.1:0/148634255 shutdown_connections 2024-09-15T21:55:31.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f2a7a755640 1 --2- 172.21.15.1:0/148634255 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a7414b150 0x7f2a74151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f2a7a755640 1 --2- 172.21.15.1:0/148634255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a7409b230 0x7f2a7414ac10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f2a7a755640 1 -- 172.21.15.1:0/148634255 >> 172.21.15.1:0/148634255 conn(0x7f2a7406c4c0 msgr2=0x7f2a740b9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f2a7a755640 1 -- 172.21.15.1:0/148634255 shutdown_connections 2024-09-15T21:55:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f2a7a755640 1 -- 172.21.15.1:0/148634255 wait complete. 2024-09-15T21:55:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fb92c71e640 1 -- 172.21.15.1:0/2841487840 wait complete. 2024-09-15T21:55:31.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fb92c71e640 1 Processor -- start 2024-09-15T21:55:31.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f1dce0f6640 1 -- 172.21.15.1:0/3343865046 shutdown_connections 2024-09-15T21:55:31.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fd9b0e9c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd9ac0b9980 0x7fd9ac0b3e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49712/0 (socket says 172.21.15.1:49712) 2024-09-15T21:55:31.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fd9b0e9c640 1 -- 172.21.15.1:0/824217898 learned_addr learned my addr 172.21.15.1:0/824217898 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:31.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fd9b3100640 1 --2- 172.21.15.1:0/824217898 >> v2:172.21.15.1:3300/0 conn(0x7fd9ac0b51b0 0x7fd9ac146e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f940d262640 1 -- 172.21.15.1:0/2665626713 wait complete. 2024-09-15T21:55:31.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f29f47c2640 1 -- 172.21.15.1:0/2994735946 shutdown_connections 2024-09-15T21:55:31.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f29f47c2640 1 --2- 172.21.15.1:0/2994735946 >> v2:172.21.15.70:3300/0 conn(0x7f29e40cfa00 0x7f29e4038030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f29f47c2640 1 --2- 172.21.15.1:0/2994735946 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e40cf5c0 0x7f29e401f200 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f29f47c2640 1 --2- 172.21.15.1:0/2994735946 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f29e4009df0 0x7f29e401ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f29f47c2640 1 -- 172.21.15.1:0/2994735946 >> 172.21.15.1:0/2994735946 conn(0x7f29e4009070 msgr2=0x7f29e4009480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d8bcd640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f49cc0cba90 0x7f49cc0c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d8bcd640 1 -- 172.21.15.1:0/3699374085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49cc0cbee0 msgr2=0x7f49cc031580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d8bcd640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49cc0cbee0 0x7f49cc031580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d8bcd640 1 -- 172.21.15.1:0/3699374085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49cc0d5810 con 0x7f49cc01b040 2024-09-15T21:55:31.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d8bcd640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49cc01b040 0x7f49cc0c45f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c3c0 tx=0x7f49c800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7f49d17fa640 1 -- 172.21.15.1:0/3699374085 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c80052d0 con 0x7f49cc01b040 2024-09-15T21:55:31.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f49d9bcf640 1 -- 172.21.15.1:0/3699374085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49cc0371a0 con 0x7f49cc01b040 2024-09-15T21:55:31.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f49d9bcf640 1 -- 172.21.15.1:0/3699374085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49cc0c50b0 con 0x7f49cc01b040 2024-09-15T21:55:31.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f49d3fff640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f49cc0cba90 0x7f49cc0c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:31.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f49d17fa640 1 -- 172.21.15.1:0/3699374085 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49c8005470 con 0x7f49cc01b040 2024-09-15T21:55:31.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f49d17fa640 1 -- 172.21.15.1:0/3699374085 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8007240 con 0x7f49cc01b040 2024-09-15T21:55:31.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940d262640 1 Processor -- start 2024-09-15T21:55:31.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f2a7a755640 1 Processor -- start 2024-09-15T21:55:31.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f47c2640 1 -- 172.21.15.1:0/2994735946 shutdown_connections 2024-09-15T21:55:31.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f49d93ce640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49cc0cbee0 0x7f49cc031580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:31.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7ff8267fc640 1 -- 172.21.15.1:0/812216186 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff830096460 con 0x7ff8280cb6a0 2024-09-15T21:55:31.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7ff8267fc640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff8140678c0 0x7ff814069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fb92c71e640 1 -- start start 2024-09-15T21:55:31.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f47c2640 1 -- 172.21.15.1:0/2994735946 wait complete. 2024-09-15T21:55:31.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fb92c71e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb91c00d860 0x7fb91c0c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fb92c71e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb91c041470 0x7fb91c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fb92c71e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb91c0cc940 0x7fb91c0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fb92c71e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c0d7450 con 0x7fb91c041470 2024-09-15T21:55:31.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fb92c71e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c0d72d0 con 0x7fb91c00d860 2024-09-15T21:55:31.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fb92c71e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb91c0d75d0 con 0x7fb91c0cc940 2024-09-15T21:55:31.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f49d9bcf640 1 -- 172.21.15.1:0/3699374085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49b4001040 con 0x7f49cc01b040 2024-09-15T21:55:31.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940d262640 1 -- start start 2024-09-15T21:55:31.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940d262640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9400009c20 0x7f9400036550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940d262640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94000d4820 0x7f94000d5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940d262640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f94000d5f60 0x7f94000c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940d262640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f94000c9ac0 con 0x7f9400009c20 2024-09-15T21:55:31.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940d262640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f94000c9940 con 0x7f94000d4820 2024-09-15T21:55:31.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940d262640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f940001ab10 con 0x7f94000d5f60 2024-09-15T21:55:31.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7ff835f92640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff8140678c0 0x7ff814069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7ff8267fc640 1 -- 172.21.15.1:0/812216186 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff8301017f0 con 0x7ff8280cb6a0 2024-09-15T21:55:31.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7ff8267fc640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] conn(0x7ff81406fa60 0x7ff814071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7ff8267fc640 1 -- 172.21.15.1:0/812216186 --> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff83008ce50 con 0x7ff81406fa60 2024-09-15T21:55:31.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7ff8267fc640 1 -- 172.21.15.1:0/812216186 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff830101ba0 con 0x7ff8280cb6a0 2024-09-15T21:55:31.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940ca61640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f94000d5f60 0x7f94000c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940ca61640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f94000d5f60 0x7f94000c5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:34374/0 (socket says 172.21.15.1:34374) 2024-09-15T21:55:31.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940ca61640 1 -- 172.21.15.1:0/2134539764 learned_addr learned my addr 172.21.15.1:0/2134539764 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7ff836793640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] conn(0x7ff81406fa60 0x7ff814071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f1dce0f6640 1 -- 172.21.15.1:0/3343865046 wait complete. 2024-09-15T21:55:31.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f1dce0f6640 1 Processor -- start 2024-09-15T21:55:31.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7ff835f92640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff8140678c0 0x7ff814069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0ad000 tx=0x7ff82c0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.129+0000 7fd9abfff640 1 --2- 172.21.15.1:0/824217898 >> v2:172.21.15.1:3300/0 conn(0x7fd9ac0b51b0 0x7fd9ac146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fd9b3100640 1 -- 172.21.15.1:0/824217898 --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9ac0ae2a0 con 0x7fd9ac0b9980 2024-09-15T21:55:31.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fd9b3100640 1 -- 172.21.15.1:0/824217898 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9ac0aef30 con 0x7fd9ac0aea10 2024-09-15T21:55:31.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fd9b3100640 1 -- 172.21.15.1:0/824217898 --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fd9ac0af210 con 0x7fd9ac0b51b0 2024-09-15T21:55:31.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f94077fe640 1 --2- 172.21.15.1:0/2134539764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94000d4820 0x7f94000d5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fd9abfff640 1 -- 172.21.15.1:0/824217898 >> v1:172.21.15.70:6789/0 conn(0x7fd9ac0aea10 legacy=0x7fd9ac1473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fd9abfff640 1 -- 172.21.15.1:0/824217898 >> v1:172.21.15.1:6789/0 conn(0x7fd9ac0b9980 legacy=0x7fd9ac0b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fd9abfff640 1 -- 172.21.15.1:0/824217898 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ac0b9d60 con 0x7fd9ac0b51b0 2024-09-15T21:55:31.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fb92b4bc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb91c0cc940 0x7fb91c0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fb92b4bc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb91c0cc940 0x7fb91c0c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:34366/0 (socket says 172.21.15.1:34366) 2024-09-15T21:55:31.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fb92b4bc640 1 -- 172.21.15.1:0/1270316971 learned_addr learned my addr 172.21.15.1:0/1270316971 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fb92a4ba640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb91c00d860 0x7fb91c0c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f2a7a755640 1 -- start start 2024-09-15T21:55:31.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f2a7a755640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a7409b230 0x7f2a740729a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f2a7a755640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a740b99a0 0x7f2a74145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f2a7a755640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a7414b150 0x7f2a74147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f2a7a755640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a740b3a30 con 0x7f2a740b99a0 2024-09-15T21:55:31.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f2a7a755640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a740affb0 con 0x7f2a7409b230 2024-09-15T21:55:31.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f2a7a755640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2a74154cc0 con 0x7f2a7414b150 2024-09-15T21:55:31.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f47c2640 1 Processor -- start 2024-09-15T21:55:31.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f47c2640 1 -- start start 2024-09-15T21:55:31.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f47c2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f29e4009df0 0x7f29e4035640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f47c2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e40cf5c0 0x7f29e4164dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f47c2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e40cfa00 0x7f29e4165300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f47c2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f29e401bc40 con 0x7f29e40cfa00 2024-09-15T21:55:31.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f47c2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f29e401bac0 con 0x7f29e40cf5c0 2024-09-15T21:55:31.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f47c2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f29e40d8900 con 0x7f29e4009df0 2024-09-15T21:55:31.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f255e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f29e4009df0 0x7f29e4035640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f255e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f29e4009df0 0x7f29e4035640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:34380/0 (socket says 172.21.15.1:34380) 2024-09-15T21:55:31.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f255e640 1 -- 172.21.15.1:0/117508351 learned_addr learned my addr 172.21.15.1:0/117508351 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f2a73fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a7409b230 0x7f2a740729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f2a73fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a7409b230 0x7f2a740729a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:42378/0 (socket says 172.21.15.1:42378) 2024-09-15T21:55:31.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f2a73fff640 1 -- 172.21.15.1:0/3446414464 learned_addr learned my addr 172.21.15.1:0/3446414464 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7ff836793640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] conn(0x7ff81406fa60 0x7ff814071e80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940ca61640 1 -- 172.21.15.1:0/2134539764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94000d4820 msgr2=0x7f94000d5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940ca61640 1 --2- 172.21.15.1:0/2134539764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94000d4820 0x7f94000d5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940ca61640 1 -- 172.21.15.1:0/2134539764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9400009c20 msgr2=0x7f9400036550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940ca61640 1 --2- 172.21.15.1:0/2134539764 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9400009c20 0x7f9400036550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940ca61640 1 -- 172.21.15.1:0/2134539764 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94000341e0 con 0x7f94000d5f60 2024-09-15T21:55:31.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f2a737fe640 1 --2- 172.21.15.1:0/3446414464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a740b99a0 0x7f2a74145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f940ca61640 1 --2- 172.21.15.1:0/2134539764 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f94000d5f60 0x7f94000c5d40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f93f400c480 tx=0x7f93f400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f29f3560640 1 --2- 172.21.15.1:0/117508351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e40cfa00 0x7f29e4165300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f29f255e640 1 -- 172.21.15.1:0/117508351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e40cf5c0 msgr2=0x7f29e4164dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T21:55:31.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f29f255e640 1 --2- 172.21.15.1:0/117508351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29e40cf5c0 0x7f29e4164dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f29f255e640 1 -- 172.21.15.1:0/117508351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e40cfa00 msgr2=0x7f29e4165300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f29f255e640 1 --2- 172.21.15.1:0/117508351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f29e40cfa00 0x7f29e4165300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f29f255e640 1 -- 172.21.15.1:0/117508351 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e4034d20 con 0x7f29e4009df0 2024-09-15T21:55:31.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7ff8267fc640 1 -- 172.21.15.1:0/812216186 <== osd.2 v2:172.21.15.1:6800/3014237921 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff83008ce50 con 0x7ff81406fa60 2024-09-15T21:55:31.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dce0f6640 1 -- start start 2024-09-15T21:55:31.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7fb929cb9640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb91c041470 0x7fb91c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fb92a4ba640 1 -- 172.21.15.1:0/1270316971 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb91c0cc940 msgr2=0x7fb91c0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fb92a4ba640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb91c0cc940 0x7fb91c0c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fb92a4ba640 1 -- 172.21.15.1:0/1270316971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb91c041470 msgr2=0x7fb91c0c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fb92a4ba640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb91c041470 0x7fb91c0c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fb92a4ba640 1 -- 172.21.15.1:0/1270316971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91c0c87d0 con 0x7fb91c00d860 2024-09-15T21:55:31.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fb929cb9640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb91c041470 0x7fb91c0c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:55:31.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f2a737fe640 1 -- 172.21.15.1:0/3446414464 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a7414b150 msgr2=0x7f2a74147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f2a737fe640 1 --2- 172.21.15.1:0/3446414464 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a7414b150 0x7f2a74147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f2a737fe640 1 -- 172.21.15.1:0/3446414464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a7409b230 msgr2=0x7f2a740729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f2a737fe640 1 --2- 172.21.15.1:0/3446414464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a7409b230 0x7f2a740729a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f2a737fe640 1 -- 172.21.15.1:0/3446414464 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a74145c10 con 0x7f2a740b99a0 2024-09-15T21:55:31.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f2a737fe640 1 --2- 172.21.15.1:0/3446414464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a740b99a0 0x7f2a74145510 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0ac000 tx=0x7f2a6c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f29f255e640 1 --2- 172.21.15.1:0/117508351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f29e4009df0 0x7f29e4035640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f29e800d830 tx=0x7f29e800dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f29e2ffd640 1 -- 172.21.15.1:0/117508351 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8018020 con 0x7f29e4009df0 2024-09-15T21:55:31.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f29e2ffd640 1 -- 172.21.15.1:0/117508351 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e80096a0 con 0x7f29e4009df0 2024-09-15T21:55:31.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f29e2ffd640 1 -- 172.21.15.1:0/117508351 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8009a50 con 0x7f29e4009df0 2024-09-15T21:55:31.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f29f47c2640 1 -- 172.21.15.1:0/117508351 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e4037030 con 0x7f29e4009df0 2024-09-15T21:55:31.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f29f47c2640 1 -- 172.21.15.1:0/117508351 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e40cbe30 con 0x7f29e4009df0 2024-09-15T21:55:31.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f49d17fa640 1 -- 172.21.15.1:0/3699374085 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f49c80073e0 con 0x7f49cc01b040 2024-09-15T21:55:31.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.133+0000 7f49d17fa640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f49b80678c0 0x7f49b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f49d17fa640 1 -- 172.21.15.1:0/3699374085 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f49c8085c40 con 0x7f49cc01b040 2024-09-15T21:55:31.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f49d17fa640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] conn(0x7f49b806fb40 0x7f49b8071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f49d17fa640 1 -- 172.21.15.1:0/3699374085 --> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49b8072610 con 0x7f49b806fb40 2024-09-15T21:55:31.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f49d17fa640 1 -- 172.21.15.1:0/3699374085 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f49c8086030 con 0x7f49cc01b040 2024-09-15T21:55:31.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f49d93ce640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] conn(0x7f49b806fb40 0x7f49b8071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f49d3fff640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f49b80678c0 0x7f49b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f49d93ce640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] conn(0x7f49b806fb40 0x7f49b8071f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f49d3fff640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f49b80678c0 0x7f49b8069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0cc620 tx=0x7f49d4122070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dce0f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dc80ae580 0x7f1dc80b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dce0f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dc80b6190 0x7f1dc80b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dce0f6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1dc8157e50 0x7f1dc80b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dce0f6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc80b3bb0 con 0x7f1dc80ae580 2024-09-15T21:55:31.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dce0f6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc80b3a30 con 0x7f1dc80b6190 2024-09-15T21:55:31.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dce0f6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc8161930 con 0x7f1dc8157e50 2024-09-15T21:55:31.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dc77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dc80ae580 0x7f1dc80b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dc77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dc80ae580 0x7f1dc80b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60378/0 (socket says 172.21.15.1:60378) 2024-09-15T21:55:31.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dc77fe640 1 -- 172.21.15.1:0/317572166 learned_addr learned my addr 172.21.15.1:0/317572166 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dc7fff640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1dc8157e50 0x7f1dc80b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dc6ffd640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dc80b6190 0x7f1dc80b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fb92a4ba640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb91c00d860 0x7fb91c0c9210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb91400c460 tx=0x7fb91400c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f2a70ff9640 1 -- 172.21.15.1:0/3446414464 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0bd030 con 0x7f2a740b99a0 2024-09-15T21:55:31.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f2a7a755640 1 -- 172.21.15.1:0/3446414464 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a741e7940 con 0x7f2a740b99a0 2024-09-15T21:55:31.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f2a7a755640 1 -- 172.21.15.1:0/3446414464 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a74145eb0 con 0x7f2a740b99a0 2024-09-15T21:55:31.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f2a7a755640 1 -- 172.21.15.1:0/3446414464 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a7414ac10 con 0x7f2a740b99a0 2024-09-15T21:55:31.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f2a70ff9640 1 -- 172.21.15.1:0/3446414464 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a6c0a55a0 con 0x7f2a740b99a0 2024-09-15T21:55:31.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f2a70ff9640 1 -- 172.21.15.1:0/3446414464 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0b2040 con 0x7f2a740b99a0 2024-09-15T21:55:31.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f9404ff9640 1 -- 172.21.15.1:0/2134539764 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4018070 con 0x7f94000d5f60 2024-09-15T21:55:31.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f9404ff9640 1 -- 172.21.15.1:0/2134539764 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f40074e0 con 0x7f94000d5f60 2024-09-15T21:55:31.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f9404ff9640 1 -- 172.21.15.1:0/2134539764 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4004a30 con 0x7f94000d5f60 2024-09-15T21:55:31.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f940d262640 1 -- 172.21.15.1:0/2134539764 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94000d52b0 con 0x7f94000d5f60 2024-09-15T21:55:31.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f940d262640 1 -- 172.21.15.1:0/2134539764 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f94000cf0b0 con 0x7f94000d5f60 2024-09-15T21:55:31.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f940d262640 1 -- 172.21.15.1:0/2134539764 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f93e8001040 con 0x7f94000d5f60 2024-09-15T21:55:31.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fd9abfff640 1 --2- 172.21.15.1:0/824217898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9ac0b51b0 0x7fd9ac146e70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000de70 tx=0x7fd9a0024880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f85927316a6809 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f49d17fa640 1 -- 172.21.15.1:0/3699374085 <== osd.1 v2:172.21.15.1:6826/4281279445 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49b8072610 con 0x7f49b806fb40 2024-09-15T21:55:31.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fd9ab7fe640 1 -- 172.21.15.1:0/824217898 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a00b8070 con 0x7fd9ac0b51b0 2024-09-15T21:55:31.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fd9ab7fe640 1 -- 172.21.15.1:0/824217898 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9ac147cd0 con 0x7fd9ac0b51b0 2024-09-15T21:55:31.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fd9ab7fe640 1 -- 172.21.15.1:0/824217898 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000d2d0 con 0x7fd9ac0b51b0 2024-09-15T21:55:31.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dc6ffd640 1 -- 172.21.15.1:0/317572166 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1dc8157e50 msgr2=0x7f1dc80b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dc6ffd640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1dc8157e50 0x7f1dc80b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dc6ffd640 1 -- 172.21.15.1:0/317572166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dc80ae580 msgr2=0x7f1dc80b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dc6ffd640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dc80ae580 0x7f1dc80b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f1dc6ffd640 1 -- 172.21.15.1:0/317572166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc80afda0 con 0x7f1dc80b6190 2024-09-15T21:55:31.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7f29f47c2640 1 -- 172.21.15.1:0/117508351 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29e401f200 con 0x7f29e4009df0 2024-09-15T21:55:31.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fd9b3100640 1 -- 172.21.15.1:0/824217898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9ac0b51b0 msgr2=0x7fd9ac146e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fd9b3100640 1 --2- 172.21.15.1:0/824217898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9ac0b51b0 0x7fd9ac146e70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd9a000de70 tx=0x7fd9a0024880 comp rx=0 tx=0).stop 2024-09-15T21:55:31.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fb91affd640 1 -- 172.21.15.1:0/1270316971 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914017070 con 0x7fb91c00d860 2024-09-15T21:55:31.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fb91affd640 1 -- 172.21.15.1:0/1270316971 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb914005cf0 con 0x7fb91c00d860 2024-09-15T21:55:31.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fd9b3100640 1 -- 172.21.15.1:0/824217898 shutdown_connections 2024-09-15T21:55:31.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fd9b3100640 1 --2- 172.21.15.1:0/824217898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9ac0b51b0 0x7fd9ac146e70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fd9b3100640 1 -- 172.21.15.1:0/824217898 >> 172.21.15.1:0/824217898 conn(0x7fd9ac06c4c0 msgr2=0x7fd9ac0b9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fd9b3100640 1 -- 172.21.15.1:0/824217898 shutdown_connections 2024-09-15T21:55:31.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fb91affd640 1 -- 172.21.15.1:0/1270316971 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914007270 con 0x7fb91c00d860 2024-09-15T21:55:31.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fb92c71e640 1 -- 172.21.15.1:0/1270316971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91c0c8ab0 con 0x7fb91c00d860 2024-09-15T21:55:31.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.137+0000 7fd9b3100640 1 -- 172.21.15.1:0/824217898 wait complete. 2024-09-15T21:55:31.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f1dc6ffd640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dc80b6190 0x7f1dc80b04e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1db800c400 tx=0x7f1db800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f1daffff640 1 -- 172.21.15.1:0/317572166 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db80074e0 con 0x7f1dc80b6190 2024-09-15T21:55:31.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f1dce0f6640 1 -- 172.21.15.1:0/317572166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc80b0080 con 0x7f1dc80b6190 2024-09-15T21:55:31.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f1dce0f6640 1 -- 172.21.15.1:0/317572166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc8200d60 con 0x7f1dc80b6190 2024-09-15T21:55:31.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b3100640 1 Processor -- start 2024-09-15T21:55:31.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b3100640 1 -- start start 2024-09-15T21:55:31.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f9404ff9640 1 -- 172.21.15.1:0/2134539764 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f93f401b070 con 0x7f94000d5f60 2024-09-15T21:55:31.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f9404ff9640 1 --2- 172.21.15.1:0/2134539764 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f93ec067990 0x7f93ec069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f9404ff9640 1 -- 172.21.15.1:0/2134539764 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f93f4085730 con 0x7f94000d5f60 2024-09-15T21:55:31.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f9404ff9640 1 --2- 172.21.15.1:0/2134539764 >> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] conn(0x7f93ec06fbb0 0x7f93ec071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f9404ff9640 1 -- 172.21.15.1:0/2134539764 --> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93f4006e50 con 0x7f93ec06fbb0 2024-09-15T21:55:31.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f9404ff9640 1 -- 172.21.15.1:0/2134539764 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f93f4085b20 con 0x7f94000d5f60 2024-09-15T21:55:31.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f2a70ff9640 1 -- 172.21.15.1:0/3446414464 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2a6c0c0070 con 0x7f2a740b99a0 2024-09-15T21:55:31.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f94077fe640 1 --2- 172.21.15.1:0/2134539764 >> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] conn(0x7f93ec06fbb0 0x7f93ec071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f9407fff640 1 --2- 172.21.15.1:0/2134539764 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f93ec067990 0x7f93ec069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b3100640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9ac0aea10 0x7fd9ac1dfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b3100640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9ac0b51b0 0x7fd9ac0b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b3100640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9ac0b9980 0x7fd9ac0b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b3100640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac151d60 con 0x7fd9ac0b9980 2024-09-15T21:55:31.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b3100640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac151be0 con 0x7fd9ac0aea10 2024-09-15T21:55:31.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b3100640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd9ac151ee0 con 0x7fd9ac0b51b0 2024-09-15T21:55:31.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f2a70ff9640 1 --2- 172.21.15.1:0/3446414464 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2a600678c0 0x7f2a60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f2a73fff640 1 --2- 172.21.15.1:0/3446414464 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2a600678c0 0x7f2a60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f2a70ff9640 1 -- 172.21.15.1:0/3446414464 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2a6c121170 con 0x7f2a740b99a0 2024-09-15T21:55:31.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f2a70ff9640 1 --2- 172.21.15.1:0/3446414464 >> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] conn(0x7f2a6006fb40 0x7f2a60071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f2a70ff9640 1 -- 172.21.15.1:0/3446414464 --> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a6c0a6e50 con 0x7f2a6006fb40 2024-09-15T21:55:31.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f2a70ff9640 1 -- 172.21.15.1:0/3446414464 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2a6c121560 con 0x7f2a740b99a0 2024-09-15T21:55:31.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f1daffff640 1 -- 172.21.15.1:0/317572166 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db8007680 con 0x7f1dc80b6190 2024-09-15T21:55:31.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f1daffff640 1 -- 172.21.15.1:0/317572166 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8004a10 con 0x7f1dc80b6190 2024-09-15T21:55:31.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fb92c71e640 1 -- 172.21.15.1:0/1270316971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb91c027600 con 0x7fb91c00d860 2024-09-15T21:55:31.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b0e9c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9ac0aea10 0x7fd9ac1dfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b0e9c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9ac0aea10 0x7fd9ac1dfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:42388/0 (socket says 172.21.15.1:42388) 2024-09-15T21:55:31.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b0e9c640 1 -- 172.21.15.1:0/1811555156 learned_addr learned my addr 172.21.15.1:0/1811555156 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f2a73fff640 1 --2- 172.21.15.1:0/3446414464 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2a600678c0 0x7f2a60069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a64005890 tx=0x7f2a64009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f94077fe640 1 --2- 172.21.15.1:0/2134539764 >> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] conn(0x7f93ec06fbb0 0x7f93ec071fd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f2a78cf2640 1 --2- 172.21.15.1:0/3446414464 >> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] conn(0x7f2a6006fb40 0x7f2a60071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9abfff640 1 --2- 172.21.15.1:0/1811555156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9ac0b51b0 0x7fd9ac0b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b0e9c640 1 -- 172.21.15.1:0/1811555156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9ac0b51b0 msgr2=0x7fd9ac0b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b0e9c640 1 --2- 172.21.15.1:0/1811555156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9ac0b51b0 0x7fd9ac0b0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b0e9c640 1 -- 172.21.15.1:0/1811555156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9ac0b9980 msgr2=0x7fd9ac0b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b0e9c640 1 --2- 172.21.15.1:0/1811555156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9ac0b9980 0x7fd9ac0b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7fd9b0e9c640 1 -- 172.21.15.1:0/1811555156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ac13cce0 con 0x7fd9ac0aea10 2024-09-15T21:55:31.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.141+0000 7f9407fff640 1 --2- 172.21.15.1:0/2134539764 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f93ec067990 0x7f93ec069e50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f940806ab00 tx=0x7f940806a790 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7f1daffff640 1 -- 172.21.15.1:0/317572166 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1db801a020 con 0x7f1dc80b6190 2024-09-15T21:55:31.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fb92c71e640 1 -- 172.21.15.1:0/1270316971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb91c0279e0 con 0x7fb91c00d860 2024-09-15T21:55:31.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7f9404ff9640 1 -- 172.21.15.1:0/2134539764 <== osd.6 v2:172.21.15.70:6824/2395913130 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93f4006e50 con 0x7f93ec06fbb0 2024-09-15T21:55:31.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7f1daffff640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1db40678f0 0x7f1db4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7f1daffff640 1 -- 172.21.15.1:0/317572166 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1db8085330 con 0x7f1dc80b6190 2024-09-15T21:55:31.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7f1dc77fe640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1db40678f0 0x7f1db4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fb91affd640 1 -- 172.21.15.1:0/1270316971 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb91401a070 con 0x7fb91c00d860 2024-09-15T21:55:31.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fd9b0e9c640 1 --2- 172.21.15.1:0/1811555156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9ac0aea10 0x7fd9ac1dfa30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400caf0 tx=0x7fd9a40020b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7f2a78cf2640 1 --2- 172.21.15.1:0/3446414464 >> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] conn(0x7f2a6006fb40 0x7f2a60071f60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7f1dce0f6640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] conn(0x7f1da8001660 0x7f1da8003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7f1dce0f6640 1 -- 172.21.15.1:0/317572166 --> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1da8006bc0 con 0x7f1da8001660 2024-09-15T21:55:31.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7f1dc77fe640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1db40678f0 0x7f1db4069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc006fd0 tx=0x7f1dbc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7f1dc7fff640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] conn(0x7f1da8001660 0x7f1da8003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fb91affd640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb908067910 0x7fb908069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fb91affd640 1 -- 172.21.15.1:0/1270316971 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb914084c80 con 0x7fb91c00d860 2024-09-15T21:55:31.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fb91affd640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] conn(0x7fb90806fb30 0x7fb908071f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fb91affd640 1 -- 172.21.15.1:0/1270316971 --> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb914005cf0 con 0x7fb90806fb30 2024-09-15T21:55:31.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fb91affd640 1 -- 172.21.15.1:0/1270316971 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb9140873d0 con 0x7fb91c00d860 2024-09-15T21:55:31.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fb92b4bc640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] conn(0x7fb90806fb30 0x7fb908071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7f1dc7fff640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] conn(0x7f1da8001660 0x7f1da8003b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fd9a97fa640 1 -- 172.21.15.1:0/1811555156 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4018070 con 0x7fd9ac0aea10 2024-09-15T21:55:31.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fd9a97fa640 1 -- 172.21.15.1:0/1811555156 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a400a700 con 0x7fd9ac0aea10 2024-09-15T21:55:31.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fd9b3100640 1 -- 172.21.15.1:0/1811555156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9ac1e0380 con 0x7fd9ac0aea10 2024-09-15T21:55:31.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fd9b3100640 1 -- 172.21.15.1:0/1811555156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9ac13c850 con 0x7fd9ac0aea10 2024-09-15T21:55:31.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7f1daffff640 1 -- 172.21.15.1:0/317572166 <== osd.3 v2:172.21.15.1:6810/4171924987 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1da8006bc0 con 0x7f1da8001660 2024-09-15T21:55:31.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fb929cb9640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb908067910 0x7fb908069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fd9a97fa640 1 -- 172.21.15.1:0/1811555156 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a400ab10 con 0x7fd9ac0aea10 2024-09-15T21:55:31.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.145+0000 7fd9b3100640 1 -- 172.21.15.1:0/1811555156 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd98c001040 con 0x7fd9ac0aea10 2024-09-15T21:55:31.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7fb92b4bc640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] conn(0x7fb90806fb30 0x7fb908071f50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7f2a70ff9640 1 -- 172.21.15.1:0/3446414464 <== osd.5 v2:172.21.15.70:6800/1012183169 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2a6c0a6e50 con 0x7f2a6006fb40 2024-09-15T21:55:31.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7fb929cb9640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb908067910 0x7fb908069dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0100d0 tx=0x7fb924122070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7fd9a97fa640 1 -- 172.21.15.1:0/1811555156 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd9a401b070 con 0x7fd9ac0aea10 2024-09-15T21:55:31.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7fb91affd640 1 -- 172.21.15.1:0/1270316971 <== osd.4 v2:172.21.15.70:6816/3705222670 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb914005cf0 con 0x7fb90806fb30 2024-09-15T21:55:31.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7fd9a97fa640 1 --2- 172.21.15.1:0/1811555156 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd998067910 0x7fd998069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7fd9a97fa640 1 -- 172.21.15.1:0/1811555156 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd9a40855e0 con 0x7fd9ac0aea10 2024-09-15T21:55:31.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7fd9a97fa640 1 --2- 172.21.15.1:0/1811555156 >> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] conn(0x7fd99806fb30 0x7fd998071f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7fd9a97fa640 1 -- 172.21.15.1:0/1811555156 --> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd998072600 con 0x7fd99806fb30 2024-09-15T21:55:31.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7fd9a97fa640 1 -- 172.21.15.1:0/1811555156 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd9a40859d0 con 0x7fd9ac0aea10 2024-09-15T21:55:31.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7fd9abfff640 1 --2- 172.21.15.1:0/1811555156 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd998067910 0x7fd998069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7fd9b169d640 1 --2- 172.21.15.1:0/1811555156 >> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] conn(0x7fd99806fb30 0x7fd998071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7f29e2ffd640 1 -- 172.21.15.1:0/117508351 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f29e801b020 con 0x7f29e4009df0 2024-09-15T21:55:31.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7f29e2ffd640 1 --2- 172.21.15.1:0/117508351 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f29d00678c0 0x7f29d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7f29e2ffd640 1 -- 172.21.15.1:0/117508351 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f29e8086690 con 0x7f29e4009df0 2024-09-15T21:55:31.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7f29f1d5d640 1 --2- 172.21.15.1:0/117508351 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f29d00678c0 0x7f29d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7f29e2ffd640 1 --2- 172.21.15.1:0/117508351 >> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] conn(0x7f29d006fac0 0x7f29d0071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7f29e2ffd640 1 -- 172.21.15.1:0/117508351 --> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29e8001d40 con 0x7f29d006fac0 2024-09-15T21:55:31.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7f29e2ffd640 1 -- 172.21.15.1:0/117508351 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f29e8086a80 con 0x7f29e4009df0 2024-09-15T21:55:31.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7f29f3560640 1 --2- 172.21.15.1:0/117508351 >> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] conn(0x7f29d006fac0 0x7f29d0071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7f29f1d5d640 1 --2- 172.21.15.1:0/117508351 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f29d00678c0 0x7f29d0069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0ae000 tx=0x7f29dc0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7f29f3560640 1 --2- 172.21.15.1:0/117508351 >> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] conn(0x7f29d006fac0 0x7f29d0071ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7fd9abfff640 1 --2- 172.21.15.1:0/1811555156 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd998067910 0x7fd998069dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00b5000 tx=0x7fd9a00ae000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.149+0000 7f29e2ffd640 1 -- 172.21.15.1:0/117508351 <== osd.0 v2:172.21.15.1:6818/2645824093 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29e8001d40 con 0x7f29d006fac0 2024-09-15T21:55:31.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.157+0000 7fd9b169d640 1 --2- 172.21.15.1:0/1811555156 >> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] conn(0x7fd99806fb30 0x7fd998071f50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.157+0000 7fd9a97fa640 1 -- 172.21.15.1:0/1811555156 <== osd.7 v2:172.21.15.70:6808/1018485464 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd998072600 con 0x7fd99806fb30 2024-09-15T21:55:31.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.165+0000 7f49d9bcf640 1 -- 172.21.15.1:0/3699374085 --> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49b4002de0 con 0x7f49b806fb40 2024-09-15T21:55:31.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.165+0000 7f49d17fa640 1 -- 172.21.15.1:0/3699374085 <== osd.1 v2:172.21.15.1:6826/4281279445 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f49b4002de0 con 0x7f49b806fb40 2024-09-15T21:55:31.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.165+0000 7f49beffd640 1 -- 172.21.15.1:0/3699374085 >> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] conn(0x7f49b806fb40 msgr2=0x7f49b8071f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.165+0000 7f49beffd640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] conn(0x7f49b806fb40 0x7f49b8071f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.165+0000 7f49beffd640 1 -- 172.21.15.1:0/3699374085 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f49b80678c0 msgr2=0x7f49b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.165+0000 7f49beffd640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f49b80678c0 0x7f49b8069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0cc620 tx=0x7f49d4122070 comp rx=0 tx=0).stop 2024-09-15T21:55:31.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.165+0000 7f49beffd640 1 -- 172.21.15.1:0/3699374085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49cc01b040 msgr2=0x7f49cc0c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.165+0000 7f49beffd640 1 --2- 172.21.15.1:0/3699374085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49cc01b040 0x7f49cc0c45f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c3c0 tx=0x7f49c800c880 comp rx=0 tx=0).stop 2024-09-15T21:55:31.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.165+0000 7f49d93ce640 1 -- 172.21.15.1:0/3699374085 reap_dead start 2024-09-15T21:55:31.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7f49beffd640 1 -- 172.21.15.1:0/3699374085 shutdown_connections 2024-09-15T21:55:31.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7f49beffd640 1 -- 172.21.15.1:0/3699374085 >> 172.21.15.1:0/3699374085 conn(0x7f49cc0092a0 msgr2=0x7f49cc038a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7f49beffd640 1 -- 172.21.15.1:0/3699374085 shutdown_connections 2024-09-15T21:55:31.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7f49beffd640 1 -- 172.21.15.1:0/3699374085 wait complete. 2024-09-15T21:55:31.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7ff836f94640 1 -- 172.21.15.1:0/812216186 --> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff828009c20 con 0x7ff81406fa60 2024-09-15T21:55:31.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7ff8267fc640 1 -- 172.21.15.1:0/812216186 <== osd.2 v2:172.21.15.1:6800/3014237921 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff828009c20 con 0x7ff81406fa60 2024-09-15T21:55:31.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7ff813fff640 1 -- 172.21.15.1:0/812216186 >> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] conn(0x7ff81406fa60 msgr2=0x7ff814071e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7ff813fff640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] conn(0x7ff81406fa60 0x7ff814071e80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7ff813fff640 1 -- 172.21.15.1:0/812216186 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff8140678c0 msgr2=0x7ff814069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7ff813fff640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff8140678c0 0x7ff814069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0ad000 tx=0x7ff82c0a6000 comp rx=0 tx=0).stop 2024-09-15T21:55:31.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7ff813fff640 1 -- 172.21.15.1:0/812216186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8280cb6a0 msgr2=0x7ff82802f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7ff813fff640 1 --2- 172.21.15.1:0/812216186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8280cb6a0 0x7ff82802f6e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8300657c0 tx=0x7ff830069810 comp rx=0 tx=0).stop 2024-09-15T21:55:31.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7ff836793640 1 -- 172.21.15.1:0/812216186 reap_dead start 2024-09-15T21:55:31.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7ff813fff640 1 -- 172.21.15.1:0/812216186 shutdown_connections 2024-09-15T21:55:31.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7ff813fff640 1 -- 172.21.15.1:0/812216186 >> 172.21.15.1:0/812216186 conn(0x7ff828008ea0 msgr2=0x7ff8280c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7ff813fff640 1 -- 172.21.15.1:0/812216186 shutdown_connections 2024-09-15T21:55:31.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.169+0000 7ff813fff640 1 -- 172.21.15.1:0/812216186 wait complete. 2024-09-15T21:55:31.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f940d262640 1 -- 172.21.15.1:0/2134539764 --> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f93e8002de0 con 0x7f93ec06fbb0 2024-09-15T21:55:31.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f9404ff9640 1 -- 172.21.15.1:0/2134539764 <== osd.6 v2:172.21.15.70:6824/2395913130 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f93e8002de0 con 0x7f93ec06fbb0 2024-09-15T21:55:31.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f2a7a755640 1 -- 172.21.15.1:0/3446414464 --> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2a7409c3c0 con 0x7f2a6006fb40 2024-09-15T21:55:31.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f1dce0f6640 1 -- 172.21.15.1:0/317572166 --> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1da8005c50 con 0x7f1da8001660 2024-09-15T21:55:31.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f1daffff640 1 -- 172.21.15.1:0/317572166 <== osd.3 v2:172.21.15.1:6810/4171924987 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1da8005c50 con 0x7f1da8001660 2024-09-15T21:55:31.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f2a70ff9640 1 -- 172.21.15.1:0/3446414464 <== osd.5 v2:172.21.15.70:6800/1012183169 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2a7409c3c0 con 0x7f2a6006fb40 2024-09-15T21:55:31.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f1dce0f6640 1 -- 172.21.15.1:0/317572166 >> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] conn(0x7f1da8001660 msgr2=0x7f1da8003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f1dce0f6640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] conn(0x7f1da8001660 0x7f1da8003b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f1dce0f6640 1 -- 172.21.15.1:0/317572166 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1db40678f0 msgr2=0x7f1db4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f1dce0f6640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1db40678f0 0x7f1db4069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc006fd0 tx=0x7f1dbc008040 comp rx=0 tx=0).stop 2024-09-15T21:55:31.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7fb92c71e640 1 -- 172.21.15.1:0/1270316971 --> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb91c0c8500 con 0x7fb90806fb30 2024-09-15T21:55:31.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f93f27fc640 1 -- 172.21.15.1:0/2134539764 >> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] conn(0x7f93ec06fbb0 msgr2=0x7f93ec071fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f93f27fc640 1 --2- 172.21.15.1:0/2134539764 >> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] conn(0x7f93ec06fbb0 0x7f93ec071fd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f1dce0f6640 1 -- 172.21.15.1:0/317572166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dc80b6190 msgr2=0x7f1dc80b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f1dce0f6640 1 --2- 172.21.15.1:0/317572166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1dc80b6190 0x7f1dc80b04e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1db800c400 tx=0x7f1db800c8c0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f1dc7fff640 1 -- 172.21.15.1:0/317572166 reap_dead start 2024-09-15T21:55:31.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f93f27fc640 1 -- 172.21.15.1:0/2134539764 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f93ec067990 msgr2=0x7f93ec069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f93f27fc640 1 --2- 172.21.15.1:0/2134539764 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f93ec067990 0x7f93ec069e50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f940806ab00 tx=0x7f940806a790 comp rx=0 tx=0).stop 2024-09-15T21:55:31.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f93f27fc640 1 -- 172.21.15.1:0/2134539764 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f94000d5f60 msgr2=0x7f94000c5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f93f27fc640 1 --2- 172.21.15.1:0/2134539764 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f94000d5f60 0x7f94000c5d40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f93f400c480 tx=0x7f93f400c940 comp rx=0 tx=0).stop 2024-09-15T21:55:31.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f940ca61640 1 -- 172.21.15.1:0/2134539764 reap_dead start 2024-09-15T21:55:31.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f29f47c2640 1 -- 172.21.15.1:0/117508351 --> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29e401f200 con 0x7f29d006fac0 2024-09-15T21:55:31.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f2a7a755640 1 -- 172.21.15.1:0/3446414464 >> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] conn(0x7f2a6006fb40 msgr2=0x7f2a60071f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f2a7a755640 1 --2- 172.21.15.1:0/3446414464 >> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] conn(0x7f2a6006fb40 0x7f2a60071f60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f93f27fc640 1 -- 172.21.15.1:0/2134539764 shutdown_connections 2024-09-15T21:55:31.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f93f27fc640 1 -- 172.21.15.1:0/2134539764 >> 172.21.15.1:0/2134539764 conn(0x7f9400008ea0 msgr2=0x7f94000c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f1dce0f6640 1 -- 172.21.15.1:0/317572166 shutdown_connections 2024-09-15T21:55:31.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f1dce0f6640 1 -- 172.21.15.1:0/317572166 >> 172.21.15.1:0/317572166 conn(0x7f1dc806c0c0 msgr2=0x7f1dc80ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f93f27fc640 1 -- 172.21.15.1:0/2134539764 shutdown_connections 2024-09-15T21:55:31.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7f93f27fc640 1 -- 172.21.15.1:0/2134539764 wait complete. 2024-09-15T21:55:31.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.177+0000 7fb91affd640 1 -- 172.21.15.1:0/1270316971 <== osd.4 v2:172.21.15.70:6816/3705222670 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb91c0c8500 con 0x7fb90806fb30 2024-09-15T21:55:31.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f29e2ffd640 1 -- 172.21.15.1:0/117508351 <== osd.0 v2:172.21.15.1:6818/2645824093 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f29e401f200 con 0x7f29d006fac0 2024-09-15T21:55:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f2a7a755640 1 -- 172.21.15.1:0/3446414464 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2a600678c0 msgr2=0x7f2a60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f2a7a755640 1 --2- 172.21.15.1:0/3446414464 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2a600678c0 0x7f2a60069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a64005890 tx=0x7f2a64009040 comp rx=0 tx=0).stop 2024-09-15T21:55:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f2a7a755640 1 -- 172.21.15.1:0/3446414464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a740b99a0 msgr2=0x7f2a74145510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f2a7a755640 1 --2- 172.21.15.1:0/3446414464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a740b99a0 0x7f2a74145510 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0ac000 tx=0x7f2a6c0196a0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f2a78cf2640 1 -- 172.21.15.1:0/3446414464 reap_dead start 2024-09-15T21:55:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7fb92c71e640 1 -- 172.21.15.1:0/1270316971 >> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] conn(0x7fb90806fb30 msgr2=0x7fb908071f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7fb92c71e640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] conn(0x7fb90806fb30 0x7fb908071f50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f1dce0f6640 1 -- 172.21.15.1:0/317572166 shutdown_connections 2024-09-15T21:55:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f1dce0f6640 1 -- 172.21.15.1:0/317572166 wait complete. 2024-09-15T21:55:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f2a7a755640 1 -- 172.21.15.1:0/3446414464 shutdown_connections 2024-09-15T21:55:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f2a7a755640 1 -- 172.21.15.1:0/3446414464 >> 172.21.15.1:0/3446414464 conn(0x7f2a7406c4c0 msgr2=0x7f2a7406cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f29e0ff9640 1 -- 172.21.15.1:0/117508351 >> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] conn(0x7f29d006fac0 msgr2=0x7f29d0071ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f29e0ff9640 1 --2- 172.21.15.1:0/117508351 >> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] conn(0x7f29d006fac0 0x7f29d0071ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7fb92c71e640 1 -- 172.21.15.1:0/1270316971 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb908067910 msgr2=0x7fb908069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7fb92c71e640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb908067910 0x7fb908069dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0100d0 tx=0x7fb924122070 comp rx=0 tx=0).stop 2024-09-15T21:55:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f2a7a755640 1 -- 172.21.15.1:0/3446414464 shutdown_connections 2024-09-15T21:55:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f2a7a755640 1 -- 172.21.15.1:0/3446414464 wait complete. 2024-09-15T21:55:31.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7fb92c71e640 1 -- 172.21.15.1:0/1270316971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb91c00d860 msgr2=0x7fb91c0c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7fb92c71e640 1 --2- 172.21.15.1:0/1270316971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb91c00d860 0x7fb91c0c9210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb91400c460 tx=0x7fb91400c920 comp rx=0 tx=0).stop 2024-09-15T21:55:31.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7fb92b4bc640 1 -- 172.21.15.1:0/1270316971 reap_dead start 2024-09-15T21:55:31.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7fb92c71e640 1 -- 172.21.15.1:0/1270316971 shutdown_connections 2024-09-15T21:55:31.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7fb92c71e640 1 -- 172.21.15.1:0/1270316971 >> 172.21.15.1:0/1270316971 conn(0x7fb91c041b70 msgr2=0x7fb91c0cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7fb92c71e640 1 -- 172.21.15.1:0/1270316971 shutdown_connections 2024-09-15T21:55:31.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7fb92c71e640 1 -- 172.21.15.1:0/1270316971 wait complete. 2024-09-15T21:55:31.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f29e0ff9640 1 -- 172.21.15.1:0/117508351 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f29d00678c0 msgr2=0x7f29d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f29e0ff9640 1 --2- 172.21.15.1:0/117508351 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f29d00678c0 0x7f29d0069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0ae000 tx=0x7f29dc0a7000 comp rx=0 tx=0).stop 2024-09-15T21:55:31.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f29e0ff9640 1 -- 172.21.15.1:0/117508351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f29e4009df0 msgr2=0x7f29e4035640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.181+0000 7f29e0ff9640 1 --2- 172.21.15.1:0/117508351 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f29e4009df0 0x7f29e4035640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f29e800d830 tx=0x7f29e800dcf0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.185+0000 7f29f3560640 1 -- 172.21.15.1:0/117508351 reap_dead start 2024-09-15T21:55:31.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.185+0000 7fd9b3100640 1 -- 172.21.15.1:0/1811555156 --> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd98c002de0 con 0x7fd99806fb30 2024-09-15T21:55:31.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.185+0000 7f29e0ff9640 1 -- 172.21.15.1:0/117508351 shutdown_connections 2024-09-15T21:55:31.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.185+0000 7f29e0ff9640 1 -- 172.21.15.1:0/117508351 >> 172.21.15.1:0/117508351 conn(0x7f29e4009070 msgr2=0x7f29e40c74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.185+0000 7fd9a97fa640 1 -- 172.21.15.1:0/1811555156 <== osd.7 v2:172.21.15.70:6808/1018485464 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd98c002de0 con 0x7fd99806fb30 2024-09-15T21:55:31.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.185+0000 7fd9b3100640 1 -- 172.21.15.1:0/1811555156 >> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] conn(0x7fd99806fb30 msgr2=0x7fd998071f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.185+0000 7fd9b3100640 1 --2- 172.21.15.1:0/1811555156 >> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] conn(0x7fd99806fb30 0x7fd998071f50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.189+0000 7fd9b3100640 1 -- 172.21.15.1:0/1811555156 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd998067910 msgr2=0x7fd998069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.189+0000 7fd9b3100640 1 --2- 172.21.15.1:0/1811555156 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd998067910 0x7fd998069dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00b5000 tx=0x7fd9a00ae000 comp rx=0 tx=0).stop 2024-09-15T21:55:31.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.189+0000 7fd9b3100640 1 -- 172.21.15.1:0/1811555156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9ac0aea10 msgr2=0x7fd9ac1dfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.189+0000 7fd9b3100640 1 --2- 172.21.15.1:0/1811555156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9ac0aea10 0x7fd9ac1dfa30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400caf0 tx=0x7fd9a40020b0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.189+0000 7fd9b169d640 1 -- 172.21.15.1:0/1811555156 reap_dead start 2024-09-15T21:55:31.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.189+0000 7fd9b3100640 1 -- 172.21.15.1:0/1811555156 shutdown_connections 2024-09-15T21:55:31.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.189+0000 7fd9b3100640 1 -- 172.21.15.1:0/1811555156 >> 172.21.15.1:0/1811555156 conn(0x7fd9ac06c4c0 msgr2=0x7fd9ac09b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.189+0000 7fd9b3100640 1 -- 172.21.15.1:0/1811555156 shutdown_connections 2024-09-15T21:55:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.189+0000 7fd9b3100640 1 -- 172.21.15.1:0/1811555156 wait complete. 2024-09-15T21:55:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.193+0000 7f29e0ff9640 1 -- 172.21.15.1:0/117508351 shutdown_connections 2024-09-15T21:55:31.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.193+0000 7f29e0ff9640 1 -- 172.21.15.1:0/117508351 wait complete. 2024-09-15T21:55:31.226 INFO:teuthology.orchestra.run.smithi001.stdout:64424509447 2024-09-15T21:55:31.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T21:55:31.227 INFO:teuthology.orchestra.run.smithi001.stdout:55834574855 2024-09-15T21:55:31.227 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T21:55:31.228 INFO:teuthology.orchestra.run.smithi001.stdout:64424509447 2024-09-15T21:55:31.228 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T21:55:31.229 INFO:teuthology.orchestra.run.smithi001.stdout:64424509448 2024-09-15T21:55:31.232 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T21:55:31.233 INFO:teuthology.orchestra.run.smithi001.stdout:64424509448 2024-09-15T21:55:31.233 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T21:55:31.234 INFO:teuthology.orchestra.run.smithi001.stdout:64424509447 2024-09-15T21:55:31.234 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T21:55:31.235 INFO:teuthology.orchestra.run.smithi001.stdout:55834574855 2024-09-15T21:55:31.235 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T21:55:31.236 INFO:teuthology.orchestra.run.smithi001.stdout:64424509446 2024-09-15T21:55:31.237 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T21:55:31.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.417+0000 7f7a39fbe640 1 Processor -- start 2024-09-15T21:55:31.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.417+0000 7f7a39fbe640 1 -- start start 2024-09-15T21:55:31.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.421+0000 7f7a39fbe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7a340b6190 0x7f7a340b5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.421+0000 7f7a39fbe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7a340ae9b0 0x7f7a3406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.421+0000 7f7a39fbe640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a340b6570 con 0x7f7a340ae580 2024-09-15T21:55:31.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.421+0000 7f7a39fbe640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f7a340b4680 con 0x7f7a340b6190 2024-09-15T21:55:31.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.421+0000 7f7a39fbe640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f7a340ae0f0 con 0x7f7a340ae9b0 2024-09-15T21:55:31.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.421+0000 7f7a337fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7a340b6190 0x7f7a340b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.421+0000 7f7a337fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7a340b6190 0x7f7a340b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60402/0 (socket says 172.21.15.1:60402) 2024-09-15T21:55:31.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.421+0000 7f7a337fe640 1 -- 172.21.15.1:0/3766872558 learned_addr learned my addr 172.21.15.1:0/3766872558 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.421+0000 7f7a33fff640 1 --2- 172.21.15.1:0/3766872558 >> v2:172.21.15.70:3300/0 conn(0x7f7a340ae9b0 0x7f7a3406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.421+0000 7f7a337fe640 1 -- 172.21.15.1:0/3766872558 >> v2:172.21.15.70:3300/0 conn(0x7f7a340ae9b0 msgr2=0x7f7a3406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.421+0000 7f7a337fe640 1 --2- 172.21.15.1:0/3766872558 >> v2:172.21.15.70:3300/0 conn(0x7f7a340ae9b0 0x7f7a3406d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.421+0000 7f7a337fe640 1 -- 172.21.15.1:0/3766872558 >> v1:172.21.15.70:6789/0 conn(0x7f7a340ae580 legacy=0x7f7a3406cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.421+0000 7f7a337fe640 1 -- 172.21.15.1:0/3766872558 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a340b4030 con 0x7f7a340b6190 2024-09-15T21:55:31.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90f4cf640 1 Processor -- start 2024-09-15T21:55:31.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90f4cf640 1 -- start start 2024-09-15T21:55:31.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90f4cf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb90806d170 0x7fb9080aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90f4cf640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb9080b3eb0 0x7fb90809b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90f4cf640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9080b4320 con 0x7fb9080b5130 2024-09-15T21:55:31.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90f4cf640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fb9080ae640 con 0x7fb9080b3eb0 2024-09-15T21:55:31.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90f4cf640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fb9080b6380 con 0x7fb90806d170 2024-09-15T21:55:31.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90d26b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb90806d170 0x7fb9080aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90d26b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb90806d170 0x7fb9080aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:42414/0 (socket says 172.21.15.1:42414) 2024-09-15T21:55:31.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90d26b640 1 -- 172.21.15.1:0/1319254268 learned_addr learned my addr 172.21.15.1:0/1319254268 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90ca6a640 1 --1- 172.21.15.1:0/1319254268 >> v1:172.21.15.70:6789/0 conn(0x7fb9080b5130 0x7fb90809aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.1:59024/0 (socket says 172.21.15.1:59024) 2024-09-15T21:55:31.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90da6c640 1 --2- 172.21.15.1:0/1319254268 >> v2:172.21.15.1:3300/0 conn(0x7fb9080b3eb0 0x7fb90809b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90d26b640 1 -- 172.21.15.1:0/1319254268 >> v2:172.21.15.1:3300/0 conn(0x7fb9080b3eb0 msgr2=0x7fb90809b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90d26b640 1 --2- 172.21.15.1:0/1319254268 >> v2:172.21.15.1:3300/0 conn(0x7fb9080b3eb0 0x7fb90809b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90d26b640 1 -- 172.21.15.1:0/1319254268 >> v1:172.21.15.70:6789/0 conn(0x7fb9080b5130 legacy=0x7fb90809aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7fb90d26b640 1 -- 172.21.15.1:0/1319254268 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9080b69d0 con 0x7fb90806d170 2024-09-15T21:55:31.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7f7a337fe640 1 --2- 172.21.15.1:0/3766872558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a340b6190 0x7f7a340b5230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a340b4800 tx=0x7f7a24024a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed7b4f22bf37b6c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7f7a327fc640 1 -- 172.21.15.1:0/3766872558 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24008be0 con 0x7f7a340b6190 2024-09-15T21:55:31.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7f7a327fc640 1 -- 172.21.15.1:0/3766872558 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a24008d80 con 0x7f7a340b6190 2024-09-15T21:55:31.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7f7a327fc640 1 -- 172.21.15.1:0/3766872558 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240adad0 con 0x7f7a340b6190 2024-09-15T21:55:31.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7f7a39fbe640 1 -- 172.21.15.1:0/3766872558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a340b6190 msgr2=0x7f7a340b5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7f7a39fbe640 1 --2- 172.21.15.1:0/3766872558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a340b6190 0x7f7a340b5230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a340b4800 tx=0x7f7a24024a40 comp rx=0 tx=0).stop 2024-09-15T21:55:31.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7f7a39fbe640 1 -- 172.21.15.1:0/3766872558 shutdown_connections 2024-09-15T21:55:31.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7f7a39fbe640 1 --2- 172.21.15.1:0/3766872558 >> v2:172.21.15.70:3300/0 conn(0x7f7a340ae9b0 0x7f7a3406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7f7a39fbe640 1 --2- 172.21.15.1:0/3766872558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a340b6190 0x7f7a340b5230 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7f7a39fbe640 1 -- 172.21.15.1:0/3766872558 >> 172.21.15.1:0/3766872558 conn(0x7f7a3406c0c0 msgr2=0x7f7a3406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7f7a39fbe640 1 -- 172.21.15.1:0/3766872558 shutdown_connections 2024-09-15T21:55:31.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.425+0000 7f7a39fbe640 1 -- 172.21.15.1:0/3766872558 wait complete. 2024-09-15T21:55:31.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7fb90d26b640 1 --2- 172.21.15.1:0/1319254268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb90806d170 0x7fb9080aed50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb9080b5bc0 tx=0x7fb8f801c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6df784a6f26f8651 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7fb8fffff640 1 -- 172.21.15.1:0/1319254268 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f80b0070 con 0x7fb90806d170 2024-09-15T21:55:31.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7fb8fffff640 1 -- 172.21.15.1:0/1319254268 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f80ab600 con 0x7fb90806d170 2024-09-15T21:55:31.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7f7a39fbe640 1 Processor -- start 2024-09-15T21:55:31.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7fb8fffff640 1 -- 172.21.15.1:0/1319254268 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f80ab9d0 con 0x7fb90806d170 2024-09-15T21:55:31.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7fb90f4cf640 1 -- 172.21.15.1:0/1319254268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb90806d170 msgr2=0x7fb9080aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7fb90f4cf640 1 --2- 172.21.15.1:0/1319254268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb90806d170 0x7fb9080aed50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb9080b5bc0 tx=0x7fb8f801c490 comp rx=0 tx=0).stop 2024-09-15T21:55:31.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7f7a39fbe640 1 -- start start 2024-09-15T21:55:31.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7f7a39fbe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a340ae580 0x7f7a341ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7f7a39fbe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a340ae9b0 0x7f7a341ed770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7f7a39fbe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a340b6190 0x7f7a340712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7f7a39fbe640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7a340b4ed0 con 0x7f7a340b6190 2024-09-15T21:55:31.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7f7a39fbe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7a340aee40 con 0x7f7a340ae9b0 2024-09-15T21:55:31.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7f7a39fbe640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7a340b3a30 con 0x7f7a340ae580 2024-09-15T21:55:31.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7f7a32ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a340ae9b0 0x7f7a341ed770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7f7a337fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a340ae580 0x7f7a341ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7f7a32ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a340ae9b0 0x7f7a341ed770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:42426/0 (socket says 172.21.15.1:42426) 2024-09-15T21:55:31.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7f7a32ffd640 1 -- 172.21.15.1:0/738752300 learned_addr learned my addr 172.21.15.1:0/738752300 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.429+0000 7f7a33fff640 1 --2- 172.21.15.1:0/738752300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a340b6190 0x7f7a340712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7f7a337fe640 1 -- 172.21.15.1:0/738752300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a340ae9b0 msgr2=0x7f7a341ed770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7f7a337fe640 1 --2- 172.21.15.1:0/738752300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a340ae9b0 0x7f7a341ed770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7f7a337fe640 1 -- 172.21.15.1:0/738752300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a340b6190 msgr2=0x7f7a340712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7f7a337fe640 1 --2- 172.21.15.1:0/738752300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a340b6190 0x7f7a340712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7f7a337fe640 1 -- 172.21.15.1:0/738752300 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a340b21c0 con 0x7f7a340ae580 2024-09-15T21:55:31.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 -- 172.21.15.1:0/1319254268 shutdown_connections 2024-09-15T21:55:31.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 --2- 172.21.15.1:0/1319254268 >> v2:172.21.15.1:3300/0 conn(0x7fb9080b3eb0 0x7fb90809b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 --2- 172.21.15.1:0/1319254268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb90806d170 0x7fb9080aed50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 -- 172.21.15.1:0/1319254268 >> 172.21.15.1:0/1319254268 conn(0x7fb90806c0c0 msgr2=0x7fb90806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7f7a337fe640 1 --2- 172.21.15.1:0/738752300 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a340ae580 0x7f7a341ed230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a340b6760 tx=0x7f7a240217e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 -- 172.21.15.1:0/1319254268 shutdown_connections 2024-09-15T21:55:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7f7a1bfff640 1 -- 172.21.15.1:0/738752300 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24018580 con 0x7f7a340ae580 2024-09-15T21:55:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7f7a1bfff640 1 -- 172.21.15.1:0/738752300 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a240ade40 con 0x7f7a340ae580 2024-09-15T21:55:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7f7a1bfff640 1 -- 172.21.15.1:0/738752300 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400a6a0 con 0x7f7a340ae580 2024-09-15T21:55:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7f7a39fbe640 1 -- 172.21.15.1:0/738752300 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a34070520 con 0x7f7a340ae580 2024-09-15T21:55:31.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7f7a39fbe640 1 -- 172.21.15.1:0/738752300 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a34071830 con 0x7f7a340ae580 2024-09-15T21:55:31.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 -- 172.21.15.1:0/1319254268 wait complete. 2024-09-15T21:55:31.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 Processor -- start 2024-09-15T21:55:31.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7f7a39fbe640 1 -- 172.21.15.1:0/738752300 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a340b5230 con 0x7f7a340ae580 2024-09-15T21:55:31.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 -- start start 2024-09-15T21:55:31.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb90806d170 0x7fb9081e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9080b3eb0 0x7fb9080b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9080b5130 0x7fb90814fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9080b55c0 con 0x7fb90806d170 2024-09-15T21:55:31.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9080b65d0 con 0x7fb9080b3eb0 2024-09-15T21:55:31.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.433+0000 7fb90f4cf640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb90809b6a0 con 0x7fb9080b5130 2024-09-15T21:55:31.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90ca6a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9080b3eb0 0x7fb9080b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90ca6a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9080b3eb0 0x7fb9080b2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:42438/0 (socket says 172.21.15.1:42438) 2024-09-15T21:55:31.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90ca6a640 1 -- 172.21.15.1:0/3164762533 learned_addr learned my addr 172.21.15.1:0/3164762533 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90d26b640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb90806d170 0x7fb9081e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90ca6a640 1 -- 172.21.15.1:0/3164762533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9080b5130 msgr2=0x7fb90814fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90ca6a640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9080b5130 0x7fb90814fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90ca6a640 1 -- 172.21.15.1:0/3164762533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb90806d170 msgr2=0x7fb9081e7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7f7a1bfff640 1 -- 172.21.15.1:0/738752300 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a240bc070 con 0x7f7a340ae580 2024-09-15T21:55:31.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90ca6a640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb90806d170 0x7fb9081e7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90ca6a640 1 -- 172.21.15.1:0/3164762533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90814f220 con 0x7fb9080b3eb0 2024-09-15T21:55:31.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90d26b640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb90806d170 0x7fb9081e7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:55:31.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90ca6a640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9080b3eb0 0x7fb9080b2830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb90400c410 tx=0x7fb90400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7f7a1bfff640 1 --2- 172.21.15.1:0/738752300 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7a1c067a20 0x7f7a1c069ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7f7a1bfff640 1 -- 172.21.15.1:0/738752300 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7a2411fd60 con 0x7f7a340ae580 2024-09-15T21:55:31.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb8fdffb640 1 -- 172.21.15.1:0/3164762533 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9040074e0 con 0x7fb9080b3eb0 2024-09-15T21:55:31.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90f4cf640 1 -- 172.21.15.1:0/3164762533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9081516b0 con 0x7fb9080b3eb0 2024-09-15T21:55:31.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90f4cf640 1 -- 172.21.15.1:0/3164762533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb90814d6a0 con 0x7fb9080b3eb0 2024-09-15T21:55:31.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7f7a32ffd640 1 --2- 172.21.15.1:0/738752300 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7a1c067a20 0x7f7a1c069ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb8fdffb640 1 -- 172.21.15.1:0/3164762533 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb904007680 con 0x7fb9080b3eb0 2024-09-15T21:55:31.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb8fdffb640 1 -- 172.21.15.1:0/3164762533 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904004a10 con 0x7fb9080b3eb0 2024-09-15T21:55:31.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7f7a32ffd640 1 --2- 172.21.15.1:0/738752300 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7a1c067a20 0x7f7a1c069ee0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a28000c10 tx=0x7f7a28009ba0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.437+0000 7fb90f4cf640 1 -- 172.21.15.1:0/3164762533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e80052a0 con 0x7fb9080b3eb0 2024-09-15T21:55:31.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7fb8fdffb640 1 -- 172.21.15.1:0/3164762533 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb90401a020 con 0x7fb9080b3eb0 2024-09-15T21:55:31.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7fb8fdffb640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb8ec0678c0 0x7fb8ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7fb8fdffb640 1 -- 172.21.15.1:0/3164762533 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb9040852a0 con 0x7fb9080b3eb0 2024-09-15T21:55:31.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7fb90d26b640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb8ec0678c0 0x7fb8ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7fb90d26b640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb8ec0678c0 0x7fb8ec069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80ad000 tx=0x7fb8f80a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f721ffff640 1 Processor -- start 2024-09-15T21:55:31.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f721ffff640 1 -- start start 2024-09-15T21:55:31.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f40cd1e7640 1 Processor -- start 2024-09-15T21:55:31.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f40cd1e7640 1 -- start start 2024-09-15T21:55:31.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f721ffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f721801e990 0x7f7218007790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f721effd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f721801e990 0x7f7218007790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f721effd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f721801e990 0x7f7218007790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60426/0 (socket says 172.21.15.1:60426) 2024-09-15T21:55:31.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f721e7fc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f721800bbd0 0x7f72180d0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49720/0 (socket says 172.21.15.1:49720) 2024-09-15T21:55:31.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f721effd640 1 -- 172.21.15.1:0/3807055205 learned_addr learned my addr 172.21.15.1:0/3807055205 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f40cd1e7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40c8067c60 0x7f40c80aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f40cd1e7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f40c8146bd0 0x7f40c8147040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f40cd1e7640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40c8068040 con 0x7f40c80afa30 2024-09-15T21:55:31.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f40cd1e7640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f40c80af2c0 con 0x7f40c8146bd0 2024-09-15T21:55:31.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f40cd1e7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f40c80af5a0 con 0x7f40c8067c60 2024-09-15T21:55:31.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f40c659c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f40c80afa30 0x7f40c80afe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49734/0 (socket says 172.21.15.1:49734) 2024-09-15T21:55:31.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f40c659c640 1 -- 172.21.15.1:0/4270127243 learned_addr learned my addr 172.21.15.1:0/4270127243 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:31.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f721ffff640 1 --2- 172.21.15.1:0/3807055205 >> v2:172.21.15.70:3300/0 conn(0x7f721800c030 0x7f72180dacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f721ffff640 1 -- 172.21.15.1:0/3807055205 --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f721801ed70 con 0x7f721800bbd0 2024-09-15T21:55:31.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f721ffff640 1 -- 172.21.15.1:0/3807055205 --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f7218008530 con 0x7f721801e990 2024-09-15T21:55:31.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.441+0000 7f721ffff640 1 -- 172.21.15.1:0/3807055205 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f7218007cd0 con 0x7f721800c030 2024-09-15T21:55:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f40c6d9d640 1 --2- 172.21.15.1:0/4270127243 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40c8067c60 0x7f40c80aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f40c759e640 1 --2- 172.21.15.1:0/4270127243 >> v2:172.21.15.1:3300/0 conn(0x7f40c8146bd0 0x7f40c8147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f721f7fe640 1 --2- 172.21.15.1:0/3807055205 >> v2:172.21.15.70:3300/0 conn(0x7f721800c030 0x7f72180dacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f40c6d9d640 1 -- 172.21.15.1:0/4270127243 >> v2:172.21.15.1:3300/0 conn(0x7f40c8146bd0 msgr2=0x7f40c8147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f40c6d9d640 1 --2- 172.21.15.1:0/4270127243 >> v2:172.21.15.1:3300/0 conn(0x7f40c8146bd0 0x7f40c8147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f40c6d9d640 1 -- 172.21.15.1:0/4270127243 >> v1:172.21.15.1:6789/0 conn(0x7f40c80afa30 legacy=0x7f40c80afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f40c6d9d640 1 -- 172.21.15.1:0/4270127243 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c80b0b30 con 0x7f40c8067c60 2024-09-15T21:55:31.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f721dffb640 1 -- 172.21.15.1:0/3807055205 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1481843339 0 0) 0x7f721801ed70 con 0x7f721800bbd0 2024-09-15T21:55:31.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f721effd640 1 -- 172.21.15.1:0/3807055205 >> v2:172.21.15.70:3300/0 conn(0x7f721800c030 msgr2=0x7f72180dacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f721effd640 1 --2- 172.21.15.1:0/3807055205 >> v2:172.21.15.70:3300/0 conn(0x7f721800c030 0x7f72180dacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f721effd640 1 -- 172.21.15.1:0/3807055205 >> v1:172.21.15.1:6789/0 conn(0x7f721800bbd0 legacy=0x7f72180d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f721effd640 1 -- 172.21.15.1:0/3807055205 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7218009660 con 0x7f721801e990 2024-09-15T21:55:31.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7f721f7fe640 1 --2- 172.21.15.1:0/3807055205 >> v2:172.21.15.70:3300/0 conn(0x7f721800c030 0x7f72180dacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:55:31.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd3c86d640 1 Processor -- start 2024-09-15T21:55:31.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd3c86d640 1 -- start start 2024-09-15T21:55:31.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd3c86d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcd300cbfa0 0x7fcd30037100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd3c86d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcd30037640 0x7fcd300d6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd3c86d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd3003ae40 con 0x7fcd3003aa60 2024-09-15T21:55:31.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd3c86d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fcd30037fd0 con 0x7fcd30037640 2024-09-15T21:55:31.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd3c86d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3002db50 con 0x7fcd300cbfa0 2024-09-15T21:55:31.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd36ffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcd300cbfa0 0x7fcd30037100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd37fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcd30037640 0x7fcd300d6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd37fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcd30037640 0x7fcd300d6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:42454/0 (socket says 172.21.15.1:42454) 2024-09-15T21:55:31.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd37fff640 1 -- 172.21.15.1:0/1107312653 learned_addr learned my addr 172.21.15.1:0/1107312653 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd37fff640 1 -- 172.21.15.1:0/1107312653 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcd300cbfa0 msgr2=0x7fcd30037100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd37fff640 1 --2- 172.21.15.1:0/1107312653 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcd300cbfa0 0x7fcd30037100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd37fff640 1 -- 172.21.15.1:0/1107312653 >> v1:172.21.15.1:6789/0 conn(0x7fcd3003aa60 legacy=0x7fcd30038460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd37fff640 1 -- 172.21.15.1:0/1107312653 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd300394a0 con 0x7fcd30037640 2024-09-15T21:55:31.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.445+0000 7fcd36ffd640 1 --2- 172.21.15.1:0/1107312653 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcd300cbfa0 0x7fcd30037100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:55:31.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f40c6d9d640 1 --2- 172.21.15.1:0/4270127243 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40c8067c60 0x7f40c80aeb70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f40b80097c0 tx=0x7f40b801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95da16a1eaa31e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28bffff640 1 Processor -- start 2024-09-15T21:55:31.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28bffff640 1 -- start start 2024-09-15T21:55:31.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721effd640 1 --2- 172.21.15.1:0/3807055205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721801e990 0x7f7218007790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7218009280 tx=0x7f721001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54402323ac86afc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721dffb640 1 -- 172.21.15.1:0/3807055205 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72100b0070 con 0x7f721801e990 2024-09-15T21:55:31.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28bffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f28b8009c20 0x7f28b80c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28bffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f28b80c9770 0x7f28b80cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28bffff640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28b80ccb40 con 0x7f28b80cc6f0 2024-09-15T21:55:31.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28bffff640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f28b80cfa10 con 0x7f28b8009c20 2024-09-15T21:55:31.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28bffff640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f28b80d02b0 con 0x7f28b80c9770 2024-09-15T21:55:31.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721dffb640 1 -- 172.21.15.1:0/3807055205 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72100ab600 con 0x7f721801e990 2024-09-15T21:55:31.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28beffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f28b8009c20 0x7f28b80c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721dffb640 1 -- 172.21.15.1:0/3807055205 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72100b0070 con 0x7f721801e990 2024-09-15T21:55:31.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28beffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f28b8009c20 0x7f28b80c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60442/0 (socket says 172.21.15.1:60442) 2024-09-15T21:55:31.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28be7fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f28b80c9770 0x7f28b80cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28beffd640 1 -- 172.21.15.1:0/3441871742 learned_addr learned my addr 172.21.15.1:0/3441871742 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721ffff640 1 -- 172.21.15.1:0/3807055205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721801e990 msgr2=0x7f7218007790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721ffff640 1 --2- 172.21.15.1:0/3807055205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721801e990 0x7f7218007790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7218009280 tx=0x7f721001c490 comp rx=0 tx=0).stop 2024-09-15T21:55:31.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28beffd640 1 -- 172.21.15.1:0/3441871742 >> v2:172.21.15.70:3300/0 conn(0x7f28b80c9770 msgr2=0x7f28b80cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28beffd640 1 --2- 172.21.15.1:0/3441871742 >> v2:172.21.15.70:3300/0 conn(0x7f28b80c9770 0x7f28b80cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28beffd640 1 -- 172.21.15.1:0/3441871742 >> v1:172.21.15.1:6789/0 conn(0x7f28b80cc6f0 legacy=0x7f28b801b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f28beffd640 1 -- 172.21.15.1:0/3441871742 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b800a000 con 0x7f28b8009c20 2024-09-15T21:55:31.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721ffff640 1 -- 172.21.15.1:0/3807055205 shutdown_connections 2024-09-15T21:55:31.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721ffff640 1 --2- 172.21.15.1:0/3807055205 >> v2:172.21.15.70:3300/0 conn(0x7f721800c030 0x7f72180dacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721ffff640 1 --2- 172.21.15.1:0/3807055205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721801e990 0x7f7218007790 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7218009280 tx=0x7f721001c490 comp rx=0 tx=0).stop 2024-09-15T21:55:31.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721ffff640 1 -- 172.21.15.1:0/3807055205 >> 172.21.15.1:0/3807055205 conn(0x7f721800b0b0 msgr2=0x7f721800b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721ffff640 1 -- 172.21.15.1:0/3807055205 shutdown_connections 2024-09-15T21:55:31.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721ffff640 1 -- 172.21.15.1:0/3807055205 wait complete. 2024-09-15T21:55:31.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7fcd37fff640 1 --2- 172.21.15.1:0/1107312653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd30037640 0x7fcd300d6840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd3802dd60 tx=0x7fcd380981c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a28d0bcea9d2c91e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721ffff640 1 Processor -- start 2024-09-15T21:55:31.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f721ffff640 1 -- start start 2024-09-15T21:55:31.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f40c5d9b640 1 -- 172.21.15.1:0/4270127243 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b80b1070 con 0x7f40c8067c60 2024-09-15T21:55:31.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f40c5d9b640 1 -- 172.21.15.1:0/4270127243 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b80a8050 con 0x7f40c8067c60 2024-09-15T21:55:31.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.449+0000 7f40c5d9b640 1 -- 172.21.15.1:0/4270127243 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b80ac860 con 0x7f40c8067c60 2024-09-15T21:55:31.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f7a1bfff640 1 -- 172.21.15.1:0/738752300 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a240c3030 con 0x7f7a340ae580 2024-09-15T21:55:31.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721800bbd0 0x7f72180ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f721800c030 0x7f72180356f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721ffff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7218035c30 0x7f721816c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721ffff640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f72180ddb90 con 0x7f721800bbd0 2024-09-15T21:55:31.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721ffff640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72180dda10 con 0x7f721800c030 2024-09-15T21:55:31.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721ffff640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f72180ddd10 con 0x7f7218035c30 2024-09-15T21:55:31.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721800bbd0 0x7f72180ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721800bbd0 0x7f72180ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60446/0 (socket says 172.21.15.1:60446) 2024-09-15T21:55:31.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721effd640 1 -- 172.21.15.1:0/3973408929 learned_addr learned my addr 172.21.15.1:0/3973408929 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721e7fc640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f721800c030 0x7f72180356f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721f7fe640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7218035c30 0x7f721816c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721effd640 1 -- 172.21.15.1:0/3973408929 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7218035c30 msgr2=0x7f721816c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721effd640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7218035c30 0x7f721816c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721effd640 1 -- 172.21.15.1:0/3973408929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f721800c030 msgr2=0x7f72180356f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721effd640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f721800c030 0x7f72180356f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721effd640 1 -- 172.21.15.1:0/3973408929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72180377a0 con 0x7f721800bbd0 2024-09-15T21:55:31.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721e7fc640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f721800c030 0x7f72180356f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:31.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721f7fe640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7218035c30 0x7f721816c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:31.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 -- 172.21.15.1:0/4270127243 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40c8067c60 msgr2=0x7f40c80aeb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 --2- 172.21.15.1:0/4270127243 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40c8067c60 0x7f40c80aeb70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f40b80097c0 tx=0x7f40b801c3e0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 -- 172.21.15.1:0/4270127243 shutdown_connections 2024-09-15T21:55:31.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 --2- 172.21.15.1:0/4270127243 >> v2:172.21.15.1:3300/0 conn(0x7f40c8146bd0 0x7f40c8147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 --2- 172.21.15.1:0/4270127243 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40c8067c60 0x7f40c80aeb70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 -- 172.21.15.1:0/4270127243 >> 172.21.15.1:0/4270127243 conn(0x7f40c80b6570 msgr2=0x7f40c80b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 -- 172.21.15.1:0/4270127243 shutdown_connections 2024-09-15T21:55:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 -- 172.21.15.1:0/4270127243 wait complete. 2024-09-15T21:55:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721effd640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721800bbd0 0x7f72180ca140 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f72100ae040 tx=0x7f721001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f72077fe640 1 -- 172.21.15.1:0/3973408929 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72100bb070 con 0x7f721800bbd0 2024-09-15T21:55:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f72077fe640 1 -- 172.21.15.1:0/3973408929 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72100ab9b0 con 0x7f721800bbd0 2024-09-15T21:55:31.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f72077fe640 1 -- 172.21.15.1:0/3973408929 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72100b0040 con 0x7f721800bbd0 2024-09-15T21:55:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f28beffd640 1 --2- 172.21.15.1:0/3441871742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28b8009c20 0x7f28b80c9230 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f28b801d2c0 tx=0x7f28b401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c742be62c0e1028 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 Processor -- start 2024-09-15T21:55:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 -- start start 2024-09-15T21:55:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c8067c60 0x7f40c81513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40c80afa30 0x7f40c81e7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40c8146bd0 0x7f40c81e7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f40c8147700 con 0x7f40c8146bd0 2024-09-15T21:55:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40c8147580 con 0x7f40c8067c60 2024-09-15T21:55:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40cd1e7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f40c8154970 con 0x7f40c80afa30 2024-09-15T21:55:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721ffff640 1 -- 172.21.15.1:0/3973408929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72180374c0 con 0x7f721800bbd0 2024-09-15T21:55:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721ffff640 1 -- 172.21.15.1:0/3973408929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f721816d230 con 0x7f721800bbd0 2024-09-15T21:55:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f721ffff640 1 -- 172.21.15.1:0/3973408929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7218007790 con 0x7f721800bbd0 2024-09-15T21:55:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f28bdffb640 1 -- 172.21.15.1:0/3441871742 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b40b0070 con 0x7f28b8009c20 2024-09-15T21:55:31.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f28bdffb640 1 -- 172.21.15.1:0/3441871742 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b40ab600 con 0x7f28b8009c20 2024-09-15T21:55:31.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f28bdffb640 1 -- 172.21.15.1:0/3441871742 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b40ab9d0 con 0x7f28b8009c20 2024-09-15T21:55:31.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40c659c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40c80afa30 0x7f40c81e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40c659c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40c80afa30 0x7f40c81e7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:34460/0 (socket says 172.21.15.1:34460) 2024-09-15T21:55:31.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40c659c640 1 -- 172.21.15.1:0/2038274232 learned_addr learned my addr 172.21.15.1:0/2038274232 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40c759e640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40c8146bd0 0x7f40c81e7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40c6d9d640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c8067c60 0x7f40c81513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f28bffff640 1 -- 172.21.15.1:0/3441871742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28b8009c20 msgr2=0x7f28b80c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f28bffff640 1 --2- 172.21.15.1:0/3441871742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28b8009c20 0x7f28b80c9230 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f28b801d2c0 tx=0x7f28b401c3c0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40c759e640 1 -- 172.21.15.1:0/2038274232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40c80afa30 msgr2=0x7f40c81e7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40c759e640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40c80afa30 0x7f40c81e7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40c759e640 1 -- 172.21.15.1:0/2038274232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c8067c60 msgr2=0x7f40c81513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40c759e640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c8067c60 0x7f40c81513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.453+0000 7f40c759e640 1 -- 172.21.15.1:0/2038274232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c809e290 con 0x7f40c8146bd0 2024-09-15T21:55:31.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7f40c659c640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40c80afa30 0x7f40c81e7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:55:31.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7f40c759e640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40c8146bd0 0x7f40c81e7e80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f40c000efc0 tx=0x7f40c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7fb8fdffb640 1 -- 172.21.15.1:0/3164762533 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb904055dd0 con 0x7fb9080b3eb0 2024-09-15T21:55:31.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7fcd367fc640 1 -- 172.21.15.1:0/1107312653 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd38128440 con 0x7fcd30037640 2024-09-15T21:55:31.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7fcd367fc640 1 -- 172.21.15.1:0/1107312653 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3806de50 con 0x7fcd30037640 2024-09-15T21:55:31.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7fcd367fc640 1 -- 172.21.15.1:0/1107312653 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd38128860 con 0x7fcd30037640 2024-09-15T21:55:31.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7f72077fe640 1 -- 172.21.15.1:0/3973408929 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f72100be070 con 0x7f721800bbd0 2024-09-15T21:55:31.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7f72077fe640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f720c067990 0x7f720c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7f72077fe640 1 -- 172.21.15.1:0/3973408929 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f721011fb00 con 0x7f721800bbd0 2024-09-15T21:55:31.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7f721e7fc640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f720c067990 0x7f720c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7f721e7fc640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f720c067990 0x7f720c069e50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f721801f290 tx=0x7f7214007df0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7fcd3c86d640 1 -- 172.21.15.1:0/1107312653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd30037640 msgr2=0x7fcd300d6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7fcd3c86d640 1 --2- 172.21.15.1:0/1107312653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd30037640 0x7fcd300d6840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd3802dd60 tx=0x7fcd380981c0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7fcd3c86d640 1 -- 172.21.15.1:0/1107312653 shutdown_connections 2024-09-15T21:55:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7fcd3c86d640 1 --2- 172.21.15.1:0/1107312653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd30037640 0x7fcd300d6840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7fcd3c86d640 1 --2- 172.21.15.1:0/1107312653 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcd300cbfa0 0x7fcd30037100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.457+0000 7fcd3c86d640 1 -- 172.21.15.1:0/1107312653 >> 172.21.15.1:0/1107312653 conn(0x7fcd3003e770 msgr2=0x7fcd3003eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd3c86d640 1 -- 172.21.15.1:0/1107312653 shutdown_connections 2024-09-15T21:55:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd3c86d640 1 -- 172.21.15.1:0/1107312653 wait complete. 2024-09-15T21:55:31.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7f28bffff640 1 -- 172.21.15.1:0/3441871742 shutdown_connections 2024-09-15T21:55:31.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7f28bffff640 1 --2- 172.21.15.1:0/3441871742 >> v2:172.21.15.70:3300/0 conn(0x7f28b80c9770 0x7f28b80cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7f28bffff640 1 --2- 172.21.15.1:0/3441871742 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28b8009c20 0x7f28b80c9230 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7f28bffff640 1 -- 172.21.15.1:0/3441871742 >> 172.21.15.1:0/3441871742 conn(0x7f28b8008ea0 msgr2=0x7f28b80092b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd3c86d640 1 Processor -- start 2024-09-15T21:55:31.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd3c86d640 1 -- start start 2024-09-15T21:55:31.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd3c86d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd30037640 0x7fcd301686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd3c86d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcd3003aa60 0x7fcd300c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd3c86d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd300cbfa0 0x7fcd3016bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd3c86d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3003bac0 con 0x7fcd300cbfa0 2024-09-15T21:55:31.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd3c86d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3003b940 con 0x7fcd30037640 2024-09-15T21:55:31.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd3c86d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3003a0a0 con 0x7fcd3003aa60 2024-09-15T21:55:31.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd37fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd300cbfa0 0x7fcd3016bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd37fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd300cbfa0 0x7fcd3016bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60454/0 (socket says 172.21.15.1:60454) 2024-09-15T21:55:31.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd37fff640 1 -- 172.21.15.1:0/3546493604 learned_addr learned my addr 172.21.15.1:0/3546493604 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7f28bffff640 1 -- 172.21.15.1:0/3441871742 shutdown_connections 2024-09-15T21:55:31.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7f28bffff640 1 -- 172.21.15.1:0/3441871742 wait complete. 2024-09-15T21:55:31.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd377fe640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd30037640 0x7fcd301686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd36ffd640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcd3003aa60 0x7fcd300c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd377fe640 1 -- 172.21.15.1:0/3546493604 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcd3003aa60 msgr2=0x7fcd300c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd377fe640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcd3003aa60 0x7fcd300c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd377fe640 1 -- 172.21.15.1:0/3546493604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd300cbfa0 msgr2=0x7fcd3016bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd377fe640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd300cbfa0 0x7fcd3016bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd377fe640 1 -- 172.21.15.1:0/3546493604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd300c3700 con 0x7fcd30037640 2024-09-15T21:55:31.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd36ffd640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcd3003aa60 0x7fcd300c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:55:31.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7f28bffff640 1 Processor -- start 2024-09-15T21:55:31.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7f28bffff640 1 -- start start 2024-09-15T21:55:31.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd377fe640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd30037640 0x7fcd301686d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00c360 tx=0x7fcd2c00c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd23fff640 1 -- 172.21.15.1:0/3546493604 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c017070 con 0x7fcd30037640 2024-09-15T21:55:31.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd23fff640 1 -- 172.21.15.1:0/3546493604 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2c003600 con 0x7fcd30037640 2024-09-15T21:55:31.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd23fff640 1 -- 172.21.15.1:0/3546493604 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0039f0 con 0x7fcd30037640 2024-09-15T21:55:31.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd3c86d640 1 -- 172.21.15.1:0/3546493604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd300c84e0 con 0x7fcd30037640 2024-09-15T21:55:31.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.461+0000 7fcd3c86d640 1 -- 172.21.15.1:0/3546493604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd300c80e0 con 0x7fcd30037640 2024-09-15T21:55:31.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bffff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28b8009c20 0x7f28b8168260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b80c9770 0x7f28b80370b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28b80cc6f0 0x7f28b8035a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bffff640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f28b801ab10 con 0x7f28b80cc6f0 2024-09-15T21:55:31.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bffff640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f28b801cc70 con 0x7f28b80c9770 2024-09-15T21:55:31.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bffff640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f28b801ac90 con 0x7f28b8009c20 2024-09-15T21:55:31.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28b80cc6f0 0x7f28b8035a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28b80cc6f0 0x7f28b8035a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60466/0 (socket says 172.21.15.1:60466) 2024-09-15T21:55:31.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bf7fe640 1 -- 172.21.15.1:0/2697737107 learned_addr learned my addr 172.21.15.1:0/2697737107 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28be7fc640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b80c9770 0x7f28b80370b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28beffd640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28b8009c20 0x7f28b8168260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7fcd3c86d640 1 -- 172.21.15.1:0/3546493604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd30037100 con 0x7fcd30037640 2024-09-15T21:55:31.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bf7fe640 1 -- 172.21.15.1:0/2697737107 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28b8009c20 msgr2=0x7f28b8168260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bf7fe640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28b8009c20 0x7f28b8168260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bf7fe640 1 -- 172.21.15.1:0/2697737107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b80c9770 msgr2=0x7f28b80370b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bf7fe640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b80c9770 0x7f28b80370b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bf7fe640 1 -- 172.21.15.1:0/2697737107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b80375f0 con 0x7f28b80cc6f0 2024-09-15T21:55:31.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bf7fe640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28b80cc6f0 0x7f28b8035a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f28c006a010 tx=0x7f28c0075370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7fcd23fff640 1 -- 172.21.15.1:0/3546493604 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcd2c003b90 con 0x7fcd30037640 2024-09-15T21:55:31.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f72077fe640 1 -- 172.21.15.1:0/3973408929 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f72100c5020 con 0x7f721800bbd0 2024-09-15T21:55:31.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7fcd23fff640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fcd1c0678f0 0x7fcd1c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7fcd23fff640 1 -- 172.21.15.1:0/3546493604 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcd2c085010 con 0x7fcd30037640 2024-09-15T21:55:31.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7fcd36ffd640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fcd1c0678f0 0x7fcd1c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7fcd36ffd640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fcd1c0678f0 0x7fcd1c069db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcd300c2fb0 tx=0x7fcd24009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28a77fe640 1 -- 172.21.15.1:0/2697737107 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c00741c0 con 0x7f28b80cc6f0 2024-09-15T21:55:31.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bffff640 1 -- 172.21.15.1:0/2697737107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b80c3110 con 0x7f28b80cc6f0 2024-09-15T21:55:31.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.465+0000 7f28bffff640 1 -- 172.21.15.1:0/2697737107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b8168900 con 0x7f28b80cc6f0 2024-09-15T21:55:31.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f40af7fe640 1 -- 172.21.15.1:0/2038274232 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0018020 con 0x7f40c8146bd0 2024-09-15T21:55:31.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f40af7fe640 1 -- 172.21.15.1:0/2038274232 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c0014480 con 0x7f40c8146bd0 2024-09-15T21:55:31.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f40cd1e7640 1 -- 172.21.15.1:0/2038274232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c809cca0 con 0x7f40c8146bd0 2024-09-15T21:55:31.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f40cd1e7640 1 -- 172.21.15.1:0/2038274232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c809ab20 con 0x7f40c8146bd0 2024-09-15T21:55:31.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f28a77fe640 1 -- 172.21.15.1:0/2697737107 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c006de50 con 0x7f28b80cc6f0 2024-09-15T21:55:31.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f28bffff640 1 -- 172.21.15.1:0/2697737107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b80c9230 con 0x7f28b80cc6f0 2024-09-15T21:55:31.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f28a77fe640 1 -- 172.21.15.1:0/2697737107 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0063220 con 0x7f28b80cc6f0 2024-09-15T21:55:31.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f40af7fe640 1 -- 172.21.15.1:0/2038274232 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0009b10 con 0x7f40c8146bd0 2024-09-15T21:55:31.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f40af7fe640 1 -- 172.21.15.1:0/2038274232 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f40c001b020 con 0x7f40c8146bd0 2024-09-15T21:55:31.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f40af7fe640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f40b4067990 0x7f40b4069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f40af7fe640 1 -- 172.21.15.1:0/2038274232 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f40c0086790 con 0x7f40c8146bd0 2024-09-15T21:55:31.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f40c6d9d640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f40b4067990 0x7f40b4069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f40cd1e7640 1 -- 172.21.15.1:0/2038274232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a80052a0 con 0x7f40c8146bd0 2024-09-15T21:55:31.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.469+0000 7f40c6d9d640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f40b4067990 0x7f40b4069e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f40b80ae000 tx=0x7f40b80a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.473+0000 7f28a77fe640 1 -- 172.21.15.1:0/2697737107 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f28c00633c0 con 0x7f28b80cc6f0 2024-09-15T21:55:31.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.473+0000 7f28a77fe640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f28ac0678f0 0x7f28ac069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.473+0000 7f28a77fe640 1 -- 172.21.15.1:0/2697737107 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f28c0101400 con 0x7f28b80cc6f0 2024-09-15T21:55:31.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.473+0000 7f28beffd640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f28ac0678f0 0x7f28ac069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.473+0000 7f28beffd640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f28ac0678f0 0x7f28ac069db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f28b40ad000 tx=0x7f28b40a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.477+0000 7f28a77fe640 1 -- 172.21.15.1:0/2697737107 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f28c00a1080 con 0x7f28b80cc6f0 2024-09-15T21:55:31.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.477+0000 7fcd23fff640 1 -- 172.21.15.1:0/3546493604 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcd2c0554f0 con 0x7fcd30037640 2024-09-15T21:55:31.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5ffff640 1 Processor -- start 2024-09-15T21:55:31.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5ffff640 1 -- start start 2024-09-15T21:55:31.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5ffff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa580ed960 0x7faa580e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6ffff640 1 Processor -- start 2024-09-15T21:55:31.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7f40af7fe640 1 -- 172.21.15.1:0/2038274232 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f40c0022030 con 0x7f40c8146bd0 2024-09-15T21:55:31.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6ffff640 1 -- start start 2024-09-15T21:55:31.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6ffff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fac7006c630 0x7fac700b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6ffff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fac70158520 0x7fac7015f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6ffff640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac7006ca10 con 0x7fac700ae740 2024-09-15T21:55:31.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6ffff640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fac7009e6e0 con 0x7fac7006c630 2024-09-15T21:55:31.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6ffff640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fac7009b460 con 0x7fac70158520 2024-09-15T21:55:31.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6f7fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fac70158520 0x7fac7015f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6effd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fac7006c630 0x7fac700b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6e7fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fac700ae740 0x7fac70157e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.1:59028/0 (socket says 172.21.15.1:59028) 2024-09-15T21:55:31.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6e7fc640 1 -- 172.21.15.1:0/4260489608 learned_addr learned my addr 172.21.15.1:0/4260489608 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:31.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5ffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7faa580ea220 0x7faa580f4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5ffff640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa5800a000 con 0x7faa58009c20 2024-09-15T21:55:31.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5effd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7faa58009c20 0x7faa580ed250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49762/0 (socket says 172.21.15.1:49762) 2024-09-15T21:55:31.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5effd640 1 -- 172.21.15.1:0/3095177546 learned_addr learned my addr 172.21.15.1:0/3095177546 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:31.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5ffff640 1 -- 172.21.15.1:0/3095177546 --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7faa58030d90 con 0x7faa580ea220 2024-09-15T21:55:31.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5ffff640 1 -- 172.21.15.1:0/3095177546 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7faa5801d3f0 con 0x7faa580ed960 2024-09-15T21:55:31.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5f7fe640 1 --2- 172.21.15.1:0/3095177546 >> v2:172.21.15.1:3300/0 conn(0x7faa580ea220 0x7faa580f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5f7fe640 1 -- 172.21.15.1:0/3095177546 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa580ed960 msgr2=0x7faa580e9ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T21:55:31.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5f7fe640 1 --2- 172.21.15.1:0/3095177546 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa580ed960 0x7faa580e9ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5f7fe640 1 -- 172.21.15.1:0/3095177546 >> v1:172.21.15.1:6789/0 conn(0x7faa58009c20 legacy=0x7faa580ed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.485+0000 7faa5f7fe640 1 -- 172.21.15.1:0/3095177546 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5801b5e0 con 0x7faa580ea220 2024-09-15T21:55:31.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7faa5f7fe640 1 --2- 172.21.15.1:0/3095177546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa580ea220 0x7faa580f4790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faa50013050 tx=0x7faa50024a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22eecb4a4b10d91 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7faa5dffb640 1 -- 172.21.15.1:0/3095177546 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa500adb50 con 0x7faa580ea220 2024-09-15T21:55:31.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7faa5dffb640 1 -- 172.21.15.1:0/3095177546 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa500adcf0 con 0x7faa580ea220 2024-09-15T21:55:31.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7faa5dffb640 1 -- 172.21.15.1:0/3095177546 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa500112f0 con 0x7faa580ea220 2024-09-15T21:55:31.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6dffb640 1 -- 172.21.15.1:0/4260489608 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1011903889 0 0) 0x7fac7006ca10 con 0x7fac700ae740 2024-09-15T21:55:31.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6effd640 1 -- 172.21.15.1:0/4260489608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fac70158520 msgr2=0x7fac7015f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:31.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6effd640 1 --2- 172.21.15.1:0/4260489608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fac70158520 0x7fac7015f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6effd640 1 -- 172.21.15.1:0/4260489608 >> v1:172.21.15.70:6789/0 conn(0x7fac700ae740 legacy=0x7fac70157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.489+0000 7fac6effd640 1 -- 172.21.15.1:0/4260489608 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac700ae2b0 con 0x7fac7006c630 2024-09-15T21:55:31.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.493+0000 7faa5ffff640 1 -- 172.21.15.1:0/3095177546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa580ea220 msgr2=0x7faa580f4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.493+0000 7faa5ffff640 1 --2- 172.21.15.1:0/3095177546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa580ea220 0x7faa580f4790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faa50013050 tx=0x7faa50024a80 comp rx=0 tx=0).stop 2024-09-15T21:55:31.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.493+0000 7faa5ffff640 1 -- 172.21.15.1:0/3095177546 shutdown_connections 2024-09-15T21:55:31.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.493+0000 7faa5ffff640 1 --2- 172.21.15.1:0/3095177546 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa580ed960 0x7faa580e9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.493+0000 7faa5ffff640 1 --2- 172.21.15.1:0/3095177546 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa580ea220 0x7faa580f4790 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.493+0000 7faa5ffff640 1 -- 172.21.15.1:0/3095177546 >> 172.21.15.1:0/3095177546 conn(0x7faa58008ea0 msgr2=0x7faa580092b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.493+0000 7faa5ffff640 1 -- 172.21.15.1:0/3095177546 shutdown_connections 2024-09-15T21:55:31.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.493+0000 7faa5ffff640 1 -- 172.21.15.1:0/3095177546 wait complete. 2024-09-15T21:55:31.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.493+0000 7fac6effd640 1 --2- 172.21.15.1:0/4260489608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7006c630 0x7fac700b46f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac68008d70 tx=0x7fac68020c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fbc159e6b70cab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.493+0000 7fac6dffb640 1 -- 172.21.15.1:0/4260489608 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac680b6070 con 0x7fac7006c630 2024-09-15T21:55:31.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.493+0000 7fac6dffb640 1 -- 172.21.15.1:0/4260489608 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac680a9d10 con 0x7fac7006c630 2024-09-15T21:55:31.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.493+0000 7fac6dffb640 1 -- 172.21.15.1:0/4260489608 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac680b1680 con 0x7fac7006c630 2024-09-15T21:55:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5ffff640 1 Processor -- start 2024-09-15T21:55:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5ffff640 1 -- start start 2024-09-15T21:55:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa58009c20 0x7faa580e9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa580ea220 0x7faa581857d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5ffff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa580ed960 0x7faa58035d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5ffff640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faa5801ac90 con 0x7faa58009c20 2024-09-15T21:55:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5ffff640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faa5801ab10 con 0x7faa580ea220 2024-09-15T21:55:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5ffff640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7faa5801cbc0 con 0x7faa580ed960 2024-09-15T21:55:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa58009c20 0x7faa580e9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa58009c20 0x7faa580e9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60488/0 (socket says 172.21.15.1:60488) 2024-09-15T21:55:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5effd640 1 -- 172.21.15.1:0/1303361562 learned_addr learned my addr 172.21.15.1:0/1303361562 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5f7fe640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa580ed960 0x7faa58035d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5e7fc640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa580ea220 0x7faa581857d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5effd640 1 -- 172.21.15.1:0/1303361562 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa580ed960 msgr2=0x7faa58035d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5effd640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa580ed960 0x7faa58035d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5effd640 1 -- 172.21.15.1:0/1303361562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa580ea220 msgr2=0x7faa581857d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5effd640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa580ea220 0x7faa581857d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5effd640 1 -- 172.21.15.1:0/1303361562 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa580e9e80 con 0x7faa58009c20 2024-09-15T21:55:31.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5e7fc640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa580ea220 0x7faa581857d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:31.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7fac6ffff640 1 -- 172.21.15.1:0/4260489608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7006c630 msgr2=0x7fac700b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5effd640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa58009c20 0x7faa580e9940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faa60000b70 tx=0x7faa60075370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7fac6ffff640 1 --2- 172.21.15.1:0/4260489608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7006c630 0x7fac700b46f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac68008d70 tx=0x7fac68020c60 comp rx=0 tx=0).stop 2024-09-15T21:55:31.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa47fff640 1 -- 172.21.15.1:0/1303361562 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60069870 con 0x7faa58009c20 2024-09-15T21:55:31.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5ffff640 1 -- 172.21.15.1:0/1303361562 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa580ee920 con 0x7faa58009c20 2024-09-15T21:55:31.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.497+0000 7faa5ffff640 1 -- 172.21.15.1:0/1303361562 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa58035810 con 0x7faa58009c20 2024-09-15T21:55:31.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.501+0000 7faa5ffff640 1 -- 172.21.15.1:0/1303361562 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa581865b0 con 0x7faa58009c20 2024-09-15T21:55:31.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.501+0000 7faa47fff640 1 -- 172.21.15.1:0/1303361562 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6007f020 con 0x7faa58009c20 2024-09-15T21:55:31.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.501+0000 7fac6ffff640 1 -- 172.21.15.1:0/4260489608 shutdown_connections 2024-09-15T21:55:31.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.501+0000 7fac6ffff640 1 --2- 172.21.15.1:0/4260489608 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fac70158520 0x7fac7015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.501+0000 7fac6ffff640 1 --2- 172.21.15.1:0/4260489608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac7006c630 0x7fac700b46f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.501+0000 7fac6ffff640 1 -- 172.21.15.1:0/4260489608 >> 172.21.15.1:0/4260489608 conn(0x7fac700b96d0 msgr2=0x7fac7006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.501+0000 7fac6ffff640 1 -- 172.21.15.1:0/4260489608 shutdown_connections 2024-09-15T21:55:31.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.501+0000 7fac6ffff640 1 -- 172.21.15.1:0/4260489608 wait complete. 2024-09-15T21:55:31.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.501+0000 7faa47fff640 1 -- 172.21.15.1:0/1303361562 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6006d110 con 0x7faa58009c20 2024-09-15T21:55:31.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.501+0000 7faa47fff640 1 -- 172.21.15.1:0/1303361562 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa6006d2f0 con 0x7faa58009c20 2024-09-15T21:55:31.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.501+0000 7fac6ffff640 1 Processor -- start 2024-09-15T21:55:31.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.501+0000 7fac6ffff640 1 -- start start 2024-09-15T21:55:31.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7faa47fff640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7faa4c0679c0 0x7faa4c069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7faa47fff640 1 -- 172.21.15.1:0/1303361562 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faa600f0860 con 0x7faa58009c20 2024-09-15T21:55:31.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7faa5e7fc640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7faa4c0679c0 0x7faa4c069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7faa5e7fc640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7faa4c0679c0 0x7faa4c069e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faa580e6510 tx=0x7faa54008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6ffff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fac7006c630 0x7fac701572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac700ae740 0x7fac701f00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac700ae740 0x7fac701f00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac700ae740 0x7fac701f00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60500/0 (socket says 172.21.15.1:60500) 2024-09-15T21:55:31.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6e7fc640 1 -- 172.21.15.1:0/1395375324 learned_addr learned my addr 172.21.15.1:0/1395375324 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:31.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6ffff640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac70158520 0x7fac701f0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6ffff640 1 -- 172.21.15.1:0/1395375324 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fac700b3ad0 con 0x7fac700ae740 2024-09-15T21:55:31.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6ffff640 1 -- 172.21.15.1:0/1395375324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fac700b4c30 con 0x7fac70158520 2024-09-15T21:55:31.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6ffff640 1 -- 172.21.15.1:0/1395375324 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fac700b56c0 con 0x7fac7006c630 2024-09-15T21:55:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6effd640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fac7006c630 0x7fac701572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6f7fe640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac70158520 0x7fac701f0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6e7fc640 1 -- 172.21.15.1:0/1395375324 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fac7006c630 msgr2=0x7fac701572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6e7fc640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fac7006c630 0x7fac701572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6e7fc640 1 -- 172.21.15.1:0/1395375324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac70158520 msgr2=0x7fac701f0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6e7fc640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac70158520 0x7fac701f0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6e7fc640 1 -- 172.21.15.1:0/1395375324 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac701594b0 con 0x7fac700ae740 2024-09-15T21:55:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6f7fe640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac70158520 0x7fac701f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.505+0000 7fac6e7fc640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac700ae740 0x7fac701f00f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac6000c410 tx=0x7fac6000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.509+0000 7fac57fff640 1 -- 172.21.15.1:0/1395375324 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac600074e0 con 0x7fac700ae740 2024-09-15T21:55:31.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.509+0000 7faa47fff640 1 -- 172.21.15.1:0/1303361562 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faa581865b0 con 0x7faa58009c20 2024-09-15T21:55:31.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.509+0000 7fac57fff640 1 -- 172.21.15.1:0/1395375324 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac600047f0 con 0x7fac700ae740 2024-09-15T21:55:31.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.509+0000 7fac57fff640 1 -- 172.21.15.1:0/1395375324 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60007680 con 0x7fac700ae740 2024-09-15T21:55:31.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.509+0000 7fac6ffff640 1 -- 172.21.15.1:0/1395375324 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac700b1a70 con 0x7fac700ae740 2024-09-15T21:55:31.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.509+0000 7fac6ffff640 1 -- 172.21.15.1:0/1395375324 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac70159ce0 con 0x7fac700ae740 2024-09-15T21:55:31.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.513+0000 7fac6ffff640 1 -- 172.21.15.1:0/1395375324 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac500052a0 con 0x7fac700ae740 2024-09-15T21:55:31.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.513+0000 7fac57fff640 1 -- 172.21.15.1:0/1395375324 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fac60011070 con 0x7fac700ae740 2024-09-15T21:55:31.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.513+0000 7fac57fff640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fac5c067990 0x7fac5c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:31.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.513+0000 7fac57fff640 1 -- 172.21.15.1:0/1395375324 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fac60085690 con 0x7fac700ae740 2024-09-15T21:55:31.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.513+0000 7fac6effd640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fac5c067990 0x7fac5c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:31.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.513+0000 7fac6effd640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fac5c067990 0x7fac5c069e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fac680b3000 tx=0x7fac680ab070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:31.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.525+0000 7fac57fff640 1 -- 172.21.15.1:0/1395375324 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fac700b1a70 con 0x7fac700ae740 2024-09-15T21:55:31.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.777+0000 7f7a39fbe640 1 -- 172.21.15.1:0/738752300 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7a340b7b50 con 0x7f7a340ae580 2024-09-15T21:55:31.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.781+0000 7f7a1bfff640 1 -- 172.21.15.1:0/738752300 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7a2401e750 con 0x7f7a340ae580 2024-09-15T21:55:31.786 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2024-09-15T21:55:31.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7fb90f4cf640 1 -- 172.21.15.1:0/3164762533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb8e8005590 con 0x7fb9080b3eb0 2024-09-15T21:55:31.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7f7a19ffb640 1 -- 172.21.15.1:0/738752300 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7a1c067a20 msgr2=0x7f7a1c069ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7f7a19ffb640 1 --2- 172.21.15.1:0/738752300 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7a1c067a20 0x7f7a1c069ee0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a28000c10 tx=0x7f7a28009ba0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7f7a19ffb640 1 -- 172.21.15.1:0/738752300 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a340ae580 msgr2=0x7f7a341ed230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7f7a19ffb640 1 --2- 172.21.15.1:0/738752300 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a340ae580 0x7f7a341ed230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a340b6760 tx=0x7f7a240217e0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7f7a19ffb640 1 -- 172.21.15.1:0/738752300 shutdown_connections 2024-09-15T21:55:31.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7f7a19ffb640 1 --2- 172.21.15.1:0/738752300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a340b6190 0x7f7a340712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7f7a19ffb640 1 --2- 172.21.15.1:0/738752300 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7a1c067a20 0x7f7a1c069ee0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7f7a19ffb640 1 --2- 172.21.15.1:0/738752300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a340ae9b0 0x7f7a341ed770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7f7a19ffb640 1 --2- 172.21.15.1:0/738752300 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a340ae580 0x7f7a341ed230 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7f7a19ffb640 1 -- 172.21.15.1:0/738752300 >> 172.21.15.1:0/738752300 conn(0x7f7a3406c0c0 msgr2=0x7f7a340b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7f7a19ffb640 1 -- 172.21.15.1:0/738752300 shutdown_connections 2024-09-15T21:55:31.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7f7a19ffb640 1 -- 172.21.15.1:0/738752300 wait complete. 2024-09-15T21:55:31.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.785+0000 7fb8fdffb640 1 -- 172.21.15.1:0/3164762533 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb9040556d0 con 0x7fb9080b3eb0 2024-09-15T21:55:31.790 INFO:teuthology.orchestra.run.smithi001.stdout:64424509447 2024-09-15T21:55:31.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.789+0000 7fb90f4cf640 1 -- 172.21.15.1:0/3164762533 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb8ec0678c0 msgr2=0x7fb8ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.789+0000 7fb90f4cf640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb8ec0678c0 0x7fb8ec069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80ad000 tx=0x7fb8f80a6000 comp rx=0 tx=0).stop 2024-09-15T21:55:31.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.789+0000 7f721ffff640 1 -- 172.21.15.1:0/3973408929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f721801ef60 con 0x7f721800bbd0 2024-09-15T21:55:31.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.789+0000 7fb90f4cf640 1 -- 172.21.15.1:0/3164762533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9080b3eb0 msgr2=0x7fb9080b2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.789+0000 7fb90f4cf640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9080b3eb0 0x7fb9080b2830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb90400c410 tx=0x7fb90400c8d0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.789+0000 7f72077fe640 1 -- 172.21.15.1:0/3973408929 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f72180377a0 con 0x7f721800bbd0 2024-09-15T21:55:31.795 INFO:teuthology.orchestra.run.smithi001.stdout:64424509447 2024-09-15T21:55:31.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.789+0000 7f72057fa640 1 -- 172.21.15.1:0/3973408929 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f720c067990 msgr2=0x7f720c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7f72057fa640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f720c067990 0x7f720c069e50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f721801f290 tx=0x7f7214007df0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7fb90f4cf640 1 -- 172.21.15.1:0/3164762533 shutdown_connections 2024-09-15T21:55:31.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7fb90f4cf640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9080b5130 0x7fb90814fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7fb90f4cf640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb8ec0678c0 0x7fb8ec069d80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7fb90f4cf640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9080b3eb0 0x7fb9080b2830 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb90400c410 tx=0x7fb90400c8d0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7fb90f4cf640 1 --2- 172.21.15.1:0/3164762533 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb90806d170 0x7fb9081e7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7fb90f4cf640 1 -- 172.21.15.1:0/3164762533 >> 172.21.15.1:0/3164762533 conn(0x7fb90806c0c0 msgr2=0x7fb908070170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7f72057fa640 1 -- 172.21.15.1:0/3973408929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721800bbd0 msgr2=0x7f72180ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7f72057fa640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721800bbd0 0x7f72180ca140 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f72100ae040 tx=0x7f721001acd0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7f72057fa640 1 -- 172.21.15.1:0/3973408929 shutdown_connections 2024-09-15T21:55:31.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7f72057fa640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7218035c30 0x7f721816c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7f72057fa640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f720c067990 0x7f720c069e50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7f72057fa640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f721800c030 0x7f72180356f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7f72057fa640 1 --2- 172.21.15.1:0/3973408929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f721800bbd0 0x7f72180ca140 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7f72057fa640 1 -- 172.21.15.1:0/3973408929 >> 172.21.15.1:0/3973408929 conn(0x7f721800b0b0 msgr2=0x7f72180cf470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7f72057fa640 1 -- 172.21.15.1:0/3973408929 shutdown_connections 2024-09-15T21:55:31.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7fb90f4cf640 1 -- 172.21.15.1:0/3164762533 shutdown_connections 2024-09-15T21:55:31.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7f72057fa640 1 -- 172.21.15.1:0/3973408929 wait complete. 2024-09-15T21:55:31.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.793+0000 7fb90f4cf640 1 -- 172.21.15.1:0/3164762533 wait complete. 2024-09-15T21:55:31.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.805+0000 7f28bffff640 1 -- 172.21.15.1:0/2697737107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f28b801b8a0 con 0x7f28b80cc6f0 2024-09-15T21:55:31.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.805+0000 7f28a77fe640 1 -- 172.21.15.1:0/2697737107 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f28c008f030 con 0x7f28b80cc6f0 2024-09-15T21:55:31.811 INFO:teuthology.orchestra.run.smithi001.stdout:64424509446 2024-09-15T21:55:31.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.809+0000 7f28a57fa640 1 -- 172.21.15.1:0/2697737107 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f28ac0678f0 msgr2=0x7f28ac069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.809+0000 7f28a57fa640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f28ac0678f0 0x7f28ac069db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f28b40ad000 tx=0x7f28b40a6000 comp rx=0 tx=0).stop 2024-09-15T21:55:31.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.809+0000 7f28a57fa640 1 -- 172.21.15.1:0/2697737107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28b80cc6f0 msgr2=0x7f28b8035a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.809+0000 7f28a57fa640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28b80cc6f0 0x7f28b8035a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f28c006a010 tx=0x7f28c0075370 comp rx=0 tx=0).stop 2024-09-15T21:55:31.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.813+0000 7f28a57fa640 1 -- 172.21.15.1:0/2697737107 shutdown_connections 2024-09-15T21:55:31.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.813+0000 7f28a57fa640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f28b80cc6f0 0x7f28b8035a70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.813+0000 7f28a57fa640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f28ac0678f0 0x7f28ac069db0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.813+0000 7f28a57fa640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b80c9770 0x7f28b80370b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.813+0000 7f28a57fa640 1 --2- 172.21.15.1:0/2697737107 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f28b8009c20 0x7f28b8168260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.813+0000 7f28a57fa640 1 -- 172.21.15.1:0/2697737107 >> 172.21.15.1:0/2697737107 conn(0x7f28b8008ea0 msgr2=0x7f28b80c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.813+0000 7f28a57fa640 1 -- 172.21.15.1:0/2697737107 shutdown_connections 2024-09-15T21:55:31.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.813+0000 7f28a57fa640 1 -- 172.21.15.1:0/2697737107 wait complete. 2024-09-15T21:55:31.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-09-15T21:55:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.817+0000 7fcd3c86d640 1 -- 172.21.15.1:0/3546493604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcd300ca150 con 0x7fcd30037640 2024-09-15T21:55:31.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.821+0000 7fcd23fff640 1 -- 172.21.15.1:0/3546493604 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcd2c0597f0 con 0x7fcd30037640 2024-09-15T21:55:31.824 INFO:teuthology.orchestra.run.smithi001.stdout:64424509446 2024-09-15T21:55:31.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.5 2024-09-15T21:55:31.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.821+0000 7fcd3c86d640 1 -- 172.21.15.1:0/3546493604 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fcd1c0678f0 msgr2=0x7fcd1c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.821+0000 7fcd3c86d640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fcd1c0678f0 0x7fcd1c069db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcd300c2fb0 tx=0x7fcd24009190 comp rx=0 tx=0).stop 2024-09-15T21:55:31.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.821+0000 7fcd3c86d640 1 -- 172.21.15.1:0/3546493604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd30037640 msgr2=0x7fcd301686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.821+0000 7fcd3c86d640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd30037640 0x7fcd301686d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00c360 tx=0x7fcd2c00c820 comp rx=0 tx=0).stop 2024-09-15T21:55:31.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.821+0000 7fcd3c86d640 1 -- 172.21.15.1:0/3546493604 shutdown_connections 2024-09-15T21:55:31.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.821+0000 7fcd3c86d640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcd300cbfa0 0x7fcd3016bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.821+0000 7fcd3c86d640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcd3003aa60 0x7fcd300c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.821+0000 7fcd3c86d640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fcd1c0678f0 0x7fcd1c069db0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.821+0000 7fcd3c86d640 1 --2- 172.21.15.1:0/3546493604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd30037640 0x7fcd301686d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.821+0000 7fcd3c86d640 1 -- 172.21.15.1:0/3546493604 >> 172.21.15.1:0/3546493604 conn(0x7fcd3003e770 msgr2=0x7fcd300cb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.821+0000 7fcd3c86d640 1 -- 172.21.15.1:0/3546493604 shutdown_connections 2024-09-15T21:55:31.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.821+0000 7fcd3c86d640 1 -- 172.21.15.1:0/3546493604 wait complete. 2024-09-15T21:55:31.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-09-15T21:55:31.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.829+0000 7faa5ffff640 1 -- 172.21.15.1:0/1303361562 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7faa58037310 con 0x7faa58009c20 2024-09-15T21:55:31.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.829+0000 7faa47fff640 1 -- 172.21.15.1:0/1303361562 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa60089030 con 0x7faa58009c20 2024-09-15T21:55:31.832 INFO:teuthology.orchestra.run.smithi001.stdout:64424509445 2024-09-15T21:55:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.829+0000 7f40cd1e7640 1 -- 172.21.15.1:0/2038274232 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f40a8005590 con 0x7f40c8146bd0 2024-09-15T21:55:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.829+0000 7f40af7fe640 1 -- 172.21.15.1:0/2038274232 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f40c0010040 con 0x7f40c8146bd0 2024-09-15T21:55:31.835 INFO:teuthology.orchestra.run.smithi001.stdout:64424509446 2024-09-15T21:55:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7faa5ffff640 1 -- 172.21.15.1:0/1303361562 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7faa4c0679c0 msgr2=0x7faa4c069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7faa5ffff640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7faa4c0679c0 0x7faa4c069e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faa580e6510 tx=0x7faa54008040 comp rx=0 tx=0).stop 2024-09-15T21:55:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7faa5ffff640 1 -- 172.21.15.1:0/1303361562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa58009c20 msgr2=0x7faa580e9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7faa5ffff640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa58009c20 0x7faa580e9940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faa60000b70 tx=0x7faa60075370 comp rx=0 tx=0).stop 2024-09-15T21:55:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7faa5ffff640 1 -- 172.21.15.1:0/1303361562 shutdown_connections 2024-09-15T21:55:31.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7faa5ffff640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa580ed960 0x7faa58035d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7faa5ffff640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7faa4c0679c0 0x7faa4c069e80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7faa5ffff640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa580ea220 0x7faa581857d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7faa5ffff640 1 --2- 172.21.15.1:0/1303361562 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa58009c20 0x7faa580e9940 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7faa5ffff640 1 -- 172.21.15.1:0/1303361562 >> 172.21.15.1:0/1303361562 conn(0x7faa58008ea0 msgr2=0x7faa5801e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7faa5ffff640 1 -- 172.21.15.1:0/1303361562 shutdown_connections 2024-09-15T21:55:31.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7faa5ffff640 1 -- 172.21.15.1:0/1303361562 wait complete. 2024-09-15T21:55:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7f40cd1e7640 1 -- 172.21.15.1:0/2038274232 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f40b4067990 msgr2=0x7f40b4069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7f40cd1e7640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f40b4067990 0x7f40b4069e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f40b80ae000 tx=0x7f40b80a7000 comp rx=0 tx=0).stop 2024-09-15T21:55:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7f40cd1e7640 1 -- 172.21.15.1:0/2038274232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40c8146bd0 msgr2=0x7f40c81e7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7f40cd1e7640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40c8146bd0 0x7f40c81e7e80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f40c000efc0 tx=0x7f40c000c490 comp rx=0 tx=0).stop 2024-09-15T21:55:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7f40cd1e7640 1 -- 172.21.15.1:0/2038274232 shutdown_connections 2024-09-15T21:55:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7f40cd1e7640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40c8146bd0 0x7f40c81e7e80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7f40cd1e7640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40c80afa30 0x7f40c81e7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7f40cd1e7640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f40b4067990 0x7f40b4069e50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7f40cd1e7640 1 --2- 172.21.15.1:0/2038274232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c8067c60 0x7f40c81513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7f40cd1e7640 1 -- 172.21.15.1:0/2038274232 >> 172.21.15.1:0/2038274232 conn(0x7f40c80b6570 msgr2=0x7f40c80b81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7f40cd1e7640 1 -- 172.21.15.1:0/2038274232 shutdown_connections 2024-09-15T21:55:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.833+0000 7f40cd1e7640 1 -- 172.21.15.1:0/2038274232 wait complete. 2024-09-15T21:55:31.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-09-15T21:55:31.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-09-15T21:55:31.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.845+0000 7fac6ffff640 1 -- 172.21.15.1:0/1395375324 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fac50005590 con 0x7fac700ae740 2024-09-15T21:55:31.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.845+0000 7fac57fff640 1 -- 172.21.15.1:0/1395375324 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fac60056240 con 0x7fac700ae740 2024-09-15T21:55:31.848 INFO:teuthology.orchestra.run.smithi001.stdout:55834574854 2024-09-15T21:55:31.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.845+0000 7fac6ffff640 1 -- 172.21.15.1:0/1395375324 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fac5c067990 msgr2=0x7fac5c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.845+0000 7fac6ffff640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fac5c067990 0x7fac5c069e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fac680b3000 tx=0x7fac680ab070 comp rx=0 tx=0).stop 2024-09-15T21:55:31.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.845+0000 7fac6ffff640 1 -- 172.21.15.1:0/1395375324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac700ae740 msgr2=0x7fac701f00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:31.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.845+0000 7fac6ffff640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac700ae740 0x7fac701f00f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac6000c410 tx=0x7fac6000c8d0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.845+0000 7fac6ffff640 1 -- 172.21.15.1:0/1395375324 shutdown_connections 2024-09-15T21:55:31.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.845+0000 7fac6ffff640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fac5c067990 0x7fac5c069e50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.845+0000 7fac6ffff640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac70158520 0x7fac701f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.845+0000 7fac6ffff640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac700ae740 0x7fac701f00f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.845+0000 7fac6ffff640 1 --2- 172.21.15.1:0/1395375324 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fac7006c630 0x7fac701572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:31.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.845+0000 7fac6ffff640 1 -- 172.21.15.1:0/1395375324 >> 172.21.15.1:0/1395375324 conn(0x7fac700b96d0 msgr2=0x7fac7009c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:31.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.849+0000 7fac6ffff640 1 -- 172.21.15.1:0/1395375324 shutdown_connections 2024-09-15T21:55:31.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:31.849+0000 7fac6ffff640 1 -- 172.21.15.1:0/1395375324 wait complete. 2024-09-15T21:55:31.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-09-15T21:55:31.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2024-09-15T21:55:31.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-09-15T21:55:32.819 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T21:55:32.826 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T21:55:32.828 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T21:55:32.843 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T21:55:32.848 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T21:55:32.858 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T21:55:32.865 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T21:55:32.872 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T21:55:33.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fab22a640 1 Processor -- start 2024-09-15T21:55:33.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fab22a640 1 -- start start 2024-09-15T21:55:33.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fab22a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1fa406dbd0 0x7f1fa40af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fab22a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa406cf10 0x7f1fa409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fab22a640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa40ae310 con 0x7f1fa40b64b0 2024-09-15T21:55:33.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fab22a640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f1fa40aeb40 con 0x7f1fa406dbd0 2024-09-15T21:55:33.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fab22a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa40af560 con 0x7f1fa406cf10 2024-09-15T21:55:33.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fa8fc6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1fa406dbd0 0x7f1fa40af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fa8fc6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1fa406dbd0 0x7f1fa40af020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60504/0 (socket says 172.21.15.1:60504) 2024-09-15T21:55:33.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fa8fc6640 1 -- 172.21.15.1:0/4148639675 learned_addr learned my addr 172.21.15.1:0/4148639675 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fa3fff640 1 --2- 172.21.15.1:0/4148639675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa406cf10 0x7f1fa409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fa8fc6640 1 -- 172.21.15.1:0/4148639675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa406cf10 msgr2=0x7f1fa409aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:33.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fa8fc6640 1 --2- 172.21.15.1:0/4148639675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa406cf10 0x7f1fa409aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fa8fc6640 1 -- 172.21.15.1:0/4148639675 >> v1:172.21.15.1:6789/0 conn(0x7f1fa40b64b0 legacy=0x7f1fa409af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:33.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.001+0000 7f1fa8fc6640 1 -- 172.21.15.1:0/4148639675 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa406dfb0 con 0x7f1fa406dbd0 2024-09-15T21:55:33.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.005+0000 7f1fa8fc6640 1 --2- 172.21.15.1:0/4148639675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fa406dbd0 0x7f1fa40af020 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400aa10 tx=0x7f1f9401d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a81d086b7412bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.005+0000 7f1fa37fe640 1 -- 172.21.15.1:0/4148639675 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f940b3070 con 0x7f1fa406dbd0 2024-09-15T21:55:33.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.005+0000 7f1fa37fe640 1 -- 172.21.15.1:0/4148639675 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f940a6810 con 0x7f1fa406dbd0 2024-09-15T21:55:33.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.005+0000 7f1fa37fe640 1 -- 172.21.15.1:0/4148639675 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9400b040 con 0x7f1fa406dbd0 2024-09-15T21:55:33.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.005+0000 7f1fab22a640 1 -- 172.21.15.1:0/4148639675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fa406dbd0 msgr2=0x7f1fa40af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.005+0000 7f1fab22a640 1 --2- 172.21.15.1:0/4148639675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fa406dbd0 0x7f1fa40af020 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400aa10 tx=0x7f1f9401d7a0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.005+0000 7f1fab22a640 1 -- 172.21.15.1:0/4148639675 shutdown_connections 2024-09-15T21:55:33.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.005+0000 7f1fab22a640 1 --2- 172.21.15.1:0/4148639675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa406cf10 0x7f1fa409aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.005+0000 7f1fab22a640 1 --2- 172.21.15.1:0/4148639675 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fa406dbd0 0x7f1fa40af020 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.005+0000 7f1fab22a640 1 -- 172.21.15.1:0/4148639675 >> 172.21.15.1:0/4148639675 conn(0x7f1fa406c0c0 msgr2=0x7f1fa406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.005+0000 7f1fab22a640 1 -- 172.21.15.1:0/4148639675 shutdown_connections 2024-09-15T21:55:33.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.005+0000 7f1fab22a640 1 -- 172.21.15.1:0/4148639675 wait complete. 2024-09-15T21:55:33.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fab22a640 1 Processor -- start 2024-09-15T21:55:33.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fab22a640 1 -- start start 2024-09-15T21:55:33.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fab22a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa406dbd0 0x7f1fa4148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fab22a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa40b64b0 0x7f1fa414c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fab22a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fa414c710 0x7f1fa41450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fab22a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa409b820 con 0x7f1fa414c710 2024-09-15T21:55:33.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fab22a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa409b6a0 con 0x7f1fa40b64b0 2024-09-15T21:55:33.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fab22a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa4150b60 con 0x7f1fa406dbd0 2024-09-15T21:55:33.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fa97c7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fa414c710 0x7f1fa41450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fa97c7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fa414c710 0x7f1fa41450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60518/0 (socket says 172.21.15.1:60518) 2024-09-15T21:55:33.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fa97c7640 1 -- 172.21.15.1:0/1453333184 learned_addr learned my addr 172.21.15.1:0/1453333184 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fa3fff640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa40b64b0 0x7f1fa414c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fa8fc6640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa406dbd0 0x7f1fa4148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fa97c7640 1 -- 172.21.15.1:0/1453333184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa406dbd0 msgr2=0x7f1fa4148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fa97c7640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa406dbd0 0x7f1fa4148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fa97c7640 1 -- 172.21.15.1:0/1453333184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa40b64b0 msgr2=0x7f1fa414c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fa97c7640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa40b64b0 0x7f1fa414c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.009+0000 7f1fa97c7640 1 -- 172.21.15.1:0/1453333184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa414cb90 con 0x7f1fa414c710 2024-09-15T21:55:33.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.013+0000 7f1fa97c7640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fa414c710 0x7f1fa41450a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800b440 tx=0x7f1f9800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.013+0000 7f1fa17fa640 1 -- 172.21.15.1:0/1453333184 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f98015020 con 0x7f1fa414c710 2024-09-15T21:55:33.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.013+0000 7f1fab22a640 1 -- 172.21.15.1:0/1453333184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa414b750 con 0x7f1fa414c710 2024-09-15T21:55:33.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.013+0000 7f1fab22a640 1 -- 172.21.15.1:0/1453333184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa40b2be0 con 0x7f1fa414c710 2024-09-15T21:55:33.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.017+0000 7f1fa17fa640 1 -- 172.21.15.1:0/1453333184 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f98011870 con 0x7f1fa414c710 2024-09-15T21:55:33.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.017+0000 7f1fa17fa640 1 -- 172.21.15.1:0/1453333184 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f98011c60 con 0x7f1fa414c710 2024-09-15T21:55:33.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.017+0000 7f1fa17fa640 1 -- 172.21.15.1:0/1453333184 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f98018020 con 0x7f1fa414c710 2024-09-15T21:55:33.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.017+0000 7f1fa17fa640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1f900679c0 0x7f1f90069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.017+0000 7f1fa8fc6640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1f900679c0 0x7f1f90069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.017+0000 7f1fa17fa640 1 -- 172.21.15.1:0/1453333184 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1f98085a00 con 0x7f1fa414c710 2024-09-15T21:55:33.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.017+0000 7f1fa8fc6640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1f900679c0 0x7f1f90069e80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1f940b0000 tx=0x7f1f9400c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.017+0000 7f1fab22a640 1 -- 172.21.15.1:0/1453333184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f840052a0 con 0x7f1fa414c710 2024-09-15T21:55:33.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.029+0000 7f1fa17fa640 1 -- 172.21.15.1:0/1453333184 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1f9801f020 con 0x7f1fa414c710 2024-09-15T21:55:33.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b268f640 1 Processor -- start 2024-09-15T21:55:33.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b268f640 1 -- start start 2024-09-15T21:55:33.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b268f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f58ac06d190 0x7f58ac0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b268f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f58ac147a70 0x7f58ac14e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b268f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58ac06db90 con 0x7f58ac0b57c0 2024-09-15T21:55:33.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b268f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f58ac0b41e0 con 0x7f58ac147a70 2024-09-15T21:55:33.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b268f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f58ac06d570 con 0x7f58ac06d190 2024-09-15T21:55:33.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b1e8e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f58ac147a70 0x7f58ac14e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b168d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f58ac06d190 0x7f58ac0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b1e8e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f58ac147a70 0x7f58ac14e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:42568/0 (socket says 172.21.15.1:42568) 2024-09-15T21:55:33.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b1e8e640 1 -- 172.21.15.1:0/4073948757 learned_addr learned my addr 172.21.15.1:0/4073948757 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b1e8e640 1 -- 172.21.15.1:0/4073948757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f58ac06d190 msgr2=0x7f58ac0aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:33.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b1e8e640 1 --2- 172.21.15.1:0/4073948757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f58ac06d190 0x7f58ac0aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b1e8e640 1 -- 172.21.15.1:0/4073948757 >> v1:172.21.15.70:6789/0 conn(0x7f58ac0b57c0 legacy=0x7f58ac147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.041+0000 7f58b1e8e640 1 -- 172.21.15.1:0/4073948757 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac0ae500 con 0x7f58ac147a70 2024-09-15T21:55:33.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.045+0000 7f58b1e8e640 1 --2- 172.21.15.1:0/4073948757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ac147a70 0x7f58ac14e160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f589c006fd0 tx=0x7f589c01cb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc52d13691031163 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.045+0000 7f58a3fff640 1 -- 172.21.15.1:0/4073948757 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c0ab070 con 0x7f58ac147a70 2024-09-15T21:55:33.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.045+0000 7f58a3fff640 1 -- 172.21.15.1:0/4073948757 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589c0a5c10 con 0x7f58ac147a70 2024-09-15T21:55:33.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.045+0000 7f58a3fff640 1 -- 172.21.15.1:0/4073948757 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c0ab070 con 0x7f58ac147a70 2024-09-15T21:55:33.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.045+0000 7f58b268f640 1 -- 172.21.15.1:0/4073948757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ac147a70 msgr2=0x7f58ac14e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.045+0000 7f58b268f640 1 --2- 172.21.15.1:0/4073948757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ac147a70 0x7f58ac14e160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f589c006fd0 tx=0x7f589c01cb40 comp rx=0 tx=0).stop 2024-09-15T21:55:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.045+0000 7f58b268f640 1 -- 172.21.15.1:0/4073948757 shutdown_connections 2024-09-15T21:55:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.045+0000 7f58b268f640 1 --2- 172.21.15.1:0/4073948757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ac147a70 0x7f58ac14e160 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.045+0000 7f58b268f640 1 --2- 172.21.15.1:0/4073948757 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f58ac06d190 0x7f58ac0aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.045+0000 7f58b268f640 1 -- 172.21.15.1:0/4073948757 >> 172.21.15.1:0/4073948757 conn(0x7f58ac0b96d0 msgr2=0x7f58ac06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.045+0000 7f58b268f640 1 -- 172.21.15.1:0/4073948757 shutdown_connections 2024-09-15T21:55:33.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.045+0000 7f58b268f640 1 -- 172.21.15.1:0/4073948757 wait complete. 2024-09-15T21:55:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b268f640 1 Processor -- start 2024-09-15T21:55:33.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b268f640 1 -- start start 2024-09-15T21:55:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b268f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ac06d190 0x7f58ac14d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b268f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ac0b57c0 0x7f58ac1dc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b168d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ac06d190 0x7f58ac14d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b168d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ac06d190 0x7f58ac14d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60532/0 (socket says 172.21.15.1:60532) 2024-09-15T21:55:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b268f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f58ac147a70 0x7f58ac1dc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b268f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac09e5b0 con 0x7f58ac06d190 2024-09-15T21:55:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b268f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac0ae180 con 0x7f58ac0b57c0 2024-09-15T21:55:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b268f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f58ac150ec0 con 0x7f58ac147a70 2024-09-15T21:55:33.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7fa25d662640 1 Processor -- start 2024-09-15T21:55:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b168d640 1 -- 172.21.15.1:0/3924272070 learned_addr learned my addr 172.21.15.1:0/3924272070 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b0e8c640 1 --2- 172.21.15.1:0/3924272070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ac0b57c0 0x7f58ac1dc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7fa25d662640 1 -- start start 2024-09-15T21:55:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b168d640 1 -- 172.21.15.1:0/3924272070 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f58ac147a70 msgr2=0x7f58ac1dc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b168d640 1 --2- 172.21.15.1:0/3924272070 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f58ac147a70 0x7f58ac1dc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b168d640 1 -- 172.21.15.1:0/3924272070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ac0b57c0 msgr2=0x7f58ac1dc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b168d640 1 --2- 172.21.15.1:0/3924272070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ac0b57c0 0x7f58ac1dc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b168d640 1 -- 172.21.15.1:0/3924272070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac14cd00 con 0x7f58ac06d190 2024-09-15T21:55:33.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f58b168d640 1 --2- 172.21.15.1:0/3924272070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ac06d190 0x7f58ac14d760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58a8017f60 tx=0x7f58a8017f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7fa25d662640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa2500ca440 0x7fa2500ca820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7fa25d662640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa25001cf90 0x7fa2500cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7fa257fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa2500ca440 0x7fa2500ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7fa2577fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa25001cf90 0x7fa2500cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7fa2577fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa25001cf90 0x7fa2500cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60546/0 (socket says 172.21.15.1:60546) 2024-09-15T21:55:33.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fa257fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa2500ca440 0x7fa2500ca820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:42596/0 (socket says 172.21.15.1:42596) 2024-09-15T21:55:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f58a1ffb640 1 -- 172.21.15.1:0/3924272070 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8024070 con 0x7f58ac06d190 2024-09-15T21:55:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fa2577fe640 1 -- 172.21.15.1:0/3729970162 learned_addr learned my addr 172.21.15.1:0/3729970162 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f58a1ffb640 1 -- 172.21.15.1:0/3924272070 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a800c490 con 0x7f58ac06d190 2024-09-15T21:55:33.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f58b268f640 1 -- 172.21.15.1:0/3924272070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ac14cfe0 con 0x7f58ac06d190 2024-09-15T21:55:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fa25d662640 1 -- 172.21.15.1:0/3729970162 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa25001c790 con 0x7fa25001d400 2024-09-15T21:55:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fa25d662640 1 -- 172.21.15.1:0/3729970162 --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fa2500cad60 con 0x7fa25001cf90 2024-09-15T21:55:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fa25d662640 1 -- 172.21.15.1:0/3729970162 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa25003ad00 con 0x7fa2500ca440 2024-09-15T21:55:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f58b268f640 1 -- 172.21.15.1:0/3924272070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ac14a5d0 con 0x7f58ac06d190 2024-09-15T21:55:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f58a1ffb640 1 -- 172.21.15.1:0/3924272070 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a800c860 con 0x7f58ac06d190 2024-09-15T21:55:33.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f58b268f640 1 -- 172.21.15.1:0/3924272070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f588c0052a0 con 0x7f58ac06d190 2024-09-15T21:55:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f6e6f59e640 1 Processor -- start 2024-09-15T21:55:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fa2577fe640 1 -- 172.21.15.1:0/3729970162 >> v2:172.21.15.70:3300/0 conn(0x7fa2500ca440 msgr2=0x7fa2500ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fa2577fe640 1 --2- 172.21.15.1:0/3729970162 >> v2:172.21.15.70:3300/0 conn(0x7fa2500ca440 0x7fa2500ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fa2577fe640 1 -- 172.21.15.1:0/3729970162 >> v1:172.21.15.70:6789/0 conn(0x7fa25001d400 legacy=0x7fa2500cb040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T21:55:33.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fa2577fe640 1 -- 172.21.15.1:0/3729970162 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25001dd10 con 0x7fa25001cf90 2024-09-15T21:55:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f6e6f59e640 1 -- start start 2024-09-15T21:55:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fb385783640 1 Processor -- start 2024-09-15T21:55:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fb385783640 1 -- start start 2024-09-15T21:55:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f6e6f59e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6e700bc6c0 0x7f6e70141600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f6e6f59e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6e70141b40 0x7f6e70151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f6e6f59e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e7009fcf0 con 0x7f6e7009f910 2024-09-15T21:55:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f6e6f59e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f6e7014ac10 con 0x7f6e700bc6c0 2024-09-15T21:55:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f6e6f59e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f6e7014b4b0 con 0x7f6e70141b40 2024-09-15T21:55:33.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fb385783640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb3800b5560 0x7fb3801415c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fb385783640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb38006d200 con 0x7fb38006e030 2024-09-15T21:55:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fb385783640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb38006d4e0 con 0x7fb380141b00 2024-09-15T21:55:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7fb385783640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fb3800b59b0 con 0x7fb3800b5560 2024-09-15T21:55:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7fb377fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb3800b5560 0x7fb3801415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f58a1ffb640 1 -- 172.21.15.1:0/3924272070 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58a8027070 con 0x7f58ac06d190 2024-09-15T21:55:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f58a1ffb640 1 --2- 172.21.15.1:0/3924272070 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5890067990 0x7f5890069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f58a1ffb640 1 -- 172.21.15.1:0/3924272070 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f58a808f020 con 0x7f58ac06d190 2024-09-15T21:55:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7fb377fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb3800b5560 0x7fb3801415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60548/0 (socket says 172.21.15.1:60548) 2024-09-15T21:55:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7fb377fff640 1 -- 172.21.15.1:0/4083909610 learned_addr learned my addr 172.21.15.1:0/4083909610 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7fb377fff640 1 -- 172.21.15.1:0/4083909610 >> v1:172.21.15.70:6789/0 conn(0x7fb380141b00 legacy=0x7fb38009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7fb377fff640 1 -- 172.21.15.1:0/4083909610 >> v1:172.21.15.1:6789/0 conn(0x7fb38006e030 legacy=0x7fb3800afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7fb377fff640 1 -- 172.21.15.1:0/4083909610 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38014aeb0 con 0x7fb3800b5560 2024-09-15T21:55:33.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f6e6e59c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6e7009f910 0x7f6e70147640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.1:59046/0 (socket says 172.21.15.1:59046) 2024-09-15T21:55:33.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f6e6e59c640 1 -- 172.21.15.1:0/1367287686 learned_addr learned my addr 172.21.15.1:0/1367287686 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:33.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f6e6dd9b640 1 --2- 172.21.15.1:0/1367287686 >> v2:172.21.15.1:3300/0 conn(0x7f6e700bc6c0 0x7f6e70141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7fa2577fe640 1 --2- 172.21.15.1:0/3729970162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa25001cf90 0x7fa2500cc900 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa25000ce40 tx=0x7fa24c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442efdd0c1785c4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f58b0e8c640 1 --2- 172.21.15.1:0/3924272070 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5890067990 0x7f5890069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f6e6d59a640 1 -- 172.21.15.1:0/1367287686 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1778302453 0 0) 0x7f6e7009fcf0 con 0x7f6e7009f910 2024-09-15T21:55:33.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f6e6d59a640 1 -- 172.21.15.1:0/1367287686 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e58003530 con 0x7f6e7009f910 2024-09-15T21:55:33.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f6e6ed9d640 1 --2- 172.21.15.1:0/1367287686 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6e70141b40 0x7f6e70151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f7486565640 1 Processor -- start 2024-09-15T21:55:33.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f58b0e8c640 1 --2- 172.21.15.1:0/3924272070 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5890067990 0x7f5890069e50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f58ac1498d0 tx=0x7f58a4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f7486565640 1 -- start start 2024-09-15T21:55:33.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f7486565640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f74780ed960 0x7f74780e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f7486565640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f74780eddb0 0x7f74780ea220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f7485563640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7478009c20 0x7f74780ed250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49770/0 (socket says 172.21.15.1:49770) 2024-09-15T21:55:33.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f7485563640 1 -- 172.21.15.1:0/4157117865 learned_addr learned my addr 172.21.15.1:0/4157117865 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:33.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f7486565640 1 -- 172.21.15.1:0/4157117865 --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f747800a000 con 0x7f7478009c20 2024-09-15T21:55:33.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f7486565640 1 -- 172.21.15.1:0/4157117865 --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f74780ea760 con 0x7f74780eddb0 2024-09-15T21:55:33.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f7486565640 1 -- 172.21.15.1:0/4157117865 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f7478030d90 con 0x7f74780ed960 2024-09-15T21:55:33.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f7485d64640 1 --2- 172.21.15.1:0/4157117865 >> v2:172.21.15.1:3300/0 conn(0x7f74780eddb0 0x7f74780ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f7484d62640 1 --2- 172.21.15.1:0/4157117865 >> v2:172.21.15.70:3300/0 conn(0x7f74780ed960 0x7f74780e9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.049+0000 7f7477fff640 1 -- 172.21.15.1:0/4157117865 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156085021 0 0) 0x7f747800a000 con 0x7f7478009c20 2024-09-15T21:55:33.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f7477fff640 1 -- 172.21.15.1:0/4157117865 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f746c007940 con 0x7f7478009c20 2024-09-15T21:55:33.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f7485d64640 1 -- 172.21.15.1:0/4157117865 >> v2:172.21.15.70:3300/0 conn(0x7f74780ed960 msgr2=0x7f74780e9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:33.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f7485d64640 1 --2- 172.21.15.1:0/4157117865 >> v2:172.21.15.70:3300/0 conn(0x7f74780ed960 0x7f74780e9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f7485d64640 1 -- 172.21.15.1:0/4157117865 >> v1:172.21.15.1:6789/0 conn(0x7f7478009c20 legacy=0x7f74780ed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.053+0000 7f7485d64640 1 -- 172.21.15.1:0/4157117865 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747801d3f0 con 0x7f74780eddb0 2024-09-15T21:55:33.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f7485d64640 1 --2- 172.21.15.1:0/4157117865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74780eddb0 0x7f74780ea220 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7480050e10 tx=0x7f748008fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6420cde2bad819ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f6e6dd9b640 1 -- 172.21.15.1:0/1367287686 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6e70141b40 msgr2=0x7f6e70151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:33.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f6e6dd9b640 1 --2- 172.21.15.1:0/1367287686 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6e70141b40 0x7f6e70151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f6e6dd9b640 1 -- 172.21.15.1:0/1367287686 >> v1:172.21.15.70:6789/0 conn(0x7f6e7009f910 legacy=0x7f6e70147640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.057+0000 7f6e6dd9b640 1 -- 172.21.15.1:0/1367287686 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7014ae60 con 0x7f6e700bc6c0 2024-09-15T21:55:33.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc149df640 1 Processor -- start 2024-09-15T21:55:33.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fb377fff640 1 --2- 172.21.15.1:0/4083909610 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3800b5560 0x7fb3801415c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb370009870 tx=0x7fb37001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324e3f4b9502a539 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc149df640 1 -- start start 2024-09-15T21:55:33.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f6e6dd9b640 1 --2- 172.21.15.1:0/1367287686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e700bc6c0 0x7f6e70141600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6e640097c0 tx=0x7f6e6401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c44ac62d011e2dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f7477fff640 1 -- 172.21.15.1:0/4157117865 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480125070 con 0x7f74780eddb0 2024-09-15T21:55:33.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fa256ffd640 1 -- 172.21.15.1:0/3729970162 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c0b0070 con 0x7fa25001cf90 2024-09-15T21:55:33.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f58a1ffb640 1 -- 172.21.15.1:0/3924272070 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f58a805f580 con 0x7f58ac06d190 2024-09-15T21:55:33.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fb37e7fc640 1 -- 172.21.15.1:0/4083909610 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3700ab660 con 0x7fb3800b5560 2024-09-15T21:55:33.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f6e6d59a640 1 -- 172.21.15.1:0/1367287686 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e640b0070 con 0x7f6e700bc6c0 2024-09-15T21:55:33.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f7477fff640 1 -- 172.21.15.1:0/4157117865 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f748006de50 con 0x7f74780eddb0 2024-09-15T21:55:33.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f7477fff640 1 -- 172.21.15.1:0/4157117865 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480072040 con 0x7f74780eddb0 2024-09-15T21:55:33.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc149df640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc100b4df0 0x7fdc100b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc149df640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdc10141660 0x7fdc10141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fb37e7fc640 1 -- 172.21.15.1:0/4083909610 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3700b0070 con 0x7fb3800b5560 2024-09-15T21:55:33.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc149df640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc100b74c0 con 0x7fdc100b64d0 2024-09-15T21:55:33.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fa256ffd640 1 -- 172.21.15.1:0/3729970162 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24c0a4e50 con 0x7fa25001cf90 2024-09-15T21:55:33.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fa256ffd640 1 -- 172.21.15.1:0/3729970162 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c0ab820 con 0x7fa25001cf90 2024-09-15T21:55:33.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc149df640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fdc10147a50 con 0x7fdc10141660 2024-09-15T21:55:33.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f6e6d59a640 1 -- 172.21.15.1:0/1367287686 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e640ab600 con 0x7f6e700bc6c0 2024-09-15T21:55:33.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f6e6d59a640 1 -- 172.21.15.1:0/1367287686 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e640ab9b0 con 0x7f6e700bc6c0 2024-09-15T21:55:33.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc0ed9d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdc10141660 0x7fdc10141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc0e59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc100b4df0 0x7fdc100b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc0e59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc100b4df0 0x7fdc100b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:34564/0 (socket says 172.21.15.1:34564) 2024-09-15T21:55:33.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc0e59c640 1 -- 172.21.15.1:0/146510740 learned_addr learned my addr 172.21.15.1:0/146510740 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc149df640 1 -- 172.21.15.1:0/146510740 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdc100b7730 con 0x7fdc100b4df0 2024-09-15T21:55:33.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc0d59a640 1 -- 172.21.15.1:0/146510740 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 217960817 0 0) 0x7fdc100b74c0 con 0x7fdc100b64d0 2024-09-15T21:55:33.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc0d59a640 1 -- 172.21.15.1:0/146510740 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbf8003530 con 0x7fdc100b64d0 2024-09-15T21:55:33.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fb385783640 1 -- 172.21.15.1:0/4083909610 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3800b5560 msgr2=0x7fb3801415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fb385783640 1 --2- 172.21.15.1:0/4083909610 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3800b5560 0x7fb3801415c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb370009870 tx=0x7fb37001c440 comp rx=0 tx=0).stop 2024-09-15T21:55:33.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f7486565640 1 -- 172.21.15.1:0/4157117865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74780eddb0 msgr2=0x7f74780ea220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f7486565640 1 --2- 172.21.15.1:0/4157117865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74780eddb0 0x7f74780ea220 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7480050e10 tx=0x7f748008fcf0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fb385783640 1 -- 172.21.15.1:0/4083909610 shutdown_connections 2024-09-15T21:55:33.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fb385783640 1 --2- 172.21.15.1:0/4083909610 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb3800b5560 0x7fb3801415c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fb385783640 1 -- 172.21.15.1:0/4083909610 >> 172.21.15.1:0/4083909610 conn(0x7fb38006c320 msgr2=0x7fb3800b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f7486565640 1 -- 172.21.15.1:0/4157117865 shutdown_connections 2024-09-15T21:55:33.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f7486565640 1 --2- 172.21.15.1:0/4157117865 >> v2:172.21.15.70:3300/0 conn(0x7f74780ed960 0x7f74780e9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f7486565640 1 --2- 172.21.15.1:0/4157117865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74780eddb0 0x7f74780ea220 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f7486565640 1 -- 172.21.15.1:0/4157117865 >> 172.21.15.1:0/4157117865 conn(0x7f7478008ea0 msgr2=0x7f74780092b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1367287686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e700bc6c0 msgr2=0x7f6e70141600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f6e6f59e640 1 --2- 172.21.15.1:0/1367287686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e700bc6c0 0x7f6e70141600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6e640097c0 tx=0x7f6e6401c450 comp rx=0 tx=0).stop 2024-09-15T21:55:33.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1367287686 shutdown_connections 2024-09-15T21:55:33.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f6e6f59e640 1 --2- 172.21.15.1:0/1367287686 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6e70141b40 0x7f6e70151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f6e6f59e640 1 --2- 172.21.15.1:0/1367287686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e700bc6c0 0x7f6e70141600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1367287686 >> 172.21.15.1:0/1367287686 conn(0x7f6e70068000 msgr2=0x7f6e7009efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc0ed9d640 1 -- 172.21.15.1:0/146510740 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc100b4df0 msgr2=0x7fdc100b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:33.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc0ed9d640 1 --2- 172.21.15.1:0/146510740 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc100b4df0 0x7fdc100b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc0ed9d640 1 -- 172.21.15.1:0/146510740 >> v1:172.21.15.70:6789/0 conn(0x7fdc100b64d0 legacy=0x7fdc10148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f7486565640 1 -- 172.21.15.1:0/4157117865 shutdown_connections 2024-09-15T21:55:33.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f7486565640 1 -- 172.21.15.1:0/4157117865 wait complete. 2024-09-15T21:55:33.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1367287686 shutdown_connections 2024-09-15T21:55:33.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fdc0ed9d640 1 -- 172.21.15.1:0/146510740 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc10147cf0 con 0x7fdc10141660 2024-09-15T21:55:33.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1367287686 wait complete. 2024-09-15T21:55:33.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fa25d662640 1 -- 172.21.15.1:0/3729970162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa25001cf90 msgr2=0x7fa2500cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fa25d662640 1 --2- 172.21.15.1:0/3729970162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa25001cf90 0x7fa2500cc900 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa25000ce40 tx=0x7fa24c01c3c0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.061+0000 7fb385783640 1 -- 172.21.15.1:0/4083909610 shutdown_connections 2024-09-15T21:55:33.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb385783640 1 -- 172.21.15.1:0/4083909610 wait complete. 2024-09-15T21:55:33.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6f59e640 1 Processor -- start 2024-09-15T21:55:33.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7486565640 1 Processor -- start 2024-09-15T21:55:33.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6f59e640 1 -- start start 2024-09-15T21:55:33.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fa25d662640 1 -- 172.21.15.1:0/3729970162 shutdown_connections 2024-09-15T21:55:33.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fa25d662640 1 --2- 172.21.15.1:0/3729970162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa25001cf90 0x7fa2500cc900 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fa25d662640 1 --2- 172.21.15.1:0/3729970162 >> v2:172.21.15.70:3300/0 conn(0x7fa2500ca440 0x7fa2500ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fa25d662640 1 -- 172.21.15.1:0/3729970162 >> 172.21.15.1:0/3729970162 conn(0x7fa25003b070 msgr2=0x7fa25003b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6f59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e7009f910 0x7f6e700b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6f59e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6e700bc6c0 0x7f6e700ba190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6f59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70141b40 0x7f6e701e06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6f59e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6e70154d00 con 0x7f6e70141b40 2024-09-15T21:55:33.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6f59e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7014bb50 con 0x7f6e7009f910 2024-09-15T21:55:33.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6f59e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f6e70154e80 con 0x7f6e700bc6c0 2024-09-15T21:55:33.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70141b40 0x7f6e701e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fa25d662640 1 -- 172.21.15.1:0/3729970162 shutdown_connections 2024-09-15T21:55:33.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7486565640 1 -- start start 2024-09-15T21:55:33.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7486565640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7478009c20 0x7f7478031200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7486565640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74780ed960 0x7f7478193350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7486565640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74780eddb0 0x7f7478193890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7486565640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f747801ac90 con 0x7f74780ed960 2024-09-15T21:55:33.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7486565640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f747801ab10 con 0x7f74780eddb0 2024-09-15T21:55:33.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7486565640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f747801cbc0 con 0x7f7478009c20 2024-09-15T21:55:33.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb385783640 1 Processor -- start 2024-09-15T21:55:33.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7485563640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7478009c20 0x7f7478031200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70141b40 0x7f6e701e06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60562/0 (socket says 172.21.15.1:60562) 2024-09-15T21:55:33.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6ed9d640 1 -- 172.21.15.1:0/1579055066 learned_addr learned my addr 172.21.15.1:0/1579055066 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6dd9b640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6e700bc6c0 0x7f6e700ba190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6e59c640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e7009f910 0x7f6e700b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7484d62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74780ed960 0x7f7478193350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7484d62640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74780ed960 0x7f7478193350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60570/0 (socket says 172.21.15.1:60570) 2024-09-15T21:55:33.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7484d62640 1 -- 172.21.15.1:0/3214388730 learned_addr learned my addr 172.21.15.1:0/3214388730 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6ed9d640 1 -- 172.21.15.1:0/1579055066 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6e700bc6c0 msgr2=0x7f6e700ba190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6ed9d640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6e700bc6c0 0x7f6e700ba190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6ed9d640 1 -- 172.21.15.1:0/1579055066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e7009f910 msgr2=0x7f6e700b8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6ed9d640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e7009f910 0x7f6e700b8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6ed9d640 1 -- 172.21.15.1:0/1579055066 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e700bbc90 con 0x7f6e70141b40 2024-09-15T21:55:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f6e6ed9d640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70141b40 0x7f6e701e06a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000c590 tx=0x7f6e6000ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7485d64640 1 --2- 172.21.15.1:0/3214388730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74780eddb0 0x7f7478193890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7484d62640 1 -- 172.21.15.1:0/3214388730 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7478009c20 msgr2=0x7f7478031200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7484d62640 1 --2- 172.21.15.1:0/3214388730 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7478009c20 0x7f7478031200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7484d62640 1 -- 172.21.15.1:0/3214388730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74780eddb0 msgr2=0x7f7478193890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7484d62640 1 --2- 172.21.15.1:0/3214388730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74780eddb0 0x7f7478193890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7f7484d62640 1 -- 172.21.15.1:0/3214388730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7478031b20 con 0x7f74780ed960 2024-09-15T21:55:33.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fdc0ed9d640 1 --2- 172.21.15.1:0/146510740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10141660 0x7fdc10141ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc000097c0 tx=0x7fdc0001c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4830308a86c6382e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fdc0d59a640 1 -- 172.21.15.1:0/146510740 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc000b0070 con 0x7fdc10141660 2024-09-15T21:55:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb385783640 1 -- start start 2024-09-15T21:55:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb385783640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb38006e030 0x7fb380148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb385783640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb380141b00 0x7fb380145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb385783640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb380145d40 0x7fb38013dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb385783640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb3800b02e0 con 0x7fb380141b00 2024-09-15T21:55:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb385783640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb3800b0160 con 0x7fb38006e030 2024-09-15T21:55:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb385783640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb3800ae0f0 con 0x7fb380145d40 2024-09-15T21:55:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb37effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb38006e030 0x7fb380148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb37effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb38006e030 0x7fb380148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:42628/0 (socket says 172.21.15.1:42628) 2024-09-15T21:55:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb37effd640 1 -- 172.21.15.1:0/1266494245 learned_addr learned my addr 172.21.15.1:0/1266494245 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb37f7fe640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb380145d40 0x7fb38013dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fa25d662640 1 -- 172.21.15.1:0/3729970162 wait complete. 2024-09-15T21:55:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fa25d662640 1 Processor -- start 2024-09-15T21:55:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb377fff640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb380141b00 0x7fb380145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb377fff640 1 -- 172.21.15.1:0/1266494245 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb380145d40 msgr2=0x7fb38013dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fb377fff640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb380145d40 0x7fb38013dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fb377fff640 1 -- 172.21.15.1:0/1266494245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb38006e030 msgr2=0x7fb380148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fb377fff640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb38006e030 0x7fb380148510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fb377fff640 1 -- 172.21.15.1:0/1266494245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3801477d0 con 0x7fb380141b00 2024-09-15T21:55:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fa25d662640 1 -- start start 2024-09-15T21:55:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fdc0d59a640 1 -- 172.21.15.1:0/146510740 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc000ab400 con 0x7fdc10141660 2024-09-15T21:55:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fdc0d59a640 1 -- 172.21.15.1:0/146510740 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08001a00 con 0x7fdc10141660 2024-09-15T21:55:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fdc149df640 1 -- 172.21.15.1:0/146510740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10141660 msgr2=0x7fdc10141ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fdc149df640 1 --2- 172.21.15.1:0/146510740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10141660 0x7fdc10141ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc000097c0 tx=0x7fdc0001c270 comp rx=0 tx=0).stop 2024-09-15T21:55:33.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fdc149df640 1 -- 172.21.15.1:0/146510740 shutdown_connections 2024-09-15T21:55:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fdc149df640 1 --2- 172.21.15.1:0/146510740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10141660 0x7fdc10141ab0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fdc149df640 1 --2- 172.21.15.1:0/146510740 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc100b4df0 0x7fdc100b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fdc149df640 1 -- 172.21.15.1:0/146510740 >> 172.21.15.1:0/146510740 conn(0x7fdc100bd380 msgr2=0x7fdc100bd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fdc149df640 1 -- 172.21.15.1:0/146510740 shutdown_connections 2024-09-15T21:55:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.065+0000 7fdc149df640 1 -- 172.21.15.1:0/146510740 wait complete. 2024-09-15T21:55:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7f6e5effd640 1 -- 172.21.15.1:0/1579055066 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e60015070 con 0x7f6e70141b40 2024-09-15T21:55:33.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fb377fff640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb380141b00 0x7fb380145800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb3700ac000 tx=0x7fb37001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7f7484d62640 1 --2- 172.21.15.1:0/3214388730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74780ed960 0x7f7478193350 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f747000fbe0 tx=0x7f747000d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25d662640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa25001cf90 0x7fa2500c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25d662640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2500ca440 0x7fa25016c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25d662640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa250168f50 0x7fa2501693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25d662640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa2500d4a20 con 0x7fa2500ca440 2024-09-15T21:55:33.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25d662640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa2500d48a0 con 0x7fa250168f50 2024-09-15T21:55:33.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25d662640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa2500d4ba0 con 0x7fa25001cf90 2024-09-15T21:55:33.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1579055066 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e700b98b0 con 0x7f6e70141b40 2024-09-15T21:55:33.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1579055066 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e7009b5e0 con 0x7f6e70141b40 2024-09-15T21:55:33.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25ce61640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa250168f50 0x7fa2501693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25ce61640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa250168f50 0x7fa2501693e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:42644/0 (socket says 172.21.15.1:42644) 2024-09-15T21:55:33.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25ce61640 1 -- 172.21.15.1:0/234485099 learned_addr learned my addr 172.21.15.1:0/234485099 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1579055066 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e70141600 con 0x7f6e70141b40 2024-09-15T21:55:33.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa2577fe640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2500ca440 0x7fa25016c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa257fff640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa25001cf90 0x7fa2500c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7f7475ffb640 1 -- 172.21.15.1:0/3214388730 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747001d070 con 0x7f74780ed960 2024-09-15T21:55:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7f7475ffb640 1 -- 172.21.15.1:0/3214388730 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7470018640 con 0x7f74780ed960 2024-09-15T21:55:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7f7475ffb640 1 -- 172.21.15.1:0/3214388730 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74700189f0 con 0x7f74780ed960 2024-09-15T21:55:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7f7486565640 1 -- 172.21.15.1:0/3214388730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7478033bd0 con 0x7f74780ed960 2024-09-15T21:55:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7f7486565640 1 -- 172.21.15.1:0/3214388730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7478032340 con 0x7f74780ed960 2024-09-15T21:55:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25ce61640 1 -- 172.21.15.1:0/234485099 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa25001cf90 msgr2=0x7fa2500c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25ce61640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa25001cf90 0x7fa2500c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25ce61640 1 -- 172.21.15.1:0/234485099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2500ca440 msgr2=0x7fa25016c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25ce61640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2500ca440 0x7fa25016c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25ce61640 1 -- 172.21.15.1:0/234485099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa250034e60 con 0x7fa250168f50 2024-09-15T21:55:33.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fdc149df640 1 Processor -- start 2024-09-15T21:55:33.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fdc149df640 1 -- start start 2024-09-15T21:55:33.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25ce61640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa250168f50 0x7fa2501693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa25806a010 tx=0x7fa258075370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa254ff9640 1 -- 172.21.15.1:0/234485099 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2580741c0 con 0x7fa250168f50 2024-09-15T21:55:33.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25d662640 1 -- 172.21.15.1:0/234485099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25016cf40 con 0x7fa250168f50 2024-09-15T21:55:33.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25d662640 1 -- 172.21.15.1:0/234485099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa250034b10 con 0x7fa250168f50 2024-09-15T21:55:33.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fdc149df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc100b4df0 0x7fdc10144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fdc149df640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc100b64d0 0x7fdc10132190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fdc149df640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc10141660 0x7fdc1008b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fdc149df640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdc10154c60 con 0x7fdc100b64d0 2024-09-15T21:55:33.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fdc149df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc10154ae0 con 0x7fdc100b4df0 2024-09-15T21:55:33.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fdc149df640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdc10154de0 con 0x7fdc10141660 2024-09-15T21:55:33.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7f7486565640 1 -- 172.21.15.1:0/3214388730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7478037b30 con 0x7f74780ed960 2024-09-15T21:55:33.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7f6e5effd640 1 -- 172.21.15.1:0/1579055066 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e60004220 con 0x7f6e70141b40 2024-09-15T21:55:33.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7f6e5effd640 1 -- 172.21.15.1:0/1579055066 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e60003620 con 0x7f6e70141b40 2024-09-15T21:55:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fdc0e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc100b4df0 0x7fdc10144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fdc0e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc100b4df0 0x7fdc10144660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:42658/0 (socket says 172.21.15.1:42658) 2024-09-15T21:55:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fdc0e59c640 1 -- 172.21.15.1:0/2738124367 learned_addr learned my addr 172.21.15.1:0/2738124367 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fdc0ed9d640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc10141660 0x7fdc1008b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa254ff9640 1 -- 172.21.15.1:0/234485099 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25806de50 con 0x7fa250168f50 2024-09-15T21:55:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa25d662640 1 -- 172.21.15.1:0/234485099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2500088e0 con 0x7fa250168f50 2024-09-15T21:55:33.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.069+0000 7fa254ff9640 1 -- 172.21.15.1:0/234485099 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258093640 con 0x7fa250168f50 2024-09-15T21:55:33.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fdc0dd9b640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc100b64d0 0x7fdc10132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fdc0e59c640 1 -- 172.21.15.1:0/2738124367 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc10141660 msgr2=0x7fdc1008b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fdc0e59c640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc10141660 0x7fdc1008b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fdc0e59c640 1 -- 172.21.15.1:0/2738124367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc100b64d0 msgr2=0x7fdc10132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fdc0e59c640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc100b64d0 0x7fdc10132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fdc0e59c640 1 -- 172.21.15.1:0/2738124367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1014cc30 con 0x7fdc100b4df0 2024-09-15T21:55:33.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fdc0e59c640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc100b4df0 0x7fdc10144660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400e8c0 tx=0x7fdc0400ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7f7475ffb640 1 -- 172.21.15.1:0/3214388730 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7470020070 con 0x7f74780ed960 2024-09-15T21:55:33.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7f7475ffb640 1 --2- 172.21.15.1:0/3214388730 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7464067990 0x7f7464069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7f7475ffb640 1 -- 172.21.15.1:0/3214388730 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7470086780 con 0x7f74780ed960 2024-09-15T21:55:33.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7f7485563640 1 --2- 172.21.15.1:0/3214388730 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7464067990 0x7f7464069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7f7485563640 1 --2- 172.21.15.1:0/3214388730 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7464067990 0x7f7464069e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f747c0011f0 tx=0x7f747c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fa254ff9640 1 -- 172.21.15.1:0/234485099 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa25809c3f0 con 0x7fa250168f50 2024-09-15T21:55:33.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fa254ff9640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa23c0678c0 0x7fa23c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fa254ff9640 1 -- 172.21.15.1:0/234485099 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa258101380 con 0x7fa250168f50 2024-09-15T21:55:33.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fa257fff640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa23c0678c0 0x7fa23c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fa257fff640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa23c0678c0 0x7fa23c069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa2440096f0 tx=0x7fa244008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fb3777fe640 1 -- 172.21.15.1:0/1266494245 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb370004230 con 0x7fb380141b00 2024-09-15T21:55:33.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fb3777fe640 1 -- 172.21.15.1:0/1266494245 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3700043d0 con 0x7fb380141b00 2024-09-15T21:55:33.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fb3777fe640 1 -- 172.21.15.1:0/1266494245 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3700aa990 con 0x7fb380141b00 2024-09-15T21:55:33.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fb385783640 1 -- 172.21.15.1:0/1266494245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb380147d90 con 0x7fb380141b00 2024-09-15T21:55:33.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.073+0000 7fb385783640 1 -- 172.21.15.1:0/1266494245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb380146480 con 0x7fb380141b00 2024-09-15T21:55:33.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.077+0000 7fb385783640 1 -- 172.21.15.1:0/1266494245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3640052a0 con 0x7fb380141b00 2024-09-15T21:55:33.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.077+0000 7f7475ffb640 1 -- 172.21.15.1:0/3214388730 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7478031b20 con 0x7f74780ed960 2024-09-15T21:55:33.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.081+0000 7f6e5effd640 1 -- 172.21.15.1:0/1579055066 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6e600037c0 con 0x7f6e70141b40 2024-09-15T21:55:33.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.081+0000 7f6e5effd640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f6e500678c0 0x7f6e50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.081+0000 7f6e6e59c640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f6e500678c0 0x7f6e50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.081+0000 7f6e5effd640 1 -- 172.21.15.1:0/1579055066 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6e60054390 con 0x7f6e70141b40 2024-09-15T21:55:33.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.081+0000 7fb3777fe640 1 -- 172.21.15.1:0/1266494245 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3700aab30 con 0x7fb380141b00 2024-09-15T21:55:33.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.081+0000 7fb3777fe640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb3600679c0 0x7fb360069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.081+0000 7fb3777fe640 1 -- 172.21.15.1:0/1266494245 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb370120410 con 0x7fb380141b00 2024-09-15T21:55:33.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.081+0000 7fb37effd640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb3600679c0 0x7fb360069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.081+0000 7f6e6e59c640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f6e500678c0 0x7f6e50069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e68005c10 tx=0x7f6e68009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.081+0000 7fb37effd640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb3600679c0 0x7fb360069e80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb368007fd0 tx=0x7fb368009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.085+0000 7fa254ff9640 1 -- 172.21.15.1:0/234485099 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa2580a1080 con 0x7fa250168f50 2024-09-15T21:55:33.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.085+0000 7fdbfeffd640 1 -- 172.21.15.1:0/2738124367 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04017070 con 0x7fdc100b4df0 2024-09-15T21:55:33.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.085+0000 7fdbfeffd640 1 -- 172.21.15.1:0/2738124367 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc0400c940 con 0x7fdc100b4df0 2024-09-15T21:55:33.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.085+0000 7fdbfeffd640 1 -- 172.21.15.1:0/2738124367 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0400ccf0 con 0x7fdc100b4df0 2024-09-15T21:55:33.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.085+0000 7fdc149df640 1 -- 172.21.15.1:0/2738124367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc1014cf10 con 0x7fdc100b4df0 2024-09-15T21:55:33.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.085+0000 7fdc149df640 1 -- 172.21.15.1:0/2738124367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc101359d0 con 0x7fdc100b4df0 2024-09-15T21:55:33.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.085+0000 7f6e5effd640 1 -- 172.21.15.1:0/1579055066 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6e600562f0 con 0x7f6e70141b40 2024-09-15T21:55:33.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.085+0000 7fdc149df640 1 -- 172.21.15.1:0/2738124367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc100b51d0 con 0x7fdc100b4df0 2024-09-15T21:55:33.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.089+0000 7fdbfeffd640 1 -- 172.21.15.1:0/2738124367 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdc0401a070 con 0x7fdc100b4df0 2024-09-15T21:55:33.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.089+0000 7fdbfeffd640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdbf0067990 0x7fdbf0069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.089+0000 7fdbfeffd640 1 -- 172.21.15.1:0/2738124367 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdc04086320 con 0x7fdc100b4df0 2024-09-15T21:55:33.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.089+0000 7fdc0dd9b640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdbf0067990 0x7fdbf0069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.089+0000 7fdc0dd9b640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdbf0067990 0x7fdbf0069e50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc100bc920 tx=0x7fdc08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.093+0000 7fb3777fe640 1 -- 172.21.15.1:0/1266494245 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb3700c3030 con 0x7fb380141b00 2024-09-15T21:55:33.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.093+0000 7f89de3d3640 1 Processor -- start 2024-09-15T21:55:33.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.093+0000 7f89de3d3640 1 -- start start 2024-09-15T21:55:33.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.093+0000 7f89de3d3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f89d8071dc0 0x7f89d813f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.093+0000 7f89de3d3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f89d813fa30 0x7f89d814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.093+0000 7f89de3d3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d8068040 con 0x7f89d8067c60 2024-09-15T21:55:33.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.093+0000 7f89de3d3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f89d8070ff0 con 0x7f89d8071dc0 2024-09-15T21:55:33.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.093+0000 7f89de3d3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f89d806f4e0 con 0x7f89d813fa30 2024-09-15T21:55:33.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.097+0000 7f89d77fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f89d8071dc0 0x7f89d813f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.097+0000 7f89d7fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f89d8067c60 0x7f89d8072a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.1:59064/0 (socket says 172.21.15.1:59064) 2024-09-15T21:55:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.097+0000 7f89d7fff640 1 -- 172.21.15.1:0/2617213487 learned_addr learned my addr 172.21.15.1:0/2617213487 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.097+0000 7f89dc970640 1 --2- 172.21.15.1:0/2617213487 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f89d813fa30 0x7f89d814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.097+0000 7f89d77fe640 1 -- 172.21.15.1:0/2617213487 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f89d813fa30 msgr2=0x7f89d814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.097+0000 7f89d77fe640 1 --2- 172.21.15.1:0/2617213487 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f89d813fa30 0x7f89d814ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.097+0000 7f89d77fe640 1 -- 172.21.15.1:0/2617213487 >> v1:172.21.15.70:6789/0 conn(0x7f89d8067c60 legacy=0x7f89d8072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.097+0000 7f89d77fe640 1 -- 172.21.15.1:0/2617213487 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d80722a0 con 0x7f89d8071dc0 2024-09-15T21:55:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.101+0000 7f89d77fe640 1 --2- 172.21.15.1:0/2617213487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89d8071dc0 0x7f89d813f4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0097c0 tx=0x7f89cc01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cee83efa275f86fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.101+0000 7fdbfeffd640 1 -- 172.21.15.1:0/2738124367 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdc04056880 con 0x7fdc100b4df0 2024-09-15T21:55:33.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.101+0000 7f89d6ffd640 1 -- 172.21.15.1:0/2617213487 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0b2070 con 0x7f89d8071dc0 2024-09-15T21:55:33.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.101+0000 7f89d6ffd640 1 -- 172.21.15.1:0/2617213487 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc0ad640 con 0x7f89d8071dc0 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.101+0000 7f89d6ffd640 1 -- 172.21.15.1:0/2617213487 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0ad9f0 con 0x7f89d8071dc0 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.105+0000 7f89de3d3640 1 -- 172.21.15.1:0/2617213487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89d8071dc0 msgr2=0x7f89d813f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.105+0000 7f89de3d3640 1 --2- 172.21.15.1:0/2617213487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89d8071dc0 0x7f89d813f4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0097c0 tx=0x7f89cc01c390 comp rx=0 tx=0).stop 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.105+0000 7f89de3d3640 1 -- 172.21.15.1:0/2617213487 shutdown_connections 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.105+0000 7f89de3d3640 1 --2- 172.21.15.1:0/2617213487 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f89d813fa30 0x7f89d814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.105+0000 7f89de3d3640 1 --2- 172.21.15.1:0/2617213487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89d8071dc0 0x7f89d813f4f0 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0097c0 tx=0x7f89cc01c390 comp rx=0 tx=0).stop 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.105+0000 7f89de3d3640 1 -- 172.21.15.1:0/2617213487 >> 172.21.15.1:0/2617213487 conn(0x7f89d80b7970 msgr2=0x7f89d80b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.105+0000 7f89de3d3640 1 -- 172.21.15.1:0/2617213487 shutdown_connections 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.105+0000 7f89de3d3640 1 -- 172.21.15.1:0/2617213487 wait complete. 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89de3d3640 1 Processor -- start 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89de3d3640 1 -- start start 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89de3d3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f89d8067c60 0x7f89d80b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89de3d3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89d813fa30 0x7f89d81e49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89de3d3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89d80b1a50 0x7f89d81e4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89de3d3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f89d806f720 con 0x7f89d80b1a50 2024-09-15T21:55:33.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89de3d3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f89d8073120 con 0x7f89d813fa30 2024-09-15T21:55:33.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89de3d3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f89d806f8a0 con 0x7f89d8067c60 2024-09-15T21:55:33.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89dc970640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89d80b1a50 0x7f89d81e4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89dc970640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89d80b1a50 0x7f89d81e4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60604/0 (socket says 172.21.15.1:60604) 2024-09-15T21:55:33.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89dc970640 1 -- 172.21.15.1:0/1433690354 learned_addr learned my addr 172.21.15.1:0/1433690354 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89d77fe640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89d813fa30 0x7f89d81e49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89d7fff640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f89d8067c60 0x7f89d80b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89dc970640 1 -- 172.21.15.1:0/1433690354 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f89d8067c60 msgr2=0x7f89d80b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89dc970640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f89d8067c60 0x7f89d80b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89dc970640 1 -- 172.21.15.1:0/1433690354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89d813fa30 msgr2=0x7f89d81e49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89dc970640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89d813fa30 0x7f89d81e49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89dc970640 1 -- 172.21.15.1:0/1433690354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d81404b0 con 0x7f89d80b1a50 2024-09-15T21:55:33.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89dc970640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89d80b1a50 0x7f89d81e4ef0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89d000cc60 tx=0x7f89d000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89d4ff9640 1 -- 172.21.15.1:0/1433690354 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d00039a0 con 0x7f89d80b1a50 2024-09-15T21:55:33.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89d4ff9640 1 -- 172.21.15.1:0/1433690354 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d0003b40 con 0x7f89d80b1a50 2024-09-15T21:55:33.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89d4ff9640 1 -- 172.21.15.1:0/1433690354 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0004020 con 0x7f89d80b1a50 2024-09-15T21:55:33.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89de3d3640 1 -- 172.21.15.1:0/1433690354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d80b3490 con 0x7f89d80b1a50 2024-09-15T21:55:33.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.109+0000 7f89de3d3640 1 -- 172.21.15.1:0/1433690354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d80b0e00 con 0x7f89d80b1a50 2024-09-15T21:55:33.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.113+0000 7f89d4ff9640 1 -- 172.21.15.1:0/1433690354 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f89d00041c0 con 0x7f89d80b1a50 2024-09-15T21:55:33.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.113+0000 7f89d4ff9640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f89c0067a50 0x7f89c0069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.113+0000 7f89d7fff640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f89c0067a50 0x7f89c0069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.117+0000 7f89d4ff9640 1 -- 172.21.15.1:0/1433690354 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f89d00545f0 con 0x7f89d80b1a50 2024-09-15T21:55:33.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.117+0000 7f89de3d3640 1 -- 172.21.15.1:0/1433690354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d813f4f0 con 0x7f89d80b1a50 2024-09-15T21:55:33.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.117+0000 7f89d7fff640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f89c0067a50 0x7f89c0069f10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f89c8005890 tx=0x7f89c8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.125+0000 7f89d4ff9640 1 -- 172.21.15.1:0/1433690354 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f89d0014030 con 0x7f89d80b1a50 2024-09-15T21:55:33.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.341+0000 7f1fab22a640 1 -- 172.21.15.1:0/1453333184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1f84005590 con 0x7f1fa414c710 2024-09-15T21:55:33.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.345+0000 7f1fa17fa640 1 -- 172.21.15.1:0/1453333184 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1fa414b750 con 0x7f1fa414c710 2024-09-15T21:55:33.350 INFO:teuthology.orchestra.run.smithi001.stdout:55834574855 2024-09-15T21:55:33.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.353+0000 7f1f8affd640 1 -- 172.21.15.1:0/1453333184 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1f900679c0 msgr2=0x7f1f90069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.353+0000 7f1f8affd640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1f900679c0 0x7f1f90069e80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1f940b0000 tx=0x7f1f9400c040 comp rx=0 tx=0).stop 2024-09-15T21:55:33.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.353+0000 7f1f8affd640 1 -- 172.21.15.1:0/1453333184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fa414c710 msgr2=0x7f1fa41450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.353+0000 7f1f8affd640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fa414c710 0x7f1fa41450a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800b440 tx=0x7f1f9800b900 comp rx=0 tx=0).stop 2024-09-15T21:55:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.353+0000 7f1f8affd640 1 -- 172.21.15.1:0/1453333184 shutdown_connections 2024-09-15T21:55:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.353+0000 7f1f8affd640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1fa414c710 0x7f1fa41450a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.353+0000 7f1f8affd640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1f900679c0 0x7f1f90069e80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.353+0000 7f1f8affd640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa40b64b0 0x7f1fa414c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.353+0000 7f1f8affd640 1 --2- 172.21.15.1:0/1453333184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa406dbd0 0x7f1fa4148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.353+0000 7f1f8affd640 1 -- 172.21.15.1:0/1453333184 >> 172.21.15.1:0/1453333184 conn(0x7f1fa406c0c0 msgr2=0x7f1fa4147450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.353+0000 7f1f8affd640 1 -- 172.21.15.1:0/1453333184 shutdown_connections 2024-09-15T21:55:33.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.353+0000 7f1f8affd640 1 -- 172.21.15.1:0/1453333184 wait complete. 2024-09-15T21:55:33.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-09-15T21:55:33.380 DEBUG:teuthology.parallel:result is None 2024-09-15T21:55:33.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.385+0000 7f58b268f640 1 -- 172.21.15.1:0/3924272070 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f588c005860 con 0x7f58ac06d190 2024-09-15T21:55:33.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.385+0000 7f58a1ffb640 1 -- 172.21.15.1:0/3924272070 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58a8063880 con 0x7f58ac06d190 2024-09-15T21:55:33.391 INFO:teuthology.orchestra.run.smithi001.stdout:64424509448 2024-09-15T21:55:33.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.389+0000 7f58b268f640 1 -- 172.21.15.1:0/3924272070 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5890067990 msgr2=0x7f5890069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.389+0000 7f58b268f640 1 --2- 172.21.15.1:0/3924272070 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5890067990 0x7f5890069e50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f58ac1498d0 tx=0x7f58a4009040 comp rx=0 tx=0).stop 2024-09-15T21:55:33.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.389+0000 7f58b268f640 1 -- 172.21.15.1:0/3924272070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ac06d190 msgr2=0x7f58ac14d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.389+0000 7f58b268f640 1 --2- 172.21.15.1:0/3924272070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ac06d190 0x7f58ac14d760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58a8017f60 tx=0x7f58a8017f90 comp rx=0 tx=0).stop 2024-09-15T21:55:33.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.389+0000 7f58b268f640 1 -- 172.21.15.1:0/3924272070 shutdown_connections 2024-09-15T21:55:33.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.389+0000 7f58b268f640 1 --2- 172.21.15.1:0/3924272070 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f58ac147a70 0x7f58ac1dc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.389+0000 7f58b268f640 1 --2- 172.21.15.1:0/3924272070 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5890067990 0x7f5890069e50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.389+0000 7f58b268f640 1 --2- 172.21.15.1:0/3924272070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ac0b57c0 0x7f58ac1dc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.389+0000 7f58b268f640 1 --2- 172.21.15.1:0/3924272070 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f58ac06d190 0x7f58ac14d760 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.389+0000 7f58b268f640 1 -- 172.21.15.1:0/3924272070 >> 172.21.15.1:0/3924272070 conn(0x7f58ac0b96d0 msgr2=0x7f58ac0b85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.389+0000 7f58b268f640 1 -- 172.21.15.1:0/3924272070 shutdown_connections 2024-09-15T21:55:33.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.389+0000 7f58b268f640 1 -- 172.21.15.1:0/3924272070 wait complete. 2024-09-15T21:55:33.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.401+0000 7fdc149df640 1 -- 172.21.15.1:0/2738124367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fdc100b5de0 con 0x7fdc100b4df0 2024-09-15T21:55:33.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.401+0000 7fdbfeffd640 1 -- 172.21.15.1:0/2738124367 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdc0405ab80 con 0x7fdc100b4df0 2024-09-15T21:55:33.406 INFO:teuthology.orchestra.run.smithi001.stdout:64424509446 2024-09-15T21:55:33.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7fdc149df640 1 -- 172.21.15.1:0/2738124367 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdbf0067990 msgr2=0x7fdbf0069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7fdc149df640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdbf0067990 0x7fdbf0069e50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc100bc920 tx=0x7fdc08009040 comp rx=0 tx=0).stop 2024-09-15T21:55:33.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7fdc149df640 1 -- 172.21.15.1:0/2738124367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc100b4df0 msgr2=0x7fdc10144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7fdc149df640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc100b4df0 0x7fdc10144660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400e8c0 tx=0x7fdc0400ed80 comp rx=0 tx=0).stop 2024-09-15T21:55:33.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7fdc149df640 1 -- 172.21.15.1:0/2738124367 shutdown_connections 2024-09-15T21:55:33.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7fdc149df640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdc10141660 0x7fdc1008b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7fdc149df640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdc100b64d0 0x7fdc10132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7fdc149df640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdbf0067990 0x7fdbf0069e50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7fdc149df640 1 --2- 172.21.15.1:0/2738124367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc100b4df0 0x7fdc10144660 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7fdc149df640 1 -- 172.21.15.1:0/2738124367 >> 172.21.15.1:0/2738124367 conn(0x7fdc100bd380 msgr2=0x7fdc1013fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7fdc149df640 1 -- 172.21.15.1:0/2738124367 shutdown_connections 2024-09-15T21:55:33.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7fdc149df640 1 -- 172.21.15.1:0/2738124367 wait complete. 2024-09-15T21:55:33.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1579055066 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6e700b2be0 con 0x7f6e70141b40 2024-09-15T21:55:33.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.405+0000 7f6e5effd640 1 -- 172.21.15.1:0/1579055066 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6e6005a5f0 con 0x7f6e70141b40 2024-09-15T21:55:33.411 INFO:teuthology.orchestra.run.smithi001.stdout:64424509447 2024-09-15T21:55:33.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1579055066 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f6e500678c0 msgr2=0x7f6e50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f6e6f59e640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f6e500678c0 0x7f6e50069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e68005c10 tx=0x7f6e68009040 comp rx=0 tx=0).stop 2024-09-15T21:55:33.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1579055066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70141b40 msgr2=0x7f6e701e06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f6e6f59e640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70141b40 0x7f6e701e06a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000c590 tx=0x7f6e6000ca50 comp rx=0 tx=0).stop 2024-09-15T21:55:33.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1579055066 shutdown_connections 2024-09-15T21:55:33.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f6e6f59e640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6e70141b40 0x7f6e701e06a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f6e6f59e640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6e700bc6c0 0x7f6e700ba190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f6e6f59e640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f6e500678c0 0x7f6e50069d80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f6e6f59e640 1 --2- 172.21.15.1:0/1579055066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e7009f910 0x7f6e700b8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1579055066 >> 172.21.15.1:0/1579055066 conn(0x7f6e70068000 msgr2=0x7f6e7014a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f7486565640 1 -- 172.21.15.1:0/3214388730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f747800a000 con 0x7f74780ed960 2024-09-15T21:55:33.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1579055066 shutdown_connections 2024-09-15T21:55:33.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f6e6f59e640 1 -- 172.21.15.1:0/1579055066 wait complete. 2024-09-15T21:55:33.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.409+0000 7f7475ffb640 1 -- 172.21.15.1:0/3214388730 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7470056ce0 con 0x7f74780ed960 2024-09-15T21:55:33.416 INFO:teuthology.orchestra.run.smithi001.stdout:64424509447 2024-09-15T21:55:33.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.413+0000 7f7486565640 1 -- 172.21.15.1:0/3214388730 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7464067990 msgr2=0x7f7464069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.413+0000 7f7486565640 1 --2- 172.21.15.1:0/3214388730 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7464067990 0x7f7464069e50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f747c0011f0 tx=0x7f747c009040 comp rx=0 tx=0).stop 2024-09-15T21:55:33.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.413+0000 7f7486565640 1 -- 172.21.15.1:0/3214388730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74780ed960 msgr2=0x7f7478193350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.413+0000 7f7486565640 1 --2- 172.21.15.1:0/3214388730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74780ed960 0x7f7478193350 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f747000fbe0 tx=0x7f747000d720 comp rx=0 tx=0).stop 2024-09-15T21:55:33.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.413+0000 7f7486565640 1 -- 172.21.15.1:0/3214388730 shutdown_connections 2024-09-15T21:55:33.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.413+0000 7f7486565640 1 --2- 172.21.15.1:0/3214388730 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7464067990 0x7f7464069e50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.413+0000 7f7486565640 1 --2- 172.21.15.1:0/3214388730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74780eddb0 0x7f7478193890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.413+0000 7f7486565640 1 --2- 172.21.15.1:0/3214388730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74780ed960 0x7f7478193350 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.413+0000 7f7486565640 1 --2- 172.21.15.1:0/3214388730 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7478009c20 0x7f7478031200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.413+0000 7f7486565640 1 -- 172.21.15.1:0/3214388730 >> 172.21.15.1:0/3214388730 conn(0x7f7478008ea0 msgr2=0x7f747803c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-09-15T21:55:33.420 DEBUG:teuthology.parallel:result is None 2024-09-15T21:55:33.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.413+0000 7f7486565640 1 -- 172.21.15.1:0/3214388730 shutdown_connections 2024-09-15T21:55:33.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.413+0000 7f7486565640 1 -- 172.21.15.1:0/3214388730 wait complete. 2024-09-15T21:55:33.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-09-15T21:55:33.431 DEBUG:teuthology.parallel:result is None 2024-09-15T21:55:33.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.429+0000 7fa25d662640 1 -- 172.21.15.1:0/234485099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa25003ce10 con 0x7fa250168f50 2024-09-15T21:55:33.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.429+0000 7fa254ff9640 1 -- 172.21.15.1:0/234485099 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa25808f030 con 0x7fa250168f50 2024-09-15T21:55:33.432 INFO:teuthology.orchestra.run.smithi001.stdout:64424509447 2024-09-15T21:55:33.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-09-15T21:55:33.434 DEBUG:teuthology.parallel:result is None 2024-09-15T21:55:33.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fa25d662640 1 -- 172.21.15.1:0/234485099 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa23c0678c0 msgr2=0x7fa23c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fa25d662640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa23c0678c0 0x7fa23c069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa2440096f0 tx=0x7fa244008040 comp rx=0 tx=0).stop 2024-09-15T21:55:33.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fa25d662640 1 -- 172.21.15.1:0/234485099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa250168f50 msgr2=0x7fa2501693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fa25d662640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa250168f50 0x7fa2501693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa25806a010 tx=0x7fa258075370 comp rx=0 tx=0).stop 2024-09-15T21:55:33.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fa25d662640 1 -- 172.21.15.1:0/234485099 shutdown_connections 2024-09-15T21:55:33.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fa25d662640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa23c0678c0 0x7fa23c069d80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fa25d662640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa250168f50 0x7fa2501693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fa25d662640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa2500ca440 0x7fa25016c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fa25d662640 1 --2- 172.21.15.1:0/234485099 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa25001cf90 0x7fa2500c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fa25d662640 1 -- 172.21.15.1:0/234485099 >> 172.21.15.1:0/234485099 conn(0x7fa25003b070 msgr2=0x7fa250009fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb385783640 1 -- 172.21.15.1:0/1266494245 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb364005860 con 0x7fb380141b00 2024-09-15T21:55:33.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fa25d662640 1 -- 172.21.15.1:0/234485099 shutdown_connections 2024-09-15T21:55:33.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fa25d662640 1 -- 172.21.15.1:0/234485099 wait complete. 2024-09-15T21:55:33.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb3777fe640 1 -- 172.21.15.1:0/1266494245 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb370016150 con 0x7fb380141b00 2024-09-15T21:55:33.438 INFO:teuthology.orchestra.run.smithi001.stdout:64424509448 2024-09-15T21:55:33.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb385783640 1 -- 172.21.15.1:0/1266494245 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb3600679c0 msgr2=0x7fb360069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb385783640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb3600679c0 0x7fb360069e80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb368007fd0 tx=0x7fb368009040 comp rx=0 tx=0).stop 2024-09-15T21:55:33.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb385783640 1 -- 172.21.15.1:0/1266494245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb380141b00 msgr2=0x7fb380145800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb385783640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb380141b00 0x7fb380145800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb3700ac000 tx=0x7fb37001ac80 comp rx=0 tx=0).stop 2024-09-15T21:55:33.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb385783640 1 -- 172.21.15.1:0/1266494245 shutdown_connections 2024-09-15T21:55:33.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb385783640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb380145d40 0x7fb38013dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb385783640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb380141b00 0x7fb380145800 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb385783640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb3600679c0 0x7fb360069e80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb385783640 1 --2- 172.21.15.1:0/1266494245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb38006e030 0x7fb380148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb385783640 1 -- 172.21.15.1:0/1266494245 >> 172.21.15.1:0/1266494245 conn(0x7fb38006c320 msgr2=0x7fb3800b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb385783640 1 -- 172.21.15.1:0/1266494245 shutdown_connections 2024-09-15T21:55:33.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.433+0000 7fb385783640 1 -- 172.21.15.1:0/1266494245 wait complete. 2024-09-15T21:55:33.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-09-15T21:55:33.447 DEBUG:teuthology.parallel:result is None 2024-09-15T21:55:33.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89de3d3640 1 -- 172.21.15.1:0/1433690354 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f89d813ecd0 con 0x7f89d80b1a50 2024-09-15T21:55:33.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89d4ff9640 1 -- 172.21.15.1:0/1433690354 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f89d0056550 con 0x7f89d80b1a50 2024-09-15T21:55:33.453 INFO:teuthology.orchestra.run.smithi001.stdout:55834574855 2024-09-15T21:55:33.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89de3d3640 1 -- 172.21.15.1:0/1433690354 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f89c0067a50 msgr2=0x7f89c0069f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89de3d3640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f89c0067a50 0x7f89c0069f10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f89c8005890 tx=0x7f89c8009040 comp rx=0 tx=0).stop 2024-09-15T21:55:33.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89de3d3640 1 -- 172.21.15.1:0/1433690354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89d80b1a50 msgr2=0x7f89d81e4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89de3d3640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89d80b1a50 0x7f89d81e4ef0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89d000cc60 tx=0x7f89d000a5c0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89de3d3640 1 -- 172.21.15.1:0/1433690354 shutdown_connections 2024-09-15T21:55:33.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89de3d3640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89d80b1a50 0x7f89d81e4ef0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89de3d3640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f89c0067a50 0x7f89c0069f10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89de3d3640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89d813fa30 0x7f89d81e49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89de3d3640 1 --2- 172.21.15.1:0/1433690354 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f89d8067c60 0x7f89d80b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89de3d3640 1 -- 172.21.15.1:0/1433690354 >> 172.21.15.1:0/1433690354 conn(0x7f89d80b7970 msgr2=0x7f89d813db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89de3d3640 1 -- 172.21.15.1:0/1433690354 shutdown_connections 2024-09-15T21:55:33.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.449+0000 7f89de3d3640 1 -- 172.21.15.1:0/1433690354 wait complete. 2024-09-15T21:55:33.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-09-15T21:55:33.461 DEBUG:teuthology.parallel:result is None 2024-09-15T21:55:33.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.5 2024-09-15T21:55:33.463 DEBUG:teuthology.parallel:result is None 2024-09-15T21:55:33.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-09-15T21:55:33.471 DEBUG:teuthology.parallel:result is None 2024-09-15T21:55:33.471 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T21:55:33.472 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:55:33.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.617+0000 7ff768841640 1 Processor -- start 2024-09-15T21:55:33.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.617+0000 7ff768841640 1 -- start start 2024-09-15T21:55:33.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff768841640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff7640b5220 0x7ff76409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff768841640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff76409f520 con 0x7ff764148f20 2024-09-15T21:55:33.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff768841640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7640b6a50 con 0x7ff7640b5600 2024-09-15T21:55:33.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff768841640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7ff76409b800 con 0x7ff7640b5220 2024-09-15T21:55:33.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff762d9d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff764148f20 0x7ff764149370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49794/0 (socket says 172.21.15.1:49794) 2024-09-15T21:55:33.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff762d9d640 1 -- 172.21.15.1:0/4269614407 learned_addr learned my addr 172.21.15.1:0/4269614407 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:33.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76259c640 1 --2- 172.21.15.1:0/4269614407 >> v2:172.21.15.70:3300/0 conn(0x7ff7640b5220 0x7ff76409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 873257891 0 0) 0x7ff76409f520 con 0x7ff764148f20 2024-09-15T21:55:33.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff74c003530 con 0x7ff764148f20 2024-09-15T21:55:33.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2565568043 0 0) 0x7ff74c003530 con 0x7ff764148f20 2024-09-15T21:55:33.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 >> v2:172.21.15.70:3300/0 conn(0x7ff7640b5220 msgr2=0x7ff76409aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:33.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 --2- 172.21.15.1:0/4269614407 >> v2:172.21.15.70:3300/0 conn(0x7ff7640b5220 0x7ff76409aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 >> v1:172.21.15.70:6789/0 conn(0x7ff7640b5600 legacy=0x7ff76409ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76409af90 con 0x7ff764148f20 2024-09-15T21:55:33.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7ff75c001a00 con 0x7ff764148f20 2024-09-15T21:55:33.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 >> v1:172.21.15.1:6789/0 conn(0x7ff764148f20 legacy=0x7ff764149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 --2- 172.21.15.1:0/4269614407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff74c0039c0 0x7ff74c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 --2- 172.21.15.1:0/4269614407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff74c004810 0x7ff74c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 --2- 172.21.15.1:0/4269614407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff74c0052f0 0x7ff74c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff76409b800 con 0x7ff74c0039c0 2024-09-15T21:55:33.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c00c1c0 con 0x7ff74c0052f0 2024-09-15T21:55:33.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff74c00c3c0 con 0x7ff74c004810 2024-09-15T21:55:33.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76259c640 1 --2- 172.21.15.1:0/4269614407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff74c0039c0 0x7ff74c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff761d9b640 1 --2- 172.21.15.1:0/4269614407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff74c004810 0x7ff74c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff762d9d640 1 --2- 172.21.15.1:0/4269614407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff74c0052f0 0x7ff74c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76259c640 1 -- 172.21.15.1:0/4269614407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff74c004810 msgr2=0x7ff74c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:33.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76259c640 1 --2- 172.21.15.1:0/4269614407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff74c004810 0x7ff74c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76259c640 1 -- 172.21.15.1:0/4269614407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff74c0052f0 msgr2=0x7ff74c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:33.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76259c640 1 --2- 172.21.15.1:0/4269614407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff74c0052f0 0x7ff74c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76259c640 1 -- 172.21.15.1:0/4269614407 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74c003530 con 0x7ff74c0039c0 2024-09-15T21:55:33.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff762d9d640 1 -- 172.21.15.1:0/4269614407 reap_dead start 2024-09-15T21:55:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76259c640 1 --2- 172.21.15.1:0/4269614407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff74c0039c0 0x7ff74c003de0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff754009ab0 tx=0x7ff75401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee4e3680e899da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7540096b0 con 0x7ff74c0039c0 2024-09-15T21:55:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7540a6430 con 0x7ff74c0039c0 2024-09-15T21:55:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.621+0000 7ff76159a640 1 -- 172.21.15.1:0/4269614407 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7540a6820 con 0x7ff74c0039c0 2024-09-15T21:55:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 -- 172.21.15.1:0/4269614407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff74c0039c0 msgr2=0x7ff74c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 --2- 172.21.15.1:0/4269614407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff74c0039c0 0x7ff74c003de0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff754009ab0 tx=0x7ff75401ca50 comp rx=0 tx=0).stop 2024-09-15T21:55:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 -- 172.21.15.1:0/4269614407 shutdown_connections 2024-09-15T21:55:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 --2- 172.21.15.1:0/4269614407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff74c0039c0 0x7ff74c003de0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 -- 172.21.15.1:0/4269614407 >> 172.21.15.1:0/4269614407 conn(0x7ff7640b5c40 msgr2=0x7ff7640b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 -- 172.21.15.1:0/4269614407 shutdown_connections 2024-09-15T21:55:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 -- 172.21.15.1:0/4269614407 wait complete. 2024-09-15T21:55:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 Processor -- start 2024-09-15T21:55:33.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 -- start start 2024-09-15T21:55:33.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff74c0039c0 0x7ff7640b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7640b2830 0x7ff7641e1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7641e2250 0x7ff76413ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641494b0 con 0x7ff7640b2830 2024-09-15T21:55:33.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff764149330 con 0x7ff74c0039c0 2024-09-15T21:55:33.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff764149630 con 0x7ff7641e2250 2024-09-15T21:55:33.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff761d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7640b2830 0x7ff7641e1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff761d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7640b2830 0x7ff7641e1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60620/0 (socket says 172.21.15.1:60620) 2024-09-15T21:55:33.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff761d9b640 1 -- 172.21.15.1:0/774282697 learned_addr learned my addr 172.21.15.1:0/774282697 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:33.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff76259c640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff74c0039c0 0x7ff7640b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff762d9d640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7641e2250 0x7ff76413ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff761d9b640 1 -- 172.21.15.1:0/774282697 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7641e2250 msgr2=0x7ff76413ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff761d9b640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7641e2250 0x7ff76413ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff761d9b640 1 -- 172.21.15.1:0/774282697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff74c0039c0 msgr2=0x7ff7640b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff761d9b640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff74c0039c0 0x7ff7640b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff761d9b640 1 -- 172.21.15.1:0/774282697 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7640b1dc0 con 0x7ff7640b2830 2024-09-15T21:55:33.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff761d9b640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7640b2830 0x7ff7641e1d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff75800e4d0 tx=0x7ff75800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff752ffd640 1 -- 172.21.15.1:0/774282697 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7580053a0 con 0x7ff7640b2830 2024-09-15T21:55:33.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff752ffd640 1 -- 172.21.15.1:0/774282697 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff758018070 con 0x7ff7640b2830 2024-09-15T21:55:33.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff752ffd640 1 -- 172.21.15.1:0/774282697 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff758003820 con 0x7ff7640b2830 2024-09-15T21:55:33.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 -- 172.21.15.1:0/774282697 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7640b0ea0 con 0x7ff7640b2830 2024-09-15T21:55:33.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 -- 172.21.15.1:0/774282697 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7640b1140 con 0x7ff7640b2830 2024-09-15T21:55:33.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.625+0000 7ff768841640 1 -- 172.21.15.1:0/774282697 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff76409f430 con 0x7ff7640b2830 2024-09-15T21:55:33.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.629+0000 7ff752ffd640 1 -- 172.21.15.1:0/774282697 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7580039c0 con 0x7ff7640b2830 2024-09-15T21:55:33.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.629+0000 7ff752ffd640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff7440678c0 0x7ff744069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.629+0000 7ff752ffd640 1 -- 172.21.15.1:0/774282697 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff7580858f0 con 0x7ff7640b2830 2024-09-15T21:55:33.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.629+0000 7ff76259c640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff7440678c0 0x7ff744069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.629+0000 7ff76259c640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff7440678c0 0x7ff744069d80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7540ad000 tx=0x7ff7540b2040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:33.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.633+0000 7ff752ffd640 1 -- 172.21.15.1:0/774282697 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff7580564c0 con 0x7ff7640b2830 2024-09-15T21:55:33.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.785+0000 7ff768841640 1 -- 172.21.15.1:0/774282697 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff7641d1090 con 0x7ff7440678c0 2024-09-15T21:55:33.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.801+0000 7ff752ffd640 1 -- 172.21.15.1:0/774282697 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7ff7641d1090 con 0x7ff7440678c0 2024-09-15T21:55:33.810 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:33.811 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:55:33.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.805+0000 7ff768841640 1 -- 172.21.15.1:0/774282697 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff7440678c0 msgr2=0x7ff744069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.805+0000 7ff768841640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff7440678c0 0x7ff744069d80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7540ad000 tx=0x7ff7540b2040 comp rx=0 tx=0).stop 2024-09-15T21:55:33.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.805+0000 7ff768841640 1 -- 172.21.15.1:0/774282697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7640b2830 msgr2=0x7ff7641e1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.805+0000 7ff768841640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7640b2830 0x7ff7641e1d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff75800e4d0 tx=0x7ff75800e990 comp rx=0 tx=0).stop 2024-09-15T21:55:33.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.809+0000 7ff768841640 1 -- 172.21.15.1:0/774282697 shutdown_connections 2024-09-15T21:55:33.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.809+0000 7ff768841640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff7641e2250 0x7ff76413ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.809+0000 7ff768841640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7640b2830 0x7ff7641e1d10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.809+0000 7ff768841640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff7440678c0 0x7ff744069d80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.809+0000 7ff768841640 1 --2- 172.21.15.1:0/774282697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff74c0039c0 0x7ff7640b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:33.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.809+0000 7ff768841640 1 -- 172.21.15.1:0/774282697 >> 172.21.15.1:0/774282697 conn(0x7ff7640b5c40 msgr2=0x7ff7641456b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:33.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.809+0000 7ff768841640 1 -- 172.21.15.1:0/774282697 shutdown_connections 2024-09-15T21:55:33.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.809+0000 7ff768841640 1 -- 172.21.15.1:0/774282697 wait complete. 2024-09-15T21:55:33.829 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-15T21:55:33.082042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256568,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754718152,"statfs":{"total":773094113280,"available":772831387648,"internally_reserved":0,"allocated":2924544,"data_stored":1767532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.050557"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484762+0000","last_change":"2024-09-15T21:55:21.088474+0000","last_active":"2024-09-15T21:55:22.484762+0000","last_peered":"2024-09-15T21:55:22.484762+0000","last_clean":"2024-09-15T21:55:22.484762+0000","last_became_active":"2024-09-15T21:55:21.088066+0000","last_became_peered":"2024-09-15T21:55:21.088066+0000","last_unstale":"2024-09-15T21:55:22.484762+0000","last_undegraded":"2024-09-15T21:55:22.484762+0000","last_fullsized":"2024-09-15T21:55:22.484762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:35.421317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034618+0000","last_change":"2024-09-15T21:55:21.057377+0000","last_active":"2024-09-15T21:55:22.034618+0000","last_peered":"2024-09-15T21:55:22.034618+0000","last_clean":"2024-09-15T21:55:22.034618+0000","last_became_active":"2024-09-15T21:55:21.057035+0000","last_became_peered":"2024-09-15T21:55:21.057035+0000","last_unstale":"2024-09-15T21:55:22.034618+0000","last_undegraded":"2024-09-15T21:55:22.034618+0000","last_fullsized":"2024-09-15T21:55:22.034618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484551+0000","last_change":"2024-09-15T21:55:21.055398+0000","last_active":"2024-09-15T21:55:22.484551+0000","last_peered":"2024-09-15T21:55:22.484551+0000","last_clean":"2024-09-15T21:55:22.484551+0000","last_became_active":"2024-09-15T21:55:21.055039+0000","last_became_peered":"2024-09-15T21:55:21.055039+0000","last_unstale":"2024-09-15T21:55:22.484551+0000","last_undegraded":"2024-09-15T21:55:22.484551+0000","last_fullsized":"2024-09-15T21:55:22.484551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:45.407449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038690+0000","last_change":"2024-09-15T21:55:21.083779+0000","last_active":"2024-09-15T21:55:22.038690+0000","last_peered":"2024-09-15T21:55:22.038690+0000","last_clean":"2024-09-15T21:55:22.038690+0000","last_became_active":"2024-09-15T21:55:21.081667+0000","last_became_peered":"2024-09-15T21:55:21.081667+0000","last_unstale":"2024-09-15T21:55:22.038690+0000","last_undegraded":"2024-09-15T21:55:22.038690+0000","last_fullsized":"2024-09-15T21:55:22.038690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:44.705672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484114+0000","last_change":"2024-09-15T21:55:21.081320+0000","last_active":"2024-09-15T21:55:22.484114+0000","last_peered":"2024-09-15T21:55:22.484114+0000","last_clean":"2024-09-15T21:55:22.484114+0000","last_became_active":"2024-09-15T21:55:21.080501+0000","last_became_peered":"2024-09-15T21:55:21.080501+0000","last_unstale":"2024-09-15T21:55:22.484114+0000","last_undegraded":"2024-09-15T21:55:22.484114+0000","last_fullsized":"2024-09-15T21:55:22.484114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:24.528185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038584+0000","last_change":"2024-09-15T21:55:21.085688+0000","last_active":"2024-09-15T21:55:22.038584+0000","last_peered":"2024-09-15T21:55:22.038584+0000","last_clean":"2024-09-15T21:55:22.038584+0000","last_became_active":"2024-09-15T21:55:21.085166+0000","last_became_peered":"2024-09-15T21:55:21.085166+0000","last_unstale":"2024-09-15T21:55:22.038584+0000","last_undegraded":"2024-09-15T21:55:22.038584+0000","last_fullsized":"2024-09-15T21:55:22.038584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:56.272087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483929+0000","last_change":"2024-09-15T21:55:21.081625+0000","last_active":"2024-09-15T21:55:22.483929+0000","last_peered":"2024-09-15T21:55:22.483929+0000","last_clean":"2024-09-15T21:55:22.483929+0000","last_became_active":"2024-09-15T21:55:21.081233+0000","last_became_peered":"2024-09-15T21:55:21.081233+0000","last_unstale":"2024-09-15T21:55:22.483929+0000","last_undegraded":"2024-09-15T21:55:22.483929+0000","last_fullsized":"2024-09-15T21:55:22.483929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:56.638597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482172+0000","last_change":"2024-09-15T21:55:21.084462+0000","last_active":"2024-09-15T21:55:22.482172+0000","last_peered":"2024-09-15T21:55:22.482172+0000","last_clean":"2024-09-15T21:55:22.482172+0000","last_became_active":"2024-09-15T21:55:21.083916+0000","last_became_peered":"2024-09-15T21:55:21.083916+0000","last_unstale":"2024-09-15T21:55:22.482172+0000","last_undegraded":"2024-09-15T21:55:22.482172+0000","last_fullsized":"2024-09-15T21:55:22.482172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:29.617932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485001+0000","last_change":"2024-09-15T21:55:21.094131+0000","last_active":"2024-09-15T21:55:22.485001+0000","last_peered":"2024-09-15T21:55:22.485001+0000","last_clean":"2024-09-15T21:55:22.485001+0000","last_became_active":"2024-09-15T21:55:21.093635+0000","last_became_peered":"2024-09-15T21:55:21.093635+0000","last_unstale":"2024-09-15T21:55:22.485001+0000","last_undegraded":"2024-09-15T21:55:22.485001+0000","last_fullsized":"2024-09-15T21:55:22.485001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.303590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038217+0000","last_change":"2024-09-15T21:55:21.084425+0000","last_active":"2024-09-15T21:55:22.038217+0000","last_peered":"2024-09-15T21:55:22.038217+0000","last_clean":"2024-09-15T21:55:22.038217+0000","last_became_active":"2024-09-15T21:55:21.083265+0000","last_became_peered":"2024-09-15T21:55:21.083265+0000","last_unstale":"2024-09-15T21:55:22.038217+0000","last_undegraded":"2024-09-15T21:55:22.038217+0000","last_fullsized":"2024-09-15T21:55:22.038217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037906+0000","last_change":"2024-09-15T21:55:21.085602+0000","last_active":"2024-09-15T21:55:22.037906+0000","last_peered":"2024-09-15T21:55:22.037906+0000","last_clean":"2024-09-15T21:55:22.037906+0000","last_became_active":"2024-09-15T21:55:21.085179+0000","last_became_peered":"2024-09-15T21:55:21.085179+0000","last_unstale":"2024-09-15T21:55:22.037906+0000","last_undegraded":"2024-09-15T21:55:22.037906+0000","last_fullsized":"2024-09-15T21:55:22.037906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:18:48.546913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472313+0000","last_change":"2024-09-15T21:55:21.073952+0000","last_active":"2024-09-15T21:55:22.472313+0000","last_peered":"2024-09-15T21:55:22.472313+0000","last_clean":"2024-09-15T21:55:22.472313+0000","last_became_active":"2024-09-15T21:55:21.066880+0000","last_became_peered":"2024-09-15T21:55:21.066880+0000","last_unstale":"2024-09-15T21:55:22.472313+0000","last_undegraded":"2024-09-15T21:55:22.472313+0000","last_fullsized":"2024-09-15T21:55:22.472313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:04.142503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483336+0000","last_change":"2024-09-15T21:55:21.055609+0000","last_active":"2024-09-15T21:55:22.483336+0000","last_peered":"2024-09-15T21:55:22.483336+0000","last_clean":"2024-09-15T21:55:22.483336+0000","last_became_active":"2024-09-15T21:55:21.055327+0000","last_became_peered":"2024-09-15T21:55:21.055327+0000","last_unstale":"2024-09-15T21:55:22.483336+0000","last_undegraded":"2024-09-15T21:55:22.483336+0000","last_fullsized":"2024-09-15T21:55:22.483336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483575+0000","last_change":"2024-09-15T21:55:21.051382+0000","last_active":"2024-09-15T21:55:22.483575+0000","last_peered":"2024-09-15T21:55:22.483575+0000","last_clean":"2024-09-15T21:55:22.483575+0000","last_became_active":"2024-09-15T21:55:21.048576+0000","last_became_peered":"2024-09-15T21:55:21.048576+0000","last_unstale":"2024-09-15T21:55:22.483575+0000","last_undegraded":"2024-09-15T21:55:22.483575+0000","last_fullsized":"2024-09-15T21:55:22.483575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:32.450086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034843+0000","last_change":"2024-09-15T21:55:21.065866+0000","last_active":"2024-09-15T21:55:22.034843+0000","last_peered":"2024-09-15T21:55:22.034843+0000","last_clean":"2024-09-15T21:55:22.034843+0000","last_became_active":"2024-09-15T21:55:21.065546+0000","last_became_peered":"2024-09-15T21:55:21.065546+0000","last_unstale":"2024-09-15T21:55:22.034843+0000","last_undegraded":"2024-09-15T21:55:22.034843+0000","last_fullsized":"2024-09-15T21:55:22.034843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038027+0000","last_change":"2024-09-15T21:55:21.078929+0000","last_active":"2024-09-15T21:55:22.038027+0000","last_peered":"2024-09-15T21:55:22.038027+0000","last_clean":"2024-09-15T21:55:22.038027+0000","last_became_active":"2024-09-15T21:55:21.078505+0000","last_became_peered":"2024-09-15T21:55:21.078505+0000","last_unstale":"2024-09-15T21:55:22.038027+0000","last_undegraded":"2024-09-15T21:55:22.038027+0000","last_fullsized":"2024-09-15T21:55:22.038027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.040153+0000","last_change":"2024-09-15T21:55:21.093592+0000","last_active":"2024-09-15T21:55:22.040153+0000","last_peered":"2024-09-15T21:55:22.040153+0000","last_clean":"2024-09-15T21:55:22.040153+0000","last_became_active":"2024-09-15T21:55:21.092961+0000","last_became_peered":"2024-09-15T21:55:21.092961+0000","last_unstale":"2024-09-15T21:55:22.040153+0000","last_undegraded":"2024-09-15T21:55:22.040153+0000","last_fullsized":"2024-09-15T21:55:22.040153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:43.789664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.225030+0000","last_change":"2024-09-15T21:55:21.056138+0000","last_active":"2024-09-15T21:55:22.225030+0000","last_peered":"2024-09-15T21:55:22.225030+0000","last_clean":"2024-09-15T21:55:22.225030+0000","last_became_active":"2024-09-15T21:55:21.055873+0000","last_became_peered":"2024-09-15T21:55:21.055873+0000","last_unstale":"2024-09-15T21:55:22.225030+0000","last_undegraded":"2024-09-15T21:55:22.225030+0000","last_fullsized":"2024-09-15T21:55:22.225030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:11.494691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484459+0000","last_change":"2024-09-15T21:55:21.088654+0000","last_active":"2024-09-15T21:55:22.484459+0000","last_peered":"2024-09-15T21:55:22.484459+0000","last_clean":"2024-09-15T21:55:22.484459+0000","last_became_active":"2024-09-15T21:55:21.087902+0000","last_became_peered":"2024-09-15T21:55:21.087902+0000","last_unstale":"2024-09-15T21:55:22.484459+0000","last_undegraded":"2024-09-15T21:55:22.484459+0000","last_fullsized":"2024-09-15T21:55:22.484459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:40.823067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038235+0000","last_change":"2024-09-15T21:55:21.069269+0000","last_active":"2024-09-15T21:55:22.038235+0000","last_peered":"2024-09-15T21:55:22.038235+0000","last_clean":"2024-09-15T21:55:22.038235+0000","last_became_active":"2024-09-15T21:55:21.066006+0000","last_became_peered":"2024-09-15T21:55:21.066006+0000","last_unstale":"2024-09-15T21:55:22.038235+0000","last_undegraded":"2024-09-15T21:55:22.038235+0000","last_fullsized":"2024-09-15T21:55:22.038235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484203+0000","last_change":"2024-09-15T21:55:21.080185+0000","last_active":"2024-09-15T21:55:22.484203+0000","last_peered":"2024-09-15T21:55:22.484203+0000","last_clean":"2024-09-15T21:55:22.484203+0000","last_became_active":"2024-09-15T21:55:21.079797+0000","last_became_peered":"2024-09-15T21:55:21.079797+0000","last_unstale":"2024-09-15T21:55:22.484203+0000","last_undegraded":"2024-09-15T21:55:22.484203+0000","last_fullsized":"2024-09-15T21:55:22.484203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:29.713894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039100+0000","last_change":"2024-09-15T21:55:21.093516+0000","last_active":"2024-09-15T21:55:22.039100+0000","last_peered":"2024-09-15T21:55:22.039100+0000","last_clean":"2024-09-15T21:55:22.039100+0000","last_became_active":"2024-09-15T21:55:21.092809+0000","last_became_peered":"2024-09-15T21:55:21.092809+0000","last_unstale":"2024-09-15T21:55:22.039100+0000","last_undegraded":"2024-09-15T21:55:22.039100+0000","last_fullsized":"2024-09-15T21:55:22.039100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:16:19.534444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482533+0000","last_change":"2024-09-15T21:55:21.064761+0000","last_active":"2024-09-15T21:55:22.482533+0000","last_peered":"2024-09-15T21:55:22.482533+0000","last_clean":"2024-09-15T21:55:22.482533+0000","last_became_active":"2024-09-15T21:55:21.064423+0000","last_became_peered":"2024-09-15T21:55:21.064423+0000","last_unstale":"2024-09-15T21:55:22.482533+0000","last_undegraded":"2024-09-15T21:55:22.482533+0000","last_fullsized":"2024-09-15T21:55:22.482533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:45.407449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037768+0000","last_change":"2024-09-15T21:55:21.076934+0000","last_active":"2024-09-15T21:55:22.037768+0000","last_peered":"2024-09-15T21:55:22.037768+0000","last_clean":"2024-09-15T21:55:22.037768+0000","last_became_active":"2024-09-15T21:55:21.076405+0000","last_became_peered":"2024-09-15T21:55:21.076405+0000","last_unstale":"2024-09-15T21:55:22.037768+0000","last_undegraded":"2024-09-15T21:55:22.037768+0000","last_fullsized":"2024-09-15T21:55:22.037768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484840+0000","last_change":"2024-09-15T21:55:21.060381+0000","last_active":"2024-09-15T21:55:22.484840+0000","last_peered":"2024-09-15T21:55:22.484840+0000","last_clean":"2024-09-15T21:55:22.484840+0000","last_became_active":"2024-09-15T21:55:21.059955+0000","last_became_peered":"2024-09-15T21:55:21.059955+0000","last_unstale":"2024-09-15T21:55:22.484840+0000","last_undegraded":"2024-09-15T21:55:22.484840+0000","last_fullsized":"2024-09-15T21:55:22.484840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:23:53.907941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038576+0000","last_change":"2024-09-15T21:55:21.083854+0000","last_active":"2024-09-15T21:55:22.038576+0000","last_peered":"2024-09-15T21:55:22.038576+0000","last_clean":"2024-09-15T21:55:22.038576+0000","last_became_active":"2024-09-15T21:55:21.082344+0000","last_became_peered":"2024-09-15T21:55:21.082344+0000","last_unstale":"2024-09-15T21:55:22.038576+0000","last_undegraded":"2024-09-15T21:55:22.038576+0000","last_fullsized":"2024-09-15T21:55:22.038576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:56.272087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034198+0000","last_change":"2024-09-15T21:55:21.040261+0000","last_active":"2024-09-15T21:55:22.034198+0000","last_peered":"2024-09-15T21:55:22.034198+0000","last_clean":"2024-09-15T21:55:22.034198+0000","last_became_active":"2024-09-15T21:55:21.039750+0000","last_became_peered":"2024-09-15T21:55:21.039750+0000","last_unstale":"2024-09-15T21:55:22.034198+0000","last_undegraded":"2024-09-15T21:55:22.034198+0000","last_fullsized":"2024-09-15T21:55:22.034198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:29.713894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483285+0000","last_change":"2024-09-15T21:55:21.058179+0000","last_active":"2024-09-15T21:55:22.483285+0000","last_peered":"2024-09-15T21:55:22.483285+0000","last_clean":"2024-09-15T21:55:22.483285+0000","last_became_active":"2024-09-15T21:55:21.057921+0000","last_became_peered":"2024-09-15T21:55:21.057921+0000","last_unstale":"2024-09-15T21:55:22.483285+0000","last_undegraded":"2024-09-15T21:55:22.483285+0000","last_fullsized":"2024-09-15T21:55:22.483285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:18:48.546913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484622+0000","last_change":"2024-09-15T21:55:21.058728+0000","last_active":"2024-09-15T21:55:22.484622+0000","last_peered":"2024-09-15T21:55:22.484622+0000","last_clean":"2024-09-15T21:55:22.484622+0000","last_became_active":"2024-09-15T21:55:21.055629+0000","last_became_peered":"2024-09-15T21:55:21.055629+0000","last_unstale":"2024-09-15T21:55:22.484622+0000","last_undegraded":"2024-09-15T21:55:22.484622+0000","last_fullsized":"2024-09-15T21:55:22.484622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:03:15.769453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039201+0000","last_change":"2024-09-15T21:55:21.088771+0000","last_active":"2024-09-15T21:55:22.039201+0000","last_peered":"2024-09-15T21:55:22.039201+0000","last_clean":"2024-09-15T21:55:22.039201+0000","last_became_active":"2024-09-15T21:55:21.088101+0000","last_became_peered":"2024-09-15T21:55:21.088101+0000","last_unstale":"2024-09-15T21:55:22.039201+0000","last_undegraded":"2024-09-15T21:55:22.039201+0000","last_fullsized":"2024-09-15T21:55:22.039201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:30.828294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224741+0000","last_change":"2024-09-15T21:55:21.084544+0000","last_active":"2024-09-15T21:55:22.224741+0000","last_peered":"2024-09-15T21:55:22.224741+0000","last_clean":"2024-09-15T21:55:22.224741+0000","last_became_active":"2024-09-15T21:55:21.084180+0000","last_became_peered":"2024-09-15T21:55:21.084180+0000","last_unstale":"2024-09-15T21:55:22.224741+0000","last_undegraded":"2024-09-15T21:55:22.224741+0000","last_fullsized":"2024-09-15T21:55:22.224741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:41.953343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037174+0000","last_change":"2024-09-15T21:55:21.064821+0000","last_active":"2024-09-15T21:55:22.037174+0000","last_peered":"2024-09-15T21:55:22.037174+0000","last_clean":"2024-09-15T21:55:22.037174+0000","last_became_active":"2024-09-15T21:55:21.063988+0000","last_became_peered":"2024-09-15T21:55:21.063988+0000","last_unstale":"2024-09-15T21:55:22.037174+0000","last_undegraded":"2024-09-15T21:55:22.037174+0000","last_fullsized":"2024-09-15T21:55:22.037174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:29.713894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.471969+0000","last_change":"2024-09-15T21:55:21.049249+0000","last_active":"2024-09-15T21:55:22.471969+0000","last_peered":"2024-09-15T21:55:22.471969+0000","last_clean":"2024-09-15T21:55:22.471969+0000","last_became_active":"2024-09-15T21:55:21.048017+0000","last_became_peered":"2024-09-15T21:55:21.048017+0000","last_unstale":"2024-09-15T21:55:22.471969+0000","last_undegraded":"2024-09-15T21:55:22.471969+0000","last_fullsized":"2024-09-15T21:55:22.471969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:18.540720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484007+0000","last_change":"2024-09-15T21:55:20.066836+0000","last_active":"2024-09-15T21:55:22.484007+0000","last_peered":"2024-09-15T21:55:22.484007+0000","last_clean":"2024-09-15T21:55:22.484007+0000","last_became_active":"2024-09-15T21:55:20.066434+0000","last_became_peered":"2024-09-15T21:55:20.066434+0000","last_unstale":"2024-09-15T21:55:22.484007+0000","last_undegraded":"2024-09-15T21:55:22.484007+0000","last_fullsized":"2024-09-15T21:55:22.484007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484990+0000","last_change":"2024-09-15T21:55:21.052900+0000","last_active":"2024-09-15T21:55:22.484990+0000","last_peered":"2024-09-15T21:55:22.484990+0000","last_clean":"2024-09-15T21:55:22.484990+0000","last_became_active":"2024-09-15T21:55:21.052626+0000","last_became_peered":"2024-09-15T21:55:21.052626+0000","last_unstale":"2024-09-15T21:55:22.484990+0000","last_undegraded":"2024-09-15T21:55:22.484990+0000","last_fullsized":"2024-09-15T21:55:22.484990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:18:48.546913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037269+0000","last_change":"2024-09-15T21:55:20.049677+0000","last_active":"2024-09-15T21:55:22.037269+0000","last_peered":"2024-09-15T21:55:22.037269+0000","last_clean":"2024-09-15T21:55:22.037269+0000","last_became_active":"2024-09-15T21:55:20.046329+0000","last_became_peered":"2024-09-15T21:55:20.046329+0000","last_unstale":"2024-09-15T21:55:22.037269+0000","last_undegraded":"2024-09-15T21:55:22.037269+0000","last_fullsized":"2024-09-15T21:55:22.037269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:06.723350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482810+0000","last_change":"2024-09-15T21:55:20.056808+0000","last_active":"2024-09-15T21:55:22.482810+0000","last_peered":"2024-09-15T21:55:22.482810+0000","last_clean":"2024-09-15T21:55:22.482810+0000","last_became_active":"2024-09-15T21:55:20.055774+0000","last_became_peered":"2024-09-15T21:55:20.055774+0000","last_unstale":"2024-09-15T21:55:22.482810+0000","last_undegraded":"2024-09-15T21:55:22.482810+0000","last_fullsized":"2024-09-15T21:55:22.482810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:46.832251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482375+0000","last_change":"2024-09-15T21:55:21.059850+0000","last_active":"2024-09-15T21:55:22.482375+0000","last_peered":"2024-09-15T21:55:22.482375+0000","last_clean":"2024-09-15T21:55:22.482375+0000","last_became_active":"2024-09-15T21:55:21.059522+0000","last_became_peered":"2024-09-15T21:55:21.059522+0000","last_unstale":"2024-09-15T21:55:22.482375+0000","last_undegraded":"2024-09-15T21:55:22.482375+0000","last_fullsized":"2024-09-15T21:55:22.482375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:29.713894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038023+0000","last_change":"2024-09-15T21:55:20.052880+0000","last_active":"2024-09-15T21:55:22.038023+0000","last_peered":"2024-09-15T21:55:22.038023+0000","last_clean":"2024-09-15T21:55:22.038023+0000","last_became_active":"2024-09-15T21:55:20.052076+0000","last_became_peered":"2024-09-15T21:55:20.052076+0000","last_unstale":"2024-09-15T21:55:22.038023+0000","last_undegraded":"2024-09-15T21:55:22.038023+0000","last_fullsized":"2024-09-15T21:55:22.038023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.202000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034540+0000","last_change":"2024-09-15T21:55:21.040018+0000","last_active":"2024-09-15T21:55:22.034540+0000","last_peered":"2024-09-15T21:55:22.034540+0000","last_clean":"2024-09-15T21:55:22.034540+0000","last_became_active":"2024-09-15T21:55:21.039694+0000","last_became_peered":"2024-09-15T21:55:21.039694+0000","last_unstale":"2024-09-15T21:55:22.034540+0000","last_undegraded":"2024-09-15T21:55:22.034540+0000","last_fullsized":"2024-09-15T21:55:22.034540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:18:48.546913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037585+0000","last_change":"2024-09-15T21:55:20.054769+0000","last_active":"2024-09-15T21:55:22.037585+0000","last_peered":"2024-09-15T21:55:22.037585+0000","last_clean":"2024-09-15T21:55:22.037585+0000","last_became_active":"2024-09-15T21:55:20.053983+0000","last_became_peered":"2024-09-15T21:55:20.053983+0000","last_unstale":"2024-09-15T21:55:22.037585+0000","last_undegraded":"2024-09-15T21:55:22.037585+0000","last_fullsized":"2024-09-15T21:55:22.037585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:03.132039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.040113+0000","last_change":"2024-09-15T21:55:21.093104+0000","last_active":"2024-09-15T21:55:22.040113+0000","last_peered":"2024-09-15T21:55:22.040113+0000","last_clean":"2024-09-15T21:55:22.040113+0000","last_became_active":"2024-09-15T21:55:21.092699+0000","last_became_peered":"2024-09-15T21:55:21.092699+0000","last_unstale":"2024-09-15T21:55:22.040113+0000","last_undegraded":"2024-09-15T21:55:22.040113+0000","last_fullsized":"2024-09-15T21:55:22.040113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:03.817824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.040096+0000","last_change":"2024-09-15T21:55:20.055173+0000","last_active":"2024-09-15T21:55:22.040096+0000","last_peered":"2024-09-15T21:55:22.040096+0000","last_clean":"2024-09-15T21:55:22.040096+0000","last_became_active":"2024-09-15T21:55:20.054689+0000","last_became_peered":"2024-09-15T21:55:20.054689+0000","last_unstale":"2024-09-15T21:55:22.040096+0000","last_undegraded":"2024-09-15T21:55:22.040096+0000","last_fullsized":"2024-09-15T21:55:22.040096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:06.723350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485031+0000","last_change":"2024-09-15T21:55:21.077556+0000","last_active":"2024-09-15T21:55:22.485031+0000","last_peered":"2024-09-15T21:55:22.485031+0000","last_clean":"2024-09-15T21:55:22.485031+0000","last_became_active":"2024-09-15T21:55:21.077268+0000","last_became_peered":"2024-09-15T21:55:21.077268+0000","last_unstale":"2024-09-15T21:55:22.485031+0000","last_undegraded":"2024-09-15T21:55:22.485031+0000","last_fullsized":"2024-09-15T21:55:22.485031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034287+0000","last_change":"2024-09-15T21:55:20.054045+0000","last_active":"2024-09-15T21:55:22.034287+0000","last_peered":"2024-09-15T21:55:22.034287+0000","last_clean":"2024-09-15T21:55:22.034287+0000","last_became_active":"2024-09-15T21:55:20.053600+0000","last_became_peered":"2024-09-15T21:55:20.053600+0000","last_unstale":"2024-09-15T21:55:22.034287+0000","last_undegraded":"2024-09-15T21:55:22.034287+0000","last_fullsized":"2024-09-15T21:55:22.034287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:03.132039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472660+0000","last_change":"2024-09-15T21:55:21.089526+0000","last_active":"2024-09-15T21:55:22.472660+0000","last_peered":"2024-09-15T21:55:22.472660+0000","last_clean":"2024-09-15T21:55:22.472660+0000","last_became_active":"2024-09-15T21:55:21.088932+0000","last_became_peered":"2024-09-15T21:55:21.088932+0000","last_unstale":"2024-09-15T21:55:22.472660+0000","last_undegraded":"2024-09-15T21:55:22.472660+0000","last_fullsized":"2024-09-15T21:55:22.472660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:25.194521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038442+0000","last_change":"2024-09-15T21:55:20.053664+0000","last_active":"2024-09-15T21:55:22.038442+0000","last_peered":"2024-09-15T21:55:22.038442+0000","last_clean":"2024-09-15T21:55:22.038442+0000","last_became_active":"2024-09-15T21:55:20.051430+0000","last_became_peered":"2024-09-15T21:55:20.051430+0000","last_unstale":"2024-09-15T21:55:22.038442+0000","last_undegraded":"2024-09-15T21:55:22.038442+0000","last_fullsized":"2024-09-15T21:55:22.038442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:17.530256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483958+0000","last_change":"2024-09-15T21:55:21.081085+0000","last_active":"2024-09-15T21:55:22.483958+0000","last_peered":"2024-09-15T21:55:22.483958+0000","last_clean":"2024-09-15T21:55:22.483958+0000","last_became_active":"2024-09-15T21:55:21.080302+0000","last_became_peered":"2024-09-15T21:55:21.080302+0000","last_unstale":"2024-09-15T21:55:22.483958+0000","last_undegraded":"2024-09-15T21:55:22.483958+0000","last_fullsized":"2024-09-15T21:55:22.483958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:35.161272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485141+0000","last_change":"2024-09-15T21:55:20.050298+0000","last_active":"2024-09-15T21:55:22.485141+0000","last_peered":"2024-09-15T21:55:22.485141+0000","last_clean":"2024-09-15T21:55:22.485141+0000","last_became_active":"2024-09-15T21:55:20.049086+0000","last_became_peered":"2024-09-15T21:55:20.049086+0000","last_unstale":"2024-09-15T21:55:22.485141+0000","last_undegraded":"2024-09-15T21:55:22.485141+0000","last_fullsized":"2024-09-15T21:55:22.485141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484009+0000","last_change":"2024-09-15T21:55:21.079944+0000","last_active":"2024-09-15T21:55:22.484009+0000","last_peered":"2024-09-15T21:55:22.484009+0000","last_clean":"2024-09-15T21:55:22.484009+0000","last_became_active":"2024-09-15T21:55:21.079703+0000","last_became_peered":"2024-09-15T21:55:21.079703+0000","last_unstale":"2024-09-15T21:55:22.484009+0000","last_undegraded":"2024-09-15T21:55:22.484009+0000","last_fullsized":"2024-09-15T21:55:22.484009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:17.369451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039261+0000","last_change":"2024-09-15T21:55:20.067348+0000","last_active":"2024-09-15T21:55:22.039261+0000","last_peered":"2024-09-15T21:55:22.039261+0000","last_clean":"2024-09-15T21:55:22.039261+0000","last_became_active":"2024-09-15T21:55:20.066912+0000","last_became_peered":"2024-09-15T21:55:20.066912+0000","last_unstale":"2024-09-15T21:55:22.039261+0000","last_undegraded":"2024-09-15T21:55:22.039261+0000","last_fullsized":"2024-09-15T21:55:22.039261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:03.132039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484340+0000","last_change":"2024-09-15T21:55:21.092869+0000","last_active":"2024-09-15T21:55:22.484340+0000","last_peered":"2024-09-15T21:55:22.484340+0000","last_clean":"2024-09-15T21:55:22.484340+0000","last_became_active":"2024-09-15T21:55:21.092360+0000","last_became_peered":"2024-09-15T21:55:21.092360+0000","last_unstale":"2024-09-15T21:55:22.484340+0000","last_undegraded":"2024-09-15T21:55:22.484340+0000","last_fullsized":"2024-09-15T21:55:22.484340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:08.584649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037252+0000","last_change":"2024-09-15T21:55:20.046741+0000","last_active":"2024-09-15T21:55:22.037252+0000","last_peered":"2024-09-15T21:55:22.037252+0000","last_clean":"2024-09-15T21:55:22.037252+0000","last_became_active":"2024-09-15T21:55:20.044504+0000","last_became_peered":"2024-09-15T21:55:20.044504+0000","last_unstale":"2024-09-15T21:55:22.037252+0000","last_undegraded":"2024-09-15T21:55:22.037252+0000","last_fullsized":"2024-09-15T21:55:22.037252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.202000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037581+0000","last_change":"2024-09-15T21:55:21.065198+0000","last_active":"2024-09-15T21:55:22.037581+0000","last_peered":"2024-09-15T21:55:22.037581+0000","last_clean":"2024-09-15T21:55:22.037581+0000","last_became_active":"2024-09-15T21:55:21.064290+0000","last_became_peered":"2024-09-15T21:55:21.064290+0000","last_unstale":"2024-09-15T21:55:22.037581+0000","last_undegraded":"2024-09-15T21:55:22.037581+0000","last_fullsized":"2024-09-15T21:55:22.037581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:03:15.769453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224516+0000","last_change":"2024-09-15T21:55:20.045879+0000","last_active":"2024-09-15T21:55:22.224516+0000","last_peered":"2024-09-15T21:55:22.224516+0000","last_clean":"2024-09-15T21:55:22.224516+0000","last_became_active":"2024-09-15T21:55:20.045166+0000","last_became_peered":"2024-09-15T21:55:20.045166+0000","last_unstale":"2024-09-15T21:55:22.224516+0000","last_undegraded":"2024-09-15T21:55:22.224516+0000","last_fullsized":"2024-09-15T21:55:22.224516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:27.871582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484582+0000","last_change":"2024-09-15T21:55:21.091543+0000","last_active":"2024-09-15T21:55:22.484582+0000","last_peered":"2024-09-15T21:55:22.484582+0000","last_clean":"2024-09-15T21:55:22.484582+0000","last_became_active":"2024-09-15T21:55:21.088040+0000","last_became_peered":"2024-09-15T21:55:21.088040+0000","last_unstale":"2024-09-15T21:55:22.484582+0000","last_undegraded":"2024-09-15T21:55:22.484582+0000","last_fullsized":"2024-09-15T21:55:22.484582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:58.437513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472663+0000","last_change":"2024-09-15T21:55:20.060882+0000","last_active":"2024-09-15T21:55:22.472663+0000","last_peered":"2024-09-15T21:55:22.472663+0000","last_clean":"2024-09-15T21:55:22.472663+0000","last_became_active":"2024-09-15T21:55:20.059856+0000","last_became_peered":"2024-09-15T21:55:20.059856+0000","last_unstale":"2024-09-15T21:55:22.472663+0000","last_undegraded":"2024-09-15T21:55:22.472663+0000","last_fullsized":"2024-09-15T21:55:22.472663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484517+0000","last_change":"2024-09-15T21:55:21.088545+0000","last_active":"2024-09-15T21:55:22.484517+0000","last_peered":"2024-09-15T21:55:22.484517+0000","last_clean":"2024-09-15T21:55:22.484517+0000","last_became_active":"2024-09-15T21:55:21.080729+0000","last_became_peered":"2024-09-15T21:55:21.080729+0000","last_unstale":"2024-09-15T21:55:22.484517+0000","last_undegraded":"2024-09-15T21:55:22.484517+0000","last_fullsized":"2024-09-15T21:55:22.484517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:10.451575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224968+0000","last_change":"2024-09-15T21:55:20.053774+0000","last_active":"2024-09-15T21:55:22.224968+0000","last_peered":"2024-09-15T21:55:22.224968+0000","last_clean":"2024-09-15T21:55:22.224968+0000","last_became_active":"2024-09-15T21:55:20.053417+0000","last_became_peered":"2024-09-15T21:55:20.053417+0000","last_unstale":"2024-09-15T21:55:22.224968+0000","last_undegraded":"2024-09-15T21:55:22.224968+0000","last_fullsized":"2024-09-15T21:55:22.224968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:42:50.046558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484974+0000","last_change":"2024-09-15T21:55:21.088812+0000","last_active":"2024-09-15T21:55:22.484974+0000","last_peered":"2024-09-15T21:55:22.484974+0000","last_clean":"2024-09-15T21:55:22.484974+0000","last_became_active":"2024-09-15T21:55:21.088403+0000","last_became_peered":"2024-09-15T21:55:21.088403+0000","last_unstale":"2024-09-15T21:55:22.484974+0000","last_undegraded":"2024-09-15T21:55:22.484974+0000","last_fullsized":"2024-09-15T21:55:22.484974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:53:46.896732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034408+0000","last_change":"2024-09-15T21:55:20.049155+0000","last_active":"2024-09-15T21:55:22.034408+0000","last_peered":"2024-09-15T21:55:22.034408+0000","last_clean":"2024-09-15T21:55:22.034408+0000","last_became_active":"2024-09-15T21:55:20.048758+0000","last_became_peered":"2024-09-15T21:55:20.048758+0000","last_unstale":"2024-09-15T21:55:22.034408+0000","last_undegraded":"2024-09-15T21:55:22.034408+0000","last_fullsized":"2024-09-15T21:55:22.034408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:26.853149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039043+0000","last_change":"2024-09-15T21:55:21.080373+0000","last_active":"2024-09-15T21:55:22.039043+0000","last_peered":"2024-09-15T21:55:22.039043+0000","last_clean":"2024-09-15T21:55:22.039043+0000","last_became_active":"2024-09-15T21:55:21.079654+0000","last_became_peered":"2024-09-15T21:55:21.079654+0000","last_unstale":"2024-09-15T21:55:22.039043+0000","last_undegraded":"2024-09-15T21:55:22.039043+0000","last_fullsized":"2024-09-15T21:55:22.039043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:51.738245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224802+0000","last_change":"2024-09-15T21:55:20.057638+0000","last_active":"2024-09-15T21:55:22.224802+0000","last_peered":"2024-09-15T21:55:22.224802+0000","last_clean":"2024-09-15T21:55:22.224802+0000","last_became_active":"2024-09-15T21:55:20.057104+0000","last_became_peered":"2024-09-15T21:55:20.057104+0000","last_unstale":"2024-09-15T21:55:22.224802+0000","last_undegraded":"2024-09-15T21:55:22.224802+0000","last_fullsized":"2024-09-15T21:55:22.224802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:46.407918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484034+0000","last_change":"2024-09-15T21:55:21.092764+0000","last_active":"2024-09-15T21:55:22.484034+0000","last_peered":"2024-09-15T21:55:22.484034+0000","last_clean":"2024-09-15T21:55:22.484034+0000","last_became_active":"2024-09-15T21:55:21.092278+0000","last_became_peered":"2024-09-15T21:55:21.092278+0000","last_unstale":"2024-09-15T21:55:22.484034+0000","last_undegraded":"2024-09-15T21:55:22.484034+0000","last_fullsized":"2024-09-15T21:55:22.484034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:16.853013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483633+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:22.483633+0000","last_peered":"2024-09-15T21:55:22.483633+0000","last_clean":"2024-09-15T21:55:22.483633+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:22.483633+0000","last_undegraded":"2024-09-15T21:55:22.483633+0000","last_fullsized":"2024-09-15T21:55:22.483633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038105+0000","last_change":"2024-09-15T21:55:20.062164+0000","last_active":"2024-09-15T21:55:22.038105+0000","last_peered":"2024-09-15T21:55:22.038105+0000","last_clean":"2024-09-15T21:55:22.038105+0000","last_became_active":"2024-09-15T21:55:20.061451+0000","last_became_peered":"2024-09-15T21:55:20.061451+0000","last_unstale":"2024-09-15T21:55:22.038105+0000","last_undegraded":"2024-09-15T21:55:22.038105+0000","last_fullsized":"2024-09-15T21:55:22.038105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:46.832251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483314+0000","last_change":"2024-09-15T21:55:21.093819+0000","last_active":"2024-09-15T21:55:22.483314+0000","last_peered":"2024-09-15T21:55:22.483314+0000","last_clean":"2024-09-15T21:55:22.483314+0000","last_became_active":"2024-09-15T21:55:21.093514+0000","last_became_peered":"2024-09-15T21:55:21.093514+0000","last_unstale":"2024-09-15T21:55:22.483314+0000","last_undegraded":"2024-09-15T21:55:22.483314+0000","last_fullsized":"2024-09-15T21:55:22.483314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483452+0000","last_change":"2024-09-15T21:55:20.067427+0000","last_active":"2024-09-15T21:55:22.483452+0000","last_peered":"2024-09-15T21:55:22.483452+0000","last_clean":"2024-09-15T21:55:22.483452+0000","last_became_active":"2024-09-15T21:55:20.066778+0000","last_became_peered":"2024-09-15T21:55:20.066778+0000","last_unstale":"2024-09-15T21:55:22.483452+0000","last_undegraded":"2024-09-15T21:55:22.483452+0000","last_fullsized":"2024-09-15T21:55:22.483452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:26.867497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483333+0000","last_change":"2024-09-15T21:55:21.064883+0000","last_active":"2024-09-15T21:55:22.483333+0000","last_peered":"2024-09-15T21:55:22.483333+0000","last_clean":"2024-09-15T21:55:22.483333+0000","last_became_active":"2024-09-15T21:55:21.064565+0000","last_became_peered":"2024-09-15T21:55:21.064565+0000","last_unstale":"2024-09-15T21:55:22.483333+0000","last_undegraded":"2024-09-15T21:55:22.483333+0000","last_fullsized":"2024-09-15T21:55:22.483333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:27.419646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224713+0000","last_change":"2024-09-15T21:55:20.064316+0000","last_active":"2024-09-15T21:55:22.224713+0000","last_peered":"2024-09-15T21:55:22.224713+0000","last_clean":"2024-09-15T21:55:22.224713+0000","last_became_active":"2024-09-15T21:55:20.064010+0000","last_became_peered":"2024-09-15T21:55:20.064010+0000","last_unstale":"2024-09-15T21:55:22.224713+0000","last_undegraded":"2024-09-15T21:55:22.224713+0000","last_fullsized":"2024-09-15T21:55:22.224713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:55.450682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034330+0000","last_change":"2024-09-15T21:55:21.039824+0000","last_active":"2024-09-15T21:55:22.034330+0000","last_peered":"2024-09-15T21:55:22.034330+0000","last_clean":"2024-09-15T21:55:22.034330+0000","last_became_active":"2024-09-15T21:55:21.039532+0000","last_became_peered":"2024-09-15T21:55:21.039532+0000","last_unstale":"2024-09-15T21:55:22.034330+0000","last_undegraded":"2024-09-15T21:55:22.034330+0000","last_fullsized":"2024-09-15T21:55:22.034330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:03:15.769453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039468+0000","last_change":"2024-09-15T21:55:20.053996+0000","last_active":"2024-09-15T21:55:22.039468+0000","last_peered":"2024-09-15T21:55:22.039468+0000","last_clean":"2024-09-15T21:55:22.039468+0000","last_became_active":"2024-09-15T21:55:20.053487+0000","last_became_peered":"2024-09-15T21:55:20.053487+0000","last_unstale":"2024-09-15T21:55:22.039468+0000","last_undegraded":"2024-09-15T21:55:22.039468+0000","last_fullsized":"2024-09-15T21:55:22.039468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:05.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472458+0000","last_change":"2024-09-15T21:55:21.073289+0000","last_active":"2024-09-15T21:55:22.472458+0000","last_peered":"2024-09-15T21:55:22.472458+0000","last_clean":"2024-09-15T21:55:22.472458+0000","last_became_active":"2024-09-15T21:55:21.064508+0000","last_became_peered":"2024-09-15T21:55:21.064508+0000","last_unstale":"2024-09-15T21:55:22.472458+0000","last_undegraded":"2024-09-15T21:55:22.472458+0000","last_fullsized":"2024-09-15T21:55:22.472458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:27.863613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034372+0000","last_change":"2024-09-15T21:55:20.055656+0000","last_active":"2024-09-15T21:55:22.034372+0000","last_peered":"2024-09-15T21:55:22.034372+0000","last_clean":"2024-09-15T21:55:22.034372+0000","last_became_active":"2024-09-15T21:55:20.055168+0000","last_became_peered":"2024-09-15T21:55:20.055168+0000","last_unstale":"2024-09-15T21:55:22.034372+0000","last_undegraded":"2024-09-15T21:55:22.034372+0000","last_fullsized":"2024-09-15T21:55:22.034372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:05.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039815+0000","last_change":"2024-09-15T21:55:21.079617+0000","last_active":"2024-09-15T21:55:22.039815+0000","last_peered":"2024-09-15T21:55:22.039815+0000","last_clean":"2024-09-15T21:55:22.039815+0000","last_became_active":"2024-09-15T21:55:21.078651+0000","last_became_peered":"2024-09-15T21:55:21.078651+0000","last_unstale":"2024-09-15T21:55:22.039815+0000","last_undegraded":"2024-09-15T21:55:22.039815+0000","last_fullsized":"2024-09-15T21:55:22.039815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:13.196570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484562+0000","last_change":"2024-09-15T21:55:20.067021+0000","last_active":"2024-09-15T21:55:22.484562+0000","last_peered":"2024-09-15T21:55:22.484562+0000","last_clean":"2024-09-15T21:55:22.484562+0000","last_became_active":"2024-09-15T21:55:20.066354+0000","last_became_peered":"2024-09-15T21:55:20.066354+0000","last_unstale":"2024-09-15T21:55:22.484562+0000","last_undegraded":"2024-09-15T21:55:22.484562+0000","last_fullsized":"2024-09-15T21:55:22.484562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:57.837195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034197+0000","last_change":"2024-09-15T21:55:21.043432+0000","last_active":"2024-09-15T21:55:22.034197+0000","last_peered":"2024-09-15T21:55:22.034197+0000","last_clean":"2024-09-15T21:55:22.034197+0000","last_became_active":"2024-09-15T21:55:21.043150+0000","last_became_peered":"2024-09-15T21:55:21.043150+0000","last_unstale":"2024-09-15T21:55:22.034197+0000","last_undegraded":"2024-09-15T21:55:22.034197+0000","last_fullsized":"2024-09-15T21:55:22.034197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:45.407449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034641+0000","last_change":"2024-09-15T21:55:20.051483+0000","last_active":"2024-09-15T21:55:22.034641+0000","last_peered":"2024-09-15T21:55:22.034641+0000","last_clean":"2024-09-15T21:55:22.034641+0000","last_became_active":"2024-09-15T21:55:20.051077+0000","last_became_peered":"2024-09-15T21:55:20.051077+0000","last_unstale":"2024-09-15T21:55:22.034641+0000","last_undegraded":"2024-09-15T21:55:22.034641+0000","last_fullsized":"2024-09-15T21:55:22.034641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.202000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484985+0000","last_change":"2024-09-15T21:55:21.090900+0000","last_active":"2024-09-15T21:55:22.484985+0000","last_peered":"2024-09-15T21:55:22.484985+0000","last_clean":"2024-09-15T21:55:22.484985+0000","last_became_active":"2024-09-15T21:55:21.090600+0000","last_became_peered":"2024-09-15T21:55:21.090600+0000","last_unstale":"2024-09-15T21:55:22.484985+0000","last_undegraded":"2024-09-15T21:55:22.484985+0000","last_fullsized":"2024-09-15T21:55:22.484985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:51.738245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037826+0000","last_change":"2024-09-15T21:55:20.058425+0000","last_active":"2024-09-15T21:55:22.037826+0000","last_peered":"2024-09-15T21:55:22.037826+0000","last_clean":"2024-09-15T21:55:22.037826+0000","last_became_active":"2024-09-15T21:55:20.057897+0000","last_became_peered":"2024-09-15T21:55:20.057897+0000","last_unstale":"2024-09-15T21:55:22.037826+0000","last_undegraded":"2024-09-15T21:55:22.037826+0000","last_fullsized":"2024-09-15T21:55:22.037826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:05.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485013+0000","last_change":"2024-09-15T21:55:21.055808+0000","last_active":"2024-09-15T21:55:22.485013+0000","last_peered":"2024-09-15T21:55:22.485013+0000","last_clean":"2024-09-15T21:55:22.485013+0000","last_became_active":"2024-09-15T21:55:21.054995+0000","last_became_peered":"2024-09-15T21:55:21.054995+0000","last_unstale":"2024-09-15T21:55:22.485013+0000","last_undegraded":"2024-09-15T21:55:22.485013+0000","last_fullsized":"2024-09-15T21:55:22.485013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483454+0000","last_change":"2024-09-15T21:55:20.067341+0000","last_active":"2024-09-15T21:55:22.483454+0000","last_peered":"2024-09-15T21:55:22.483454+0000","last_clean":"2024-09-15T21:55:22.483454+0000","last_became_active":"2024-09-15T21:55:20.066114+0000","last_became_peered":"2024-09-15T21:55:20.066114+0000","last_unstale":"2024-09-15T21:55:22.483454+0000","last_undegraded":"2024-09-15T21:55:22.483454+0000","last_fullsized":"2024-09-15T21:55:22.483454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:54.611870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472372+0000","last_change":"2024-09-15T21:55:21.065815+0000","last_active":"2024-09-15T21:55:22.472372+0000","last_peered":"2024-09-15T21:55:22.472372+0000","last_clean":"2024-09-15T21:55:22.472372+0000","last_became_active":"2024-09-15T21:55:21.064866+0000","last_became_peered":"2024-09-15T21:55:21.064866+0000","last_unstale":"2024-09-15T21:55:22.472372+0000","last_undegraded":"2024-09-15T21:55:22.472372+0000","last_fullsized":"2024-09-15T21:55:22.472372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:06.281118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034646+0000","last_change":"2024-09-15T21:55:20.057081+0000","last_active":"2024-09-15T21:55:22.034646+0000","last_peered":"2024-09-15T21:55:22.034646+0000","last_clean":"2024-09-15T21:55:22.034646+0000","last_became_active":"2024-09-15T21:55:20.056673+0000","last_became_peered":"2024-09-15T21:55:20.056673+0000","last_unstale":"2024-09-15T21:55:22.034646+0000","last_undegraded":"2024-09-15T21:55:22.034646+0000","last_fullsized":"2024-09-15T21:55:22.034646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:06.723350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482625+0000","last_change":"2024-09-15T21:55:21.042285+0000","last_active":"2024-09-15T21:55:22.482625+0000","last_peered":"2024-09-15T21:55:22.482625+0000","last_clean":"2024-09-15T21:55:22.482625+0000","last_became_active":"2024-09-15T21:55:21.041896+0000","last_became_peered":"2024-09-15T21:55:21.041896+0000","last_unstale":"2024-09-15T21:55:22.482625+0000","last_undegraded":"2024-09-15T21:55:22.482625+0000","last_fullsized":"2024-09-15T21:55:22.482625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:03:15.769453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034611+0000","last_change":"2024-09-15T21:55:20.053890+0000","last_active":"2024-09-15T21:55:22.034611+0000","last_peered":"2024-09-15T21:55:22.034611+0000","last_clean":"2024-09-15T21:55:22.034611+0000","last_became_active":"2024-09-15T21:55:20.053359+0000","last_became_peered":"2024-09-15T21:55:20.053359+0000","last_unstale":"2024-09-15T21:55:22.034611+0000","last_undegraded":"2024-09-15T21:55:22.034611+0000","last_fullsized":"2024-09-15T21:55:22.034611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:17.530256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483756+0000","last_change":"2024-09-15T21:55:21.060275+0000","last_active":"2024-09-15T21:55:22.483756+0000","last_peered":"2024-09-15T21:55:22.483756+0000","last_clean":"2024-09-15T21:55:22.483756+0000","last_became_active":"2024-09-15T21:55:21.059657+0000","last_became_peered":"2024-09-15T21:55:21.059657+0000","last_unstale":"2024-09-15T21:55:22.483756+0000","last_undegraded":"2024-09-15T21:55:22.483756+0000","last_fullsized":"2024-09-15T21:55:22.483756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:56.272087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484372+0000","last_change":"2024-09-15T21:55:20.066502+0000","last_active":"2024-09-15T21:55:22.484372+0000","last_peered":"2024-09-15T21:55:22.484372+0000","last_clean":"2024-09-15T21:55:22.484372+0000","last_became_active":"2024-09-15T21:55:20.066143+0000","last_became_peered":"2024-09-15T21:55:20.066143+0000","last_unstale":"2024-09-15T21:55:22.484372+0000","last_undegraded":"2024-09-15T21:55:22.484372+0000","last_fullsized":"2024-09-15T21:55:22.484372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:26.132589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037228+0000","last_change":"2024-09-15T21:55:21.056694+0000","last_active":"2024-09-15T21:55:22.037228+0000","last_peered":"2024-09-15T21:55:22.037228+0000","last_clean":"2024-09-15T21:55:22.037228+0000","last_became_active":"2024-09-15T21:55:21.055728+0000","last_became_peered":"2024-09-15T21:55:21.055728+0000","last_unstale":"2024-09-15T21:55:22.037228+0000","last_undegraded":"2024-09-15T21:55:22.037228+0000","last_fullsized":"2024-09-15T21:55:22.037228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:45.407449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039691+0000","last_change":"2024-09-15T21:55:21.083720+0000","last_active":"2024-09-15T21:55:22.039691+0000","last_peered":"2024-09-15T21:55:22.039691+0000","last_clean":"2024-09-15T21:55:22.039691+0000","last_became_active":"2024-09-15T21:55:21.083110+0000","last_became_peered":"2024-09-15T21:55:21.083110+0000","last_unstale":"2024-09-15T21:55:22.039691+0000","last_undegraded":"2024-09-15T21:55:22.039691+0000","last_fullsized":"2024-09-15T21:55:22.039691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:45:22.889914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483812+0000","last_change":"2024-09-15T21:55:20.069937+0000","last_active":"2024-09-15T21:55:22.483812+0000","last_peered":"2024-09-15T21:55:22.483812+0000","last_clean":"2024-09-15T21:55:22.483812+0000","last_became_active":"2024-09-15T21:55:20.069454+0000","last_became_peered":"2024-09-15T21:55:20.069454+0000","last_unstale":"2024-09-15T21:55:22.483812+0000","last_undegraded":"2024-09-15T21:55:22.483812+0000","last_fullsized":"2024-09-15T21:55:22.483812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:40.942879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038724+0000","last_change":"2024-09-15T21:55:21.082991+0000","last_active":"2024-09-15T21:55:22.038724+0000","last_peered":"2024-09-15T21:55:22.038724+0000","last_clean":"2024-09-15T21:55:22.038724+0000","last_became_active":"2024-09-15T21:55:21.082634+0000","last_became_peered":"2024-09-15T21:55:21.082634+0000","last_unstale":"2024-09-15T21:55:22.038724+0000","last_undegraded":"2024-09-15T21:55:22.038724+0000","last_fullsized":"2024-09-15T21:55:22.038724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:23:53.907941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484270+0000","last_change":"2024-09-15T21:55:20.068019+0000","last_active":"2024-09-15T21:55:22.484270+0000","last_peered":"2024-09-15T21:55:22.484270+0000","last_clean":"2024-09-15T21:55:22.484270+0000","last_became_active":"2024-09-15T21:55:20.067127+0000","last_became_peered":"2024-09-15T21:55:20.067127+0000","last_unstale":"2024-09-15T21:55:22.484270+0000","last_undegraded":"2024-09-15T21:55:22.484270+0000","last_fullsized":"2024-09-15T21:55:22.484270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:10.484227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484179+0000","last_change":"2024-09-15T21:55:21.091582+0000","last_active":"2024-09-15T21:55:22.484179+0000","last_peered":"2024-09-15T21:55:22.484179+0000","last_clean":"2024-09-15T21:55:22.484179+0000","last_became_active":"2024-09-15T21:55:21.091286+0000","last_became_peered":"2024-09-15T21:55:21.091286+0000","last_unstale":"2024-09-15T21:55:22.484179+0000","last_undegraded":"2024-09-15T21:55:22.484179+0000","last_fullsized":"2024-09-15T21:55:22.484179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:29.617932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484237+0000","last_change":"2024-09-15T21:55:20.055671+0000","last_active":"2024-09-15T21:55:22.484237+0000","last_peered":"2024-09-15T21:55:22.484237+0000","last_clean":"2024-09-15T21:55:22.484237+0000","last_became_active":"2024-09-15T21:55:20.054385+0000","last_became_peered":"2024-09-15T21:55:20.054385+0000","last_unstale":"2024-09-15T21:55:22.484237+0000","last_undegraded":"2024-09-15T21:55:22.484237+0000","last_fullsized":"2024-09-15T21:55:22.484237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483963+0000","last_change":"2024-09-15T21:55:21.051450+0000","last_active":"2024-09-15T21:55:22.483963+0000","last_peered":"2024-09-15T21:55:22.483963+0000","last_clean":"2024-09-15T21:55:22.483963+0000","last_became_active":"2024-09-15T21:55:21.051151+0000","last_became_peered":"2024-09-15T21:55:21.051151+0000","last_unstale":"2024-09-15T21:55:22.483963+0000","last_undegraded":"2024-09-15T21:55:22.483963+0000","last_fullsized":"2024-09-15T21:55:22.483963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:44.705672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484447+0000","last_change":"2024-09-15T21:55:20.057739+0000","last_active":"2024-09-15T21:55:22.484447+0000","last_peered":"2024-09-15T21:55:22.484447+0000","last_clean":"2024-09-15T21:55:22.484447+0000","last_became_active":"2024-09-15T21:55:20.056988+0000","last_became_peered":"2024-09-15T21:55:20.056988+0000","last_unstale":"2024-09-15T21:55:22.484447+0000","last_undegraded":"2024-09-15T21:55:22.484447+0000","last_fullsized":"2024-09-15T21:55:22.484447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":72837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":663753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:55:33.832 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:55:33.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.989+0000 7f224515b640 1 Processor -- start 2024-09-15T21:55:33.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.993+0000 7f224515b640 1 -- start start 2024-09-15T21:55:33.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.993+0000 7f224515b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f22400ae3a0 0x7f224009eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:33.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.993+0000 7f224515b640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22400b00f0 con 0x7f22400b4c50 2024-09-15T21:55:33.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.993+0000 7f224515b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22400b50e0 con 0x7f22400af160 2024-09-15T21:55:33.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.993+0000 7f224515b640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f22400afe10 con 0x7f22400ae3a0 2024-09-15T21:55:33.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.993+0000 7f223e59c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f22400b4c50 0x7f2240147ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49800/0 (socket says 172.21.15.1:49800) 2024-09-15T21:55:33.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.993+0000 7f223ed9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f22400ae3a0 0x7f224009eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:33.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.993+0000 7f223e59c640 1 -- 172.21.15.1:0/2371771751 learned_addr learned my addr 172.21.15.1:0/2371771751 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:33.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.993+0000 7f223dd9b640 1 -- 172.21.15.1:0/2371771751 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 150053567 0 0) 0x7f22400b00f0 con 0x7f22400b4c50 2024-09-15T21:55:33.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.993+0000 7f223dd9b640 1 -- 172.21.15.1:0/2371771751 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2228005740 con 0x7f22400b4c50 2024-09-15T21:55:33.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.993+0000 7f223ed9d640 1 -- 172.21.15.1:0/2371771751 >> v1:172.21.15.70:6789/0 conn(0x7f22400af160 legacy=0x7f224014eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.993+0000 7f223ed9d640 1 -- 172.21.15.1:0/2371771751 >> v1:172.21.15.1:6789/0 conn(0x7f22400b4c50 legacy=0x7f2240147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:33.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.993+0000 7f223ed9d640 1 -- 172.21.15.1:0/2371771751 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22400b53c0 con 0x7f22400ae3a0 2024-09-15T21:55:34.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223ed9d640 1 --2- 172.21.15.1:0/2371771751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22400ae3a0 0x7f224009eb50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f22300097c0 tx=0x7f223001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78045250e76101c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:34.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223dd9b640 1 -- 172.21.15.1:0/2371771751 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22300b0070 con 0x7f22400ae3a0 2024-09-15T21:55:34.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223dd9b640 1 -- 172.21.15.1:0/2371771751 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22300ab600 con 0x7f22400ae3a0 2024-09-15T21:55:34.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223dd9b640 1 -- 172.21.15.1:0/2371771751 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22300ab9b0 con 0x7f22400ae3a0 2024-09-15T21:55:34.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 -- 172.21.15.1:0/2371771751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22400ae3a0 msgr2=0x7f224009eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 --2- 172.21.15.1:0/2371771751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22400ae3a0 0x7f224009eb50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f22300097c0 tx=0x7f223001c3e0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 -- 172.21.15.1:0/2371771751 shutdown_connections 2024-09-15T21:55:34.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 --2- 172.21.15.1:0/2371771751 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22400ae3a0 0x7f224009eb50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 -- 172.21.15.1:0/2371771751 >> 172.21.15.1:0/2371771751 conn(0x7f22400b5c40 msgr2=0x7f22400b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:34.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 -- 172.21.15.1:0/2371771751 shutdown_connections 2024-09-15T21:55:34.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 -- 172.21.15.1:0/2371771751 wait complete. 2024-09-15T21:55:34.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 Processor -- start 2024-09-15T21:55:34.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 -- start start 2024-09-15T21:55:34.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22400ae3a0 0x7f22400b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f22400af160 0x7f2240147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22401e0e30 0x7f224014f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f22400b46e0 con 0x7f22401e0e30 2024-09-15T21:55:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f22400b4560 con 0x7f22400ae3a0 2024-09-15T21:55:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f22400b4860 con 0x7f22400af160 2024-09-15T21:55:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223f59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22401e0e30 0x7f224014f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223f59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22401e0e30 0x7f224014f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60638/0 (socket says 172.21.15.1:60638) 2024-09-15T21:55:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223f59e640 1 -- 172.21.15.1:0/2799692888 learned_addr learned my addr 172.21.15.1:0/2799692888 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223ed9d640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22400ae3a0 0x7f22400b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223e59c640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f22400af160 0x7f2240147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223f59e640 1 -- 172.21.15.1:0/2799692888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f22400af160 msgr2=0x7f2240147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223f59e640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f22400af160 0x7f2240147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223f59e640 1 -- 172.21.15.1:0/2799692888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22400ae3a0 msgr2=0x7f22400b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223f59e640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22400ae3a0 0x7f22400b75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223f59e640 1 -- 172.21.15.1:0/2799692888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22401e0350 con 0x7f22401e0e30 2024-09-15T21:55:34.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223ed9d640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22400ae3a0 0x7f22400b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:34.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f223f59e640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22401e0e30 0x7f224014f380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f223800c7a0 tx=0x7f223800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:34.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f22277fe640 1 -- 172.21.15.1:0/2799692888 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238003b80 con 0x7f22401e0e30 2024-09-15T21:55:34.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f22277fe640 1 -- 172.21.15.1:0/2799692888 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2238003d20 con 0x7f22401e0e30 2024-09-15T21:55:34.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 -- 172.21.15.1:0/2799692888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22401e0630 con 0x7f22401e0e30 2024-09-15T21:55:34.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f22277fe640 1 -- 172.21.15.1:0/2799692888 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223800aa30 con 0x7f22401e0e30 2024-09-15T21:55:34.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:33.997+0000 7f224515b640 1 -- 172.21.15.1:0/2799692888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f224013a020 con 0x7f22401e0e30 2024-09-15T21:55:34.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.001+0000 7f224515b640 1 -- 172.21.15.1:0/2799692888 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f224009eb50 con 0x7f22401e0e30 2024-09-15T21:55:34.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.001+0000 7f22277fe640 1 -- 172.21.15.1:0/2799692888 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f223800abd0 con 0x7f22401e0e30 2024-09-15T21:55:34.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.001+0000 7f22277fe640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f222c0678c0 0x7f222c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.001+0000 7f22277fe640 1 -- 172.21.15.1:0/2799692888 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2238085c20 con 0x7f22401e0e30 2024-09-15T21:55:34.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.001+0000 7f223ed9d640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f222c0678c0 0x7f222c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.001+0000 7f223ed9d640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f222c0678c0 0x7f222c069d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22300ad000 tx=0x7f22300a4f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:34.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.005+0000 7f22277fe640 1 -- 172.21.15.1:0/2799692888 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2238056750 con 0x7f22401e0e30 2024-09-15T21:55:34.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.157+0000 7f224515b640 1 -- 172.21.15.1:0/2799692888 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22400b8cc0 con 0x7f222c0678c0 2024-09-15T21:55:34.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.169+0000 7f22277fe640 1 -- 172.21.15.1:0/2799692888 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f22400b8cc0 con 0x7f222c0678c0 2024-09-15T21:55:34.176 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:34.178 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:55:34.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.173+0000 7f224515b640 1 -- 172.21.15.1:0/2799692888 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f222c0678c0 msgr2=0x7f222c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.173+0000 7f224515b640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f222c0678c0 0x7f222c069d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22300ad000 tx=0x7f22300a4f90 comp rx=0 tx=0).stop 2024-09-15T21:55:34.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.173+0000 7f224515b640 1 -- 172.21.15.1:0/2799692888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22401e0e30 msgr2=0x7f224014f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.173+0000 7f224515b640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22401e0e30 0x7f224014f380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f223800c7a0 tx=0x7f223800cc60 comp rx=0 tx=0).stop 2024-09-15T21:55:34.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.173+0000 7f224515b640 1 -- 172.21.15.1:0/2799692888 shutdown_connections 2024-09-15T21:55:34.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.173+0000 7f224515b640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22401e0e30 0x7f224014f380 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.173+0000 7f224515b640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f22400af160 0x7f2240147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.173+0000 7f224515b640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f222c0678c0 0x7f222c069d80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.173+0000 7f224515b640 1 --2- 172.21.15.1:0/2799692888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22400ae3a0 0x7f22400b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.173+0000 7f224515b640 1 -- 172.21.15.1:0/2799692888 >> 172.21.15.1:0/2799692888 conn(0x7f22400b5c40 msgr2=0x7f224009c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:34.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.173+0000 7f224515b640 1 -- 172.21.15.1:0/2799692888 shutdown_connections 2024-09-15T21:55:34.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.173+0000 7f224515b640 1 -- 172.21.15.1:0/2799692888 wait complete. 2024-09-15T21:55:34.194 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-15T21:55:33.082042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256568,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754718152,"statfs":{"total":773094113280,"available":772831387648,"internally_reserved":0,"allocated":2924544,"data_stored":1767532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.050557"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484762+0000","last_change":"2024-09-15T21:55:21.088474+0000","last_active":"2024-09-15T21:55:22.484762+0000","last_peered":"2024-09-15T21:55:22.484762+0000","last_clean":"2024-09-15T21:55:22.484762+0000","last_became_active":"2024-09-15T21:55:21.088066+0000","last_became_peered":"2024-09-15T21:55:21.088066+0000","last_unstale":"2024-09-15T21:55:22.484762+0000","last_undegraded":"2024-09-15T21:55:22.484762+0000","last_fullsized":"2024-09-15T21:55:22.484762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:35.421317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034618+0000","last_change":"2024-09-15T21:55:21.057377+0000","last_active":"2024-09-15T21:55:22.034618+0000","last_peered":"2024-09-15T21:55:22.034618+0000","last_clean":"2024-09-15T21:55:22.034618+0000","last_became_active":"2024-09-15T21:55:21.057035+0000","last_became_peered":"2024-09-15T21:55:21.057035+0000","last_unstale":"2024-09-15T21:55:22.034618+0000","last_undegraded":"2024-09-15T21:55:22.034618+0000","last_fullsized":"2024-09-15T21:55:22.034618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484551+0000","last_change":"2024-09-15T21:55:21.055398+0000","last_active":"2024-09-15T21:55:22.484551+0000","last_peered":"2024-09-15T21:55:22.484551+0000","last_clean":"2024-09-15T21:55:22.484551+0000","last_became_active":"2024-09-15T21:55:21.055039+0000","last_became_peered":"2024-09-15T21:55:21.055039+0000","last_unstale":"2024-09-15T21:55:22.484551+0000","last_undegraded":"2024-09-15T21:55:22.484551+0000","last_fullsized":"2024-09-15T21:55:22.484551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:45.407449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038690+0000","last_change":"2024-09-15T21:55:21.083779+0000","last_active":"2024-09-15T21:55:22.038690+0000","last_peered":"2024-09-15T21:55:22.038690+0000","last_clean":"2024-09-15T21:55:22.038690+0000","last_became_active":"2024-09-15T21:55:21.081667+0000","last_became_peered":"2024-09-15T21:55:21.081667+0000","last_unstale":"2024-09-15T21:55:22.038690+0000","last_undegraded":"2024-09-15T21:55:22.038690+0000","last_fullsized":"2024-09-15T21:55:22.038690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:44.705672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484114+0000","last_change":"2024-09-15T21:55:21.081320+0000","last_active":"2024-09-15T21:55:22.484114+0000","last_peered":"2024-09-15T21:55:22.484114+0000","last_clean":"2024-09-15T21:55:22.484114+0000","last_became_active":"2024-09-15T21:55:21.080501+0000","last_became_peered":"2024-09-15T21:55:21.080501+0000","last_unstale":"2024-09-15T21:55:22.484114+0000","last_undegraded":"2024-09-15T21:55:22.484114+0000","last_fullsized":"2024-09-15T21:55:22.484114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:24.528185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038584+0000","last_change":"2024-09-15T21:55:21.085688+0000","last_active":"2024-09-15T21:55:22.038584+0000","last_peered":"2024-09-15T21:55:22.038584+0000","last_clean":"2024-09-15T21:55:22.038584+0000","last_became_active":"2024-09-15T21:55:21.085166+0000","last_became_peered":"2024-09-15T21:55:21.085166+0000","last_unstale":"2024-09-15T21:55:22.038584+0000","last_undegraded":"2024-09-15T21:55:22.038584+0000","last_fullsized":"2024-09-15T21:55:22.038584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:56.272087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483929+0000","last_change":"2024-09-15T21:55:21.081625+0000","last_active":"2024-09-15T21:55:22.483929+0000","last_peered":"2024-09-15T21:55:22.483929+0000","last_clean":"2024-09-15T21:55:22.483929+0000","last_became_active":"2024-09-15T21:55:21.081233+0000","last_became_peered":"2024-09-15T21:55:21.081233+0000","last_unstale":"2024-09-15T21:55:22.483929+0000","last_undegraded":"2024-09-15T21:55:22.483929+0000","last_fullsized":"2024-09-15T21:55:22.483929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:56.638597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482172+0000","last_change":"2024-09-15T21:55:21.084462+0000","last_active":"2024-09-15T21:55:22.482172+0000","last_peered":"2024-09-15T21:55:22.482172+0000","last_clean":"2024-09-15T21:55:22.482172+0000","last_became_active":"2024-09-15T21:55:21.083916+0000","last_became_peered":"2024-09-15T21:55:21.083916+0000","last_unstale":"2024-09-15T21:55:22.482172+0000","last_undegraded":"2024-09-15T21:55:22.482172+0000","last_fullsized":"2024-09-15T21:55:22.482172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:29.617932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485001+0000","last_change":"2024-09-15T21:55:21.094131+0000","last_active":"2024-09-15T21:55:22.485001+0000","last_peered":"2024-09-15T21:55:22.485001+0000","last_clean":"2024-09-15T21:55:22.485001+0000","last_became_active":"2024-09-15T21:55:21.093635+0000","last_became_peered":"2024-09-15T21:55:21.093635+0000","last_unstale":"2024-09-15T21:55:22.485001+0000","last_undegraded":"2024-09-15T21:55:22.485001+0000","last_fullsized":"2024-09-15T21:55:22.485001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:07.303590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038217+0000","last_change":"2024-09-15T21:55:21.084425+0000","last_active":"2024-09-15T21:55:22.038217+0000","last_peered":"2024-09-15T21:55:22.038217+0000","last_clean":"2024-09-15T21:55:22.038217+0000","last_became_active":"2024-09-15T21:55:21.083265+0000","last_became_peered":"2024-09-15T21:55:21.083265+0000","last_unstale":"2024-09-15T21:55:22.038217+0000","last_undegraded":"2024-09-15T21:55:22.038217+0000","last_fullsized":"2024-09-15T21:55:22.038217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037906+0000","last_change":"2024-09-15T21:55:21.085602+0000","last_active":"2024-09-15T21:55:22.037906+0000","last_peered":"2024-09-15T21:55:22.037906+0000","last_clean":"2024-09-15T21:55:22.037906+0000","last_became_active":"2024-09-15T21:55:21.085179+0000","last_became_peered":"2024-09-15T21:55:21.085179+0000","last_unstale":"2024-09-15T21:55:22.037906+0000","last_undegraded":"2024-09-15T21:55:22.037906+0000","last_fullsized":"2024-09-15T21:55:22.037906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:18:48.546913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472313+0000","last_change":"2024-09-15T21:55:21.073952+0000","last_active":"2024-09-15T21:55:22.472313+0000","last_peered":"2024-09-15T21:55:22.472313+0000","last_clean":"2024-09-15T21:55:22.472313+0000","last_became_active":"2024-09-15T21:55:21.066880+0000","last_became_peered":"2024-09-15T21:55:21.066880+0000","last_unstale":"2024-09-15T21:55:22.472313+0000","last_undegraded":"2024-09-15T21:55:22.472313+0000","last_fullsized":"2024-09-15T21:55:22.472313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:04.142503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483336+0000","last_change":"2024-09-15T21:55:21.055609+0000","last_active":"2024-09-15T21:55:22.483336+0000","last_peered":"2024-09-15T21:55:22.483336+0000","last_clean":"2024-09-15T21:55:22.483336+0000","last_became_active":"2024-09-15T21:55:21.055327+0000","last_became_peered":"2024-09-15T21:55:21.055327+0000","last_unstale":"2024-09-15T21:55:22.483336+0000","last_undegraded":"2024-09-15T21:55:22.483336+0000","last_fullsized":"2024-09-15T21:55:22.483336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483575+0000","last_change":"2024-09-15T21:55:21.051382+0000","last_active":"2024-09-15T21:55:22.483575+0000","last_peered":"2024-09-15T21:55:22.483575+0000","last_clean":"2024-09-15T21:55:22.483575+0000","last_became_active":"2024-09-15T21:55:21.048576+0000","last_became_peered":"2024-09-15T21:55:21.048576+0000","last_unstale":"2024-09-15T21:55:22.483575+0000","last_undegraded":"2024-09-15T21:55:22.483575+0000","last_fullsized":"2024-09-15T21:55:22.483575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:32.450086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034843+0000","last_change":"2024-09-15T21:55:21.065866+0000","last_active":"2024-09-15T21:55:22.034843+0000","last_peered":"2024-09-15T21:55:22.034843+0000","last_clean":"2024-09-15T21:55:22.034843+0000","last_became_active":"2024-09-15T21:55:21.065546+0000","last_became_peered":"2024-09-15T21:55:21.065546+0000","last_unstale":"2024-09-15T21:55:22.034843+0000","last_undegraded":"2024-09-15T21:55:22.034843+0000","last_fullsized":"2024-09-15T21:55:22.034843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038027+0000","last_change":"2024-09-15T21:55:21.078929+0000","last_active":"2024-09-15T21:55:22.038027+0000","last_peered":"2024-09-15T21:55:22.038027+0000","last_clean":"2024-09-15T21:55:22.038027+0000","last_became_active":"2024-09-15T21:55:21.078505+0000","last_became_peered":"2024-09-15T21:55:21.078505+0000","last_unstale":"2024-09-15T21:55:22.038027+0000","last_undegraded":"2024-09-15T21:55:22.038027+0000","last_fullsized":"2024-09-15T21:55:22.038027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.040153+0000","last_change":"2024-09-15T21:55:21.093592+0000","last_active":"2024-09-15T21:55:22.040153+0000","last_peered":"2024-09-15T21:55:22.040153+0000","last_clean":"2024-09-15T21:55:22.040153+0000","last_became_active":"2024-09-15T21:55:21.092961+0000","last_became_peered":"2024-09-15T21:55:21.092961+0000","last_unstale":"2024-09-15T21:55:22.040153+0000","last_undegraded":"2024-09-15T21:55:22.040153+0000","last_fullsized":"2024-09-15T21:55:22.040153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:43.789664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.225030+0000","last_change":"2024-09-15T21:55:21.056138+0000","last_active":"2024-09-15T21:55:22.225030+0000","last_peered":"2024-09-15T21:55:22.225030+0000","last_clean":"2024-09-15T21:55:22.225030+0000","last_became_active":"2024-09-15T21:55:21.055873+0000","last_became_peered":"2024-09-15T21:55:21.055873+0000","last_unstale":"2024-09-15T21:55:22.225030+0000","last_undegraded":"2024-09-15T21:55:22.225030+0000","last_fullsized":"2024-09-15T21:55:22.225030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:11.494691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484459+0000","last_change":"2024-09-15T21:55:21.088654+0000","last_active":"2024-09-15T21:55:22.484459+0000","last_peered":"2024-09-15T21:55:22.484459+0000","last_clean":"2024-09-15T21:55:22.484459+0000","last_became_active":"2024-09-15T21:55:21.087902+0000","last_became_peered":"2024-09-15T21:55:21.087902+0000","last_unstale":"2024-09-15T21:55:22.484459+0000","last_undegraded":"2024-09-15T21:55:22.484459+0000","last_fullsized":"2024-09-15T21:55:22.484459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:40.823067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038235+0000","last_change":"2024-09-15T21:55:21.069269+0000","last_active":"2024-09-15T21:55:22.038235+0000","last_peered":"2024-09-15T21:55:22.038235+0000","last_clean":"2024-09-15T21:55:22.038235+0000","last_became_active":"2024-09-15T21:55:21.066006+0000","last_became_peered":"2024-09-15T21:55:21.066006+0000","last_unstale":"2024-09-15T21:55:22.038235+0000","last_undegraded":"2024-09-15T21:55:22.038235+0000","last_fullsized":"2024-09-15T21:55:22.038235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484203+0000","last_change":"2024-09-15T21:55:21.080185+0000","last_active":"2024-09-15T21:55:22.484203+0000","last_peered":"2024-09-15T21:55:22.484203+0000","last_clean":"2024-09-15T21:55:22.484203+0000","last_became_active":"2024-09-15T21:55:21.079797+0000","last_became_peered":"2024-09-15T21:55:21.079797+0000","last_unstale":"2024-09-15T21:55:22.484203+0000","last_undegraded":"2024-09-15T21:55:22.484203+0000","last_fullsized":"2024-09-15T21:55:22.484203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:29.713894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039100+0000","last_change":"2024-09-15T21:55:21.093516+0000","last_active":"2024-09-15T21:55:22.039100+0000","last_peered":"2024-09-15T21:55:22.039100+0000","last_clean":"2024-09-15T21:55:22.039100+0000","last_became_active":"2024-09-15T21:55:21.092809+0000","last_became_peered":"2024-09-15T21:55:21.092809+0000","last_unstale":"2024-09-15T21:55:22.039100+0000","last_undegraded":"2024-09-15T21:55:22.039100+0000","last_fullsized":"2024-09-15T21:55:22.039100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:16:19.534444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482533+0000","last_change":"2024-09-15T21:55:21.064761+0000","last_active":"2024-09-15T21:55:22.482533+0000","last_peered":"2024-09-15T21:55:22.482533+0000","last_clean":"2024-09-15T21:55:22.482533+0000","last_became_active":"2024-09-15T21:55:21.064423+0000","last_became_peered":"2024-09-15T21:55:21.064423+0000","last_unstale":"2024-09-15T21:55:22.482533+0000","last_undegraded":"2024-09-15T21:55:22.482533+0000","last_fullsized":"2024-09-15T21:55:22.482533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:45.407449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037768+0000","last_change":"2024-09-15T21:55:21.076934+0000","last_active":"2024-09-15T21:55:22.037768+0000","last_peered":"2024-09-15T21:55:22.037768+0000","last_clean":"2024-09-15T21:55:22.037768+0000","last_became_active":"2024-09-15T21:55:21.076405+0000","last_became_peered":"2024-09-15T21:55:21.076405+0000","last_unstale":"2024-09-15T21:55:22.037768+0000","last_undegraded":"2024-09-15T21:55:22.037768+0000","last_fullsized":"2024-09-15T21:55:22.037768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484840+0000","last_change":"2024-09-15T21:55:21.060381+0000","last_active":"2024-09-15T21:55:22.484840+0000","last_peered":"2024-09-15T21:55:22.484840+0000","last_clean":"2024-09-15T21:55:22.484840+0000","last_became_active":"2024-09-15T21:55:21.059955+0000","last_became_peered":"2024-09-15T21:55:21.059955+0000","last_unstale":"2024-09-15T21:55:22.484840+0000","last_undegraded":"2024-09-15T21:55:22.484840+0000","last_fullsized":"2024-09-15T21:55:22.484840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:23:53.907941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038576+0000","last_change":"2024-09-15T21:55:21.083854+0000","last_active":"2024-09-15T21:55:22.038576+0000","last_peered":"2024-09-15T21:55:22.038576+0000","last_clean":"2024-09-15T21:55:22.038576+0000","last_became_active":"2024-09-15T21:55:21.082344+0000","last_became_peered":"2024-09-15T21:55:21.082344+0000","last_unstale":"2024-09-15T21:55:22.038576+0000","last_undegraded":"2024-09-15T21:55:22.038576+0000","last_fullsized":"2024-09-15T21:55:22.038576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:56.272087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034198+0000","last_change":"2024-09-15T21:55:21.040261+0000","last_active":"2024-09-15T21:55:22.034198+0000","last_peered":"2024-09-15T21:55:22.034198+0000","last_clean":"2024-09-15T21:55:22.034198+0000","last_became_active":"2024-09-15T21:55:21.039750+0000","last_became_peered":"2024-09-15T21:55:21.039750+0000","last_unstale":"2024-09-15T21:55:22.034198+0000","last_undegraded":"2024-09-15T21:55:22.034198+0000","last_fullsized":"2024-09-15T21:55:22.034198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:29.713894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483285+0000","last_change":"2024-09-15T21:55:21.058179+0000","last_active":"2024-09-15T21:55:22.483285+0000","last_peered":"2024-09-15T21:55:22.483285+0000","last_clean":"2024-09-15T21:55:22.483285+0000","last_became_active":"2024-09-15T21:55:21.057921+0000","last_became_peered":"2024-09-15T21:55:21.057921+0000","last_unstale":"2024-09-15T21:55:22.483285+0000","last_undegraded":"2024-09-15T21:55:22.483285+0000","last_fullsized":"2024-09-15T21:55:22.483285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:18:48.546913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484622+0000","last_change":"2024-09-15T21:55:21.058728+0000","last_active":"2024-09-15T21:55:22.484622+0000","last_peered":"2024-09-15T21:55:22.484622+0000","last_clean":"2024-09-15T21:55:22.484622+0000","last_became_active":"2024-09-15T21:55:21.055629+0000","last_became_peered":"2024-09-15T21:55:21.055629+0000","last_unstale":"2024-09-15T21:55:22.484622+0000","last_undegraded":"2024-09-15T21:55:22.484622+0000","last_fullsized":"2024-09-15T21:55:22.484622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:03:15.769453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039201+0000","last_change":"2024-09-15T21:55:21.088771+0000","last_active":"2024-09-15T21:55:22.039201+0000","last_peered":"2024-09-15T21:55:22.039201+0000","last_clean":"2024-09-15T21:55:22.039201+0000","last_became_active":"2024-09-15T21:55:21.088101+0000","last_became_peered":"2024-09-15T21:55:21.088101+0000","last_unstale":"2024-09-15T21:55:22.039201+0000","last_undegraded":"2024-09-15T21:55:22.039201+0000","last_fullsized":"2024-09-15T21:55:22.039201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:30.828294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224741+0000","last_change":"2024-09-15T21:55:21.084544+0000","last_active":"2024-09-15T21:55:22.224741+0000","last_peered":"2024-09-15T21:55:22.224741+0000","last_clean":"2024-09-15T21:55:22.224741+0000","last_became_active":"2024-09-15T21:55:21.084180+0000","last_became_peered":"2024-09-15T21:55:21.084180+0000","last_unstale":"2024-09-15T21:55:22.224741+0000","last_undegraded":"2024-09-15T21:55:22.224741+0000","last_fullsized":"2024-09-15T21:55:22.224741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:41.953343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037174+0000","last_change":"2024-09-15T21:55:21.064821+0000","last_active":"2024-09-15T21:55:22.037174+0000","last_peered":"2024-09-15T21:55:22.037174+0000","last_clean":"2024-09-15T21:55:22.037174+0000","last_became_active":"2024-09-15T21:55:21.063988+0000","last_became_peered":"2024-09-15T21:55:21.063988+0000","last_unstale":"2024-09-15T21:55:22.037174+0000","last_undegraded":"2024-09-15T21:55:22.037174+0000","last_fullsized":"2024-09-15T21:55:22.037174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:29.713894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.471969+0000","last_change":"2024-09-15T21:55:21.049249+0000","last_active":"2024-09-15T21:55:22.471969+0000","last_peered":"2024-09-15T21:55:22.471969+0000","last_clean":"2024-09-15T21:55:22.471969+0000","last_became_active":"2024-09-15T21:55:21.048017+0000","last_became_peered":"2024-09-15T21:55:21.048017+0000","last_unstale":"2024-09-15T21:55:22.471969+0000","last_undegraded":"2024-09-15T21:55:22.471969+0000","last_fullsized":"2024-09-15T21:55:22.471969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:18.540720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484007+0000","last_change":"2024-09-15T21:55:20.066836+0000","last_active":"2024-09-15T21:55:22.484007+0000","last_peered":"2024-09-15T21:55:22.484007+0000","last_clean":"2024-09-15T21:55:22.484007+0000","last_became_active":"2024-09-15T21:55:20.066434+0000","last_became_peered":"2024-09-15T21:55:20.066434+0000","last_unstale":"2024-09-15T21:55:22.484007+0000","last_undegraded":"2024-09-15T21:55:22.484007+0000","last_fullsized":"2024-09-15T21:55:22.484007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484990+0000","last_change":"2024-09-15T21:55:21.052900+0000","last_active":"2024-09-15T21:55:22.484990+0000","last_peered":"2024-09-15T21:55:22.484990+0000","last_clean":"2024-09-15T21:55:22.484990+0000","last_became_active":"2024-09-15T21:55:21.052626+0000","last_became_peered":"2024-09-15T21:55:21.052626+0000","last_unstale":"2024-09-15T21:55:22.484990+0000","last_undegraded":"2024-09-15T21:55:22.484990+0000","last_fullsized":"2024-09-15T21:55:22.484990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:18:48.546913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037269+0000","last_change":"2024-09-15T21:55:20.049677+0000","last_active":"2024-09-15T21:55:22.037269+0000","last_peered":"2024-09-15T21:55:22.037269+0000","last_clean":"2024-09-15T21:55:22.037269+0000","last_became_active":"2024-09-15T21:55:20.046329+0000","last_became_peered":"2024-09-15T21:55:20.046329+0000","last_unstale":"2024-09-15T21:55:22.037269+0000","last_undegraded":"2024-09-15T21:55:22.037269+0000","last_fullsized":"2024-09-15T21:55:22.037269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:06.723350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482810+0000","last_change":"2024-09-15T21:55:20.056808+0000","last_active":"2024-09-15T21:55:22.482810+0000","last_peered":"2024-09-15T21:55:22.482810+0000","last_clean":"2024-09-15T21:55:22.482810+0000","last_became_active":"2024-09-15T21:55:20.055774+0000","last_became_peered":"2024-09-15T21:55:20.055774+0000","last_unstale":"2024-09-15T21:55:22.482810+0000","last_undegraded":"2024-09-15T21:55:22.482810+0000","last_fullsized":"2024-09-15T21:55:22.482810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:46.832251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482375+0000","last_change":"2024-09-15T21:55:21.059850+0000","last_active":"2024-09-15T21:55:22.482375+0000","last_peered":"2024-09-15T21:55:22.482375+0000","last_clean":"2024-09-15T21:55:22.482375+0000","last_became_active":"2024-09-15T21:55:21.059522+0000","last_became_peered":"2024-09-15T21:55:21.059522+0000","last_unstale":"2024-09-15T21:55:22.482375+0000","last_undegraded":"2024-09-15T21:55:22.482375+0000","last_fullsized":"2024-09-15T21:55:22.482375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:29.713894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038023+0000","last_change":"2024-09-15T21:55:20.052880+0000","last_active":"2024-09-15T21:55:22.038023+0000","last_peered":"2024-09-15T21:55:22.038023+0000","last_clean":"2024-09-15T21:55:22.038023+0000","last_became_active":"2024-09-15T21:55:20.052076+0000","last_became_peered":"2024-09-15T21:55:20.052076+0000","last_unstale":"2024-09-15T21:55:22.038023+0000","last_undegraded":"2024-09-15T21:55:22.038023+0000","last_fullsized":"2024-09-15T21:55:22.038023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.202000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034540+0000","last_change":"2024-09-15T21:55:21.040018+0000","last_active":"2024-09-15T21:55:22.034540+0000","last_peered":"2024-09-15T21:55:22.034540+0000","last_clean":"2024-09-15T21:55:22.034540+0000","last_became_active":"2024-09-15T21:55:21.039694+0000","last_became_peered":"2024-09-15T21:55:21.039694+0000","last_unstale":"2024-09-15T21:55:22.034540+0000","last_undegraded":"2024-09-15T21:55:22.034540+0000","last_fullsized":"2024-09-15T21:55:22.034540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:18:48.546913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037585+0000","last_change":"2024-09-15T21:55:20.054769+0000","last_active":"2024-09-15T21:55:22.037585+0000","last_peered":"2024-09-15T21:55:22.037585+0000","last_clean":"2024-09-15T21:55:22.037585+0000","last_became_active":"2024-09-15T21:55:20.053983+0000","last_became_peered":"2024-09-15T21:55:20.053983+0000","last_unstale":"2024-09-15T21:55:22.037585+0000","last_undegraded":"2024-09-15T21:55:22.037585+0000","last_fullsized":"2024-09-15T21:55:22.037585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:03.132039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.040113+0000","last_change":"2024-09-15T21:55:21.093104+0000","last_active":"2024-09-15T21:55:22.040113+0000","last_peered":"2024-09-15T21:55:22.040113+0000","last_clean":"2024-09-15T21:55:22.040113+0000","last_became_active":"2024-09-15T21:55:21.092699+0000","last_became_peered":"2024-09-15T21:55:21.092699+0000","last_unstale":"2024-09-15T21:55:22.040113+0000","last_undegraded":"2024-09-15T21:55:22.040113+0000","last_fullsized":"2024-09-15T21:55:22.040113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:03.817824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.040096+0000","last_change":"2024-09-15T21:55:20.055173+0000","last_active":"2024-09-15T21:55:22.040096+0000","last_peered":"2024-09-15T21:55:22.040096+0000","last_clean":"2024-09-15T21:55:22.040096+0000","last_became_active":"2024-09-15T21:55:20.054689+0000","last_became_peered":"2024-09-15T21:55:20.054689+0000","last_unstale":"2024-09-15T21:55:22.040096+0000","last_undegraded":"2024-09-15T21:55:22.040096+0000","last_fullsized":"2024-09-15T21:55:22.040096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:06.723350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485031+0000","last_change":"2024-09-15T21:55:21.077556+0000","last_active":"2024-09-15T21:55:22.485031+0000","last_peered":"2024-09-15T21:55:22.485031+0000","last_clean":"2024-09-15T21:55:22.485031+0000","last_became_active":"2024-09-15T21:55:21.077268+0000","last_became_peered":"2024-09-15T21:55:21.077268+0000","last_unstale":"2024-09-15T21:55:22.485031+0000","last_undegraded":"2024-09-15T21:55:22.485031+0000","last_fullsized":"2024-09-15T21:55:22.485031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:13.442652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034287+0000","last_change":"2024-09-15T21:55:20.054045+0000","last_active":"2024-09-15T21:55:22.034287+0000","last_peered":"2024-09-15T21:55:22.034287+0000","last_clean":"2024-09-15T21:55:22.034287+0000","last_became_active":"2024-09-15T21:55:20.053600+0000","last_became_peered":"2024-09-15T21:55:20.053600+0000","last_unstale":"2024-09-15T21:55:22.034287+0000","last_undegraded":"2024-09-15T21:55:22.034287+0000","last_fullsized":"2024-09-15T21:55:22.034287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:03.132039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472660+0000","last_change":"2024-09-15T21:55:21.089526+0000","last_active":"2024-09-15T21:55:22.472660+0000","last_peered":"2024-09-15T21:55:22.472660+0000","last_clean":"2024-09-15T21:55:22.472660+0000","last_became_active":"2024-09-15T21:55:21.088932+0000","last_became_peered":"2024-09-15T21:55:21.088932+0000","last_unstale":"2024-09-15T21:55:22.472660+0000","last_undegraded":"2024-09-15T21:55:22.472660+0000","last_fullsized":"2024-09-15T21:55:22.472660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:25.194521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038442+0000","last_change":"2024-09-15T21:55:20.053664+0000","last_active":"2024-09-15T21:55:22.038442+0000","last_peered":"2024-09-15T21:55:22.038442+0000","last_clean":"2024-09-15T21:55:22.038442+0000","last_became_active":"2024-09-15T21:55:20.051430+0000","last_became_peered":"2024-09-15T21:55:20.051430+0000","last_unstale":"2024-09-15T21:55:22.038442+0000","last_undegraded":"2024-09-15T21:55:22.038442+0000","last_fullsized":"2024-09-15T21:55:22.038442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:17.530256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483958+0000","last_change":"2024-09-15T21:55:21.081085+0000","last_active":"2024-09-15T21:55:22.483958+0000","last_peered":"2024-09-15T21:55:22.483958+0000","last_clean":"2024-09-15T21:55:22.483958+0000","last_became_active":"2024-09-15T21:55:21.080302+0000","last_became_peered":"2024-09-15T21:55:21.080302+0000","last_unstale":"2024-09-15T21:55:22.483958+0000","last_undegraded":"2024-09-15T21:55:22.483958+0000","last_fullsized":"2024-09-15T21:55:22.483958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:35.161272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485141+0000","last_change":"2024-09-15T21:55:20.050298+0000","last_active":"2024-09-15T21:55:22.485141+0000","last_peered":"2024-09-15T21:55:22.485141+0000","last_clean":"2024-09-15T21:55:22.485141+0000","last_became_active":"2024-09-15T21:55:20.049086+0000","last_became_peered":"2024-09-15T21:55:20.049086+0000","last_unstale":"2024-09-15T21:55:22.485141+0000","last_undegraded":"2024-09-15T21:55:22.485141+0000","last_fullsized":"2024-09-15T21:55:22.485141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:05.320842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484009+0000","last_change":"2024-09-15T21:55:21.079944+0000","last_active":"2024-09-15T21:55:22.484009+0000","last_peered":"2024-09-15T21:55:22.484009+0000","last_clean":"2024-09-15T21:55:22.484009+0000","last_became_active":"2024-09-15T21:55:21.079703+0000","last_became_peered":"2024-09-15T21:55:21.079703+0000","last_unstale":"2024-09-15T21:55:22.484009+0000","last_undegraded":"2024-09-15T21:55:22.484009+0000","last_fullsized":"2024-09-15T21:55:22.484009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:17.369451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039261+0000","last_change":"2024-09-15T21:55:20.067348+0000","last_active":"2024-09-15T21:55:22.039261+0000","last_peered":"2024-09-15T21:55:22.039261+0000","last_clean":"2024-09-15T21:55:22.039261+0000","last_became_active":"2024-09-15T21:55:20.066912+0000","last_became_peered":"2024-09-15T21:55:20.066912+0000","last_unstale":"2024-09-15T21:55:22.039261+0000","last_undegraded":"2024-09-15T21:55:22.039261+0000","last_fullsized":"2024-09-15T21:55:22.039261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:03.132039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484340+0000","last_change":"2024-09-15T21:55:21.092869+0000","last_active":"2024-09-15T21:55:22.484340+0000","last_peered":"2024-09-15T21:55:22.484340+0000","last_clean":"2024-09-15T21:55:22.484340+0000","last_became_active":"2024-09-15T21:55:21.092360+0000","last_became_peered":"2024-09-15T21:55:21.092360+0000","last_unstale":"2024-09-15T21:55:22.484340+0000","last_undegraded":"2024-09-15T21:55:22.484340+0000","last_fullsized":"2024-09-15T21:55:22.484340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:08.584649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037252+0000","last_change":"2024-09-15T21:55:20.046741+0000","last_active":"2024-09-15T21:55:22.037252+0000","last_peered":"2024-09-15T21:55:22.037252+0000","last_clean":"2024-09-15T21:55:22.037252+0000","last_became_active":"2024-09-15T21:55:20.044504+0000","last_became_peered":"2024-09-15T21:55:20.044504+0000","last_unstale":"2024-09-15T21:55:22.037252+0000","last_undegraded":"2024-09-15T21:55:22.037252+0000","last_fullsized":"2024-09-15T21:55:22.037252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.202000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037581+0000","last_change":"2024-09-15T21:55:21.065198+0000","last_active":"2024-09-15T21:55:22.037581+0000","last_peered":"2024-09-15T21:55:22.037581+0000","last_clean":"2024-09-15T21:55:22.037581+0000","last_became_active":"2024-09-15T21:55:21.064290+0000","last_became_peered":"2024-09-15T21:55:21.064290+0000","last_unstale":"2024-09-15T21:55:22.037581+0000","last_undegraded":"2024-09-15T21:55:22.037581+0000","last_fullsized":"2024-09-15T21:55:22.037581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:03:15.769453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224516+0000","last_change":"2024-09-15T21:55:20.045879+0000","last_active":"2024-09-15T21:55:22.224516+0000","last_peered":"2024-09-15T21:55:22.224516+0000","last_clean":"2024-09-15T21:55:22.224516+0000","last_became_active":"2024-09-15T21:55:20.045166+0000","last_became_peered":"2024-09-15T21:55:20.045166+0000","last_unstale":"2024-09-15T21:55:22.224516+0000","last_undegraded":"2024-09-15T21:55:22.224516+0000","last_fullsized":"2024-09-15T21:55:22.224516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:27.871582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484582+0000","last_change":"2024-09-15T21:55:21.091543+0000","last_active":"2024-09-15T21:55:22.484582+0000","last_peered":"2024-09-15T21:55:22.484582+0000","last_clean":"2024-09-15T21:55:22.484582+0000","last_became_active":"2024-09-15T21:55:21.088040+0000","last_became_peered":"2024-09-15T21:55:21.088040+0000","last_unstale":"2024-09-15T21:55:22.484582+0000","last_undegraded":"2024-09-15T21:55:22.484582+0000","last_fullsized":"2024-09-15T21:55:22.484582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:58.437513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472663+0000","last_change":"2024-09-15T21:55:20.060882+0000","last_active":"2024-09-15T21:55:22.472663+0000","last_peered":"2024-09-15T21:55:22.472663+0000","last_clean":"2024-09-15T21:55:22.472663+0000","last_became_active":"2024-09-15T21:55:20.059856+0000","last_became_peered":"2024-09-15T21:55:20.059856+0000","last_unstale":"2024-09-15T21:55:22.472663+0000","last_undegraded":"2024-09-15T21:55:22.472663+0000","last_fullsized":"2024-09-15T21:55:22.472663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:51.995035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484517+0000","last_change":"2024-09-15T21:55:21.088545+0000","last_active":"2024-09-15T21:55:22.484517+0000","last_peered":"2024-09-15T21:55:22.484517+0000","last_clean":"2024-09-15T21:55:22.484517+0000","last_became_active":"2024-09-15T21:55:21.080729+0000","last_became_peered":"2024-09-15T21:55:21.080729+0000","last_unstale":"2024-09-15T21:55:22.484517+0000","last_undegraded":"2024-09-15T21:55:22.484517+0000","last_fullsized":"2024-09-15T21:55:22.484517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:10.451575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224968+0000","last_change":"2024-09-15T21:55:20.053774+0000","last_active":"2024-09-15T21:55:22.224968+0000","last_peered":"2024-09-15T21:55:22.224968+0000","last_clean":"2024-09-15T21:55:22.224968+0000","last_became_active":"2024-09-15T21:55:20.053417+0000","last_became_peered":"2024-09-15T21:55:20.053417+0000","last_unstale":"2024-09-15T21:55:22.224968+0000","last_undegraded":"2024-09-15T21:55:22.224968+0000","last_fullsized":"2024-09-15T21:55:22.224968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:42:50.046558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484974+0000","last_change":"2024-09-15T21:55:21.088812+0000","last_active":"2024-09-15T21:55:22.484974+0000","last_peered":"2024-09-15T21:55:22.484974+0000","last_clean":"2024-09-15T21:55:22.484974+0000","last_became_active":"2024-09-15T21:55:21.088403+0000","last_became_peered":"2024-09-15T21:55:21.088403+0000","last_unstale":"2024-09-15T21:55:22.484974+0000","last_undegraded":"2024-09-15T21:55:22.484974+0000","last_fullsized":"2024-09-15T21:55:22.484974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:53:46.896732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034408+0000","last_change":"2024-09-15T21:55:20.049155+0000","last_active":"2024-09-15T21:55:22.034408+0000","last_peered":"2024-09-15T21:55:22.034408+0000","last_clean":"2024-09-15T21:55:22.034408+0000","last_became_active":"2024-09-15T21:55:20.048758+0000","last_became_peered":"2024-09-15T21:55:20.048758+0000","last_unstale":"2024-09-15T21:55:22.034408+0000","last_undegraded":"2024-09-15T21:55:22.034408+0000","last_fullsized":"2024-09-15T21:55:22.034408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:26.853149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039043+0000","last_change":"2024-09-15T21:55:21.080373+0000","last_active":"2024-09-15T21:55:22.039043+0000","last_peered":"2024-09-15T21:55:22.039043+0000","last_clean":"2024-09-15T21:55:22.039043+0000","last_became_active":"2024-09-15T21:55:21.079654+0000","last_became_peered":"2024-09-15T21:55:21.079654+0000","last_unstale":"2024-09-15T21:55:22.039043+0000","last_undegraded":"2024-09-15T21:55:22.039043+0000","last_fullsized":"2024-09-15T21:55:22.039043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:51.738245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224802+0000","last_change":"2024-09-15T21:55:20.057638+0000","last_active":"2024-09-15T21:55:22.224802+0000","last_peered":"2024-09-15T21:55:22.224802+0000","last_clean":"2024-09-15T21:55:22.224802+0000","last_became_active":"2024-09-15T21:55:20.057104+0000","last_became_peered":"2024-09-15T21:55:20.057104+0000","last_unstale":"2024-09-15T21:55:22.224802+0000","last_undegraded":"2024-09-15T21:55:22.224802+0000","last_fullsized":"2024-09-15T21:55:22.224802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:46.407918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484034+0000","last_change":"2024-09-15T21:55:21.092764+0000","last_active":"2024-09-15T21:55:22.484034+0000","last_peered":"2024-09-15T21:55:22.484034+0000","last_clean":"2024-09-15T21:55:22.484034+0000","last_became_active":"2024-09-15T21:55:21.092278+0000","last_became_peered":"2024-09-15T21:55:21.092278+0000","last_unstale":"2024-09-15T21:55:22.484034+0000","last_undegraded":"2024-09-15T21:55:22.484034+0000","last_fullsized":"2024-09-15T21:55:22.484034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:16.853013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483633+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:22.483633+0000","last_peered":"2024-09-15T21:55:22.483633+0000","last_clean":"2024-09-15T21:55:22.483633+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:22.483633+0000","last_undegraded":"2024-09-15T21:55:22.483633+0000","last_fullsized":"2024-09-15T21:55:22.483633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038105+0000","last_change":"2024-09-15T21:55:20.062164+0000","last_active":"2024-09-15T21:55:22.038105+0000","last_peered":"2024-09-15T21:55:22.038105+0000","last_clean":"2024-09-15T21:55:22.038105+0000","last_became_active":"2024-09-15T21:55:20.061451+0000","last_became_peered":"2024-09-15T21:55:20.061451+0000","last_unstale":"2024-09-15T21:55:22.038105+0000","last_undegraded":"2024-09-15T21:55:22.038105+0000","last_fullsized":"2024-09-15T21:55:22.038105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:46.832251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483314+0000","last_change":"2024-09-15T21:55:21.093819+0000","last_active":"2024-09-15T21:55:22.483314+0000","last_peered":"2024-09-15T21:55:22.483314+0000","last_clean":"2024-09-15T21:55:22.483314+0000","last_became_active":"2024-09-15T21:55:21.093514+0000","last_became_peered":"2024-09-15T21:55:21.093514+0000","last_unstale":"2024-09-15T21:55:22.483314+0000","last_undegraded":"2024-09-15T21:55:22.483314+0000","last_fullsized":"2024-09-15T21:55:22.483314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483452+0000","last_change":"2024-09-15T21:55:20.067427+0000","last_active":"2024-09-15T21:55:22.483452+0000","last_peered":"2024-09-15T21:55:22.483452+0000","last_clean":"2024-09-15T21:55:22.483452+0000","last_became_active":"2024-09-15T21:55:20.066778+0000","last_became_peered":"2024-09-15T21:55:20.066778+0000","last_unstale":"2024-09-15T21:55:22.483452+0000","last_undegraded":"2024-09-15T21:55:22.483452+0000","last_fullsized":"2024-09-15T21:55:22.483452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:26.867497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483333+0000","last_change":"2024-09-15T21:55:21.064883+0000","last_active":"2024-09-15T21:55:22.483333+0000","last_peered":"2024-09-15T21:55:22.483333+0000","last_clean":"2024-09-15T21:55:22.483333+0000","last_became_active":"2024-09-15T21:55:21.064565+0000","last_became_peered":"2024-09-15T21:55:21.064565+0000","last_unstale":"2024-09-15T21:55:22.483333+0000","last_undegraded":"2024-09-15T21:55:22.483333+0000","last_fullsized":"2024-09-15T21:55:22.483333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:27.419646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.224713+0000","last_change":"2024-09-15T21:55:20.064316+0000","last_active":"2024-09-15T21:55:22.224713+0000","last_peered":"2024-09-15T21:55:22.224713+0000","last_clean":"2024-09-15T21:55:22.224713+0000","last_became_active":"2024-09-15T21:55:20.064010+0000","last_became_peered":"2024-09-15T21:55:20.064010+0000","last_unstale":"2024-09-15T21:55:22.224713+0000","last_undegraded":"2024-09-15T21:55:22.224713+0000","last_fullsized":"2024-09-15T21:55:22.224713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:55.450682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034330+0000","last_change":"2024-09-15T21:55:21.039824+0000","last_active":"2024-09-15T21:55:22.034330+0000","last_peered":"2024-09-15T21:55:22.034330+0000","last_clean":"2024-09-15T21:55:22.034330+0000","last_became_active":"2024-09-15T21:55:21.039532+0000","last_became_peered":"2024-09-15T21:55:21.039532+0000","last_unstale":"2024-09-15T21:55:22.034330+0000","last_undegraded":"2024-09-15T21:55:22.034330+0000","last_fullsized":"2024-09-15T21:55:22.034330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:03:15.769453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039468+0000","last_change":"2024-09-15T21:55:20.053996+0000","last_active":"2024-09-15T21:55:22.039468+0000","last_peered":"2024-09-15T21:55:22.039468+0000","last_clean":"2024-09-15T21:55:22.039468+0000","last_became_active":"2024-09-15T21:55:20.053487+0000","last_became_peered":"2024-09-15T21:55:20.053487+0000","last_unstale":"2024-09-15T21:55:22.039468+0000","last_undegraded":"2024-09-15T21:55:22.039468+0000","last_fullsized":"2024-09-15T21:55:22.039468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:05.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472458+0000","last_change":"2024-09-15T21:55:21.073289+0000","last_active":"2024-09-15T21:55:22.472458+0000","last_peered":"2024-09-15T21:55:22.472458+0000","last_clean":"2024-09-15T21:55:22.472458+0000","last_became_active":"2024-09-15T21:55:21.064508+0000","last_became_peered":"2024-09-15T21:55:21.064508+0000","last_unstale":"2024-09-15T21:55:22.472458+0000","last_undegraded":"2024-09-15T21:55:22.472458+0000","last_fullsized":"2024-09-15T21:55:22.472458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:27.863613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034372+0000","last_change":"2024-09-15T21:55:20.055656+0000","last_active":"2024-09-15T21:55:22.034372+0000","last_peered":"2024-09-15T21:55:22.034372+0000","last_clean":"2024-09-15T21:55:22.034372+0000","last_became_active":"2024-09-15T21:55:20.055168+0000","last_became_peered":"2024-09-15T21:55:20.055168+0000","last_unstale":"2024-09-15T21:55:22.034372+0000","last_undegraded":"2024-09-15T21:55:22.034372+0000","last_fullsized":"2024-09-15T21:55:22.034372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:05.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039815+0000","last_change":"2024-09-15T21:55:21.079617+0000","last_active":"2024-09-15T21:55:22.039815+0000","last_peered":"2024-09-15T21:55:22.039815+0000","last_clean":"2024-09-15T21:55:22.039815+0000","last_became_active":"2024-09-15T21:55:21.078651+0000","last_became_peered":"2024-09-15T21:55:21.078651+0000","last_unstale":"2024-09-15T21:55:22.039815+0000","last_undegraded":"2024-09-15T21:55:22.039815+0000","last_fullsized":"2024-09-15T21:55:22.039815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:13.196570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484562+0000","last_change":"2024-09-15T21:55:20.067021+0000","last_active":"2024-09-15T21:55:22.484562+0000","last_peered":"2024-09-15T21:55:22.484562+0000","last_clean":"2024-09-15T21:55:22.484562+0000","last_became_active":"2024-09-15T21:55:20.066354+0000","last_became_peered":"2024-09-15T21:55:20.066354+0000","last_unstale":"2024-09-15T21:55:22.484562+0000","last_undegraded":"2024-09-15T21:55:22.484562+0000","last_fullsized":"2024-09-15T21:55:22.484562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:57.837195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034197+0000","last_change":"2024-09-15T21:55:21.043432+0000","last_active":"2024-09-15T21:55:22.034197+0000","last_peered":"2024-09-15T21:55:22.034197+0000","last_clean":"2024-09-15T21:55:22.034197+0000","last_became_active":"2024-09-15T21:55:21.043150+0000","last_became_peered":"2024-09-15T21:55:21.043150+0000","last_unstale":"2024-09-15T21:55:22.034197+0000","last_undegraded":"2024-09-15T21:55:22.034197+0000","last_fullsized":"2024-09-15T21:55:22.034197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:45.407449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034641+0000","last_change":"2024-09-15T21:55:20.051483+0000","last_active":"2024-09-15T21:55:22.034641+0000","last_peered":"2024-09-15T21:55:22.034641+0000","last_clean":"2024-09-15T21:55:22.034641+0000","last_became_active":"2024-09-15T21:55:20.051077+0000","last_became_peered":"2024-09-15T21:55:20.051077+0000","last_unstale":"2024-09-15T21:55:22.034641+0000","last_undegraded":"2024-09-15T21:55:22.034641+0000","last_fullsized":"2024-09-15T21:55:22.034641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:39.202000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484985+0000","last_change":"2024-09-15T21:55:21.090900+0000","last_active":"2024-09-15T21:55:22.484985+0000","last_peered":"2024-09-15T21:55:22.484985+0000","last_clean":"2024-09-15T21:55:22.484985+0000","last_became_active":"2024-09-15T21:55:21.090600+0000","last_became_peered":"2024-09-15T21:55:21.090600+0000","last_unstale":"2024-09-15T21:55:22.484985+0000","last_undegraded":"2024-09-15T21:55:22.484985+0000","last_fullsized":"2024-09-15T21:55:22.484985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:51.738245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037826+0000","last_change":"2024-09-15T21:55:20.058425+0000","last_active":"2024-09-15T21:55:22.037826+0000","last_peered":"2024-09-15T21:55:22.037826+0000","last_clean":"2024-09-15T21:55:22.037826+0000","last_became_active":"2024-09-15T21:55:20.057897+0000","last_became_peered":"2024-09-15T21:55:20.057897+0000","last_unstale":"2024-09-15T21:55:22.037826+0000","last_undegraded":"2024-09-15T21:55:22.037826+0000","last_fullsized":"2024-09-15T21:55:22.037826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:05.270654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.485013+0000","last_change":"2024-09-15T21:55:21.055808+0000","last_active":"2024-09-15T21:55:22.485013+0000","last_peered":"2024-09-15T21:55:22.485013+0000","last_clean":"2024-09-15T21:55:22.485013+0000","last_became_active":"2024-09-15T21:55:21.054995+0000","last_became_peered":"2024-09-15T21:55:21.054995+0000","last_unstale":"2024-09-15T21:55:22.485013+0000","last_undegraded":"2024-09-15T21:55:22.485013+0000","last_fullsized":"2024-09-15T21:55:22.485013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:16.374804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483454+0000","last_change":"2024-09-15T21:55:20.067341+0000","last_active":"2024-09-15T21:55:22.483454+0000","last_peered":"2024-09-15T21:55:22.483454+0000","last_clean":"2024-09-15T21:55:22.483454+0000","last_became_active":"2024-09-15T21:55:20.066114+0000","last_became_peered":"2024-09-15T21:55:20.066114+0000","last_unstale":"2024-09-15T21:55:22.483454+0000","last_undegraded":"2024-09-15T21:55:22.483454+0000","last_fullsized":"2024-09-15T21:55:22.483454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:54.611870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.472372+0000","last_change":"2024-09-15T21:55:21.065815+0000","last_active":"2024-09-15T21:55:22.472372+0000","last_peered":"2024-09-15T21:55:22.472372+0000","last_clean":"2024-09-15T21:55:22.472372+0000","last_became_active":"2024-09-15T21:55:21.064866+0000","last_became_peered":"2024-09-15T21:55:21.064866+0000","last_unstale":"2024-09-15T21:55:22.472372+0000","last_undegraded":"2024-09-15T21:55:22.472372+0000","last_fullsized":"2024-09-15T21:55:22.472372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:06.281118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034646+0000","last_change":"2024-09-15T21:55:20.057081+0000","last_active":"2024-09-15T21:55:22.034646+0000","last_peered":"2024-09-15T21:55:22.034646+0000","last_clean":"2024-09-15T21:55:22.034646+0000","last_became_active":"2024-09-15T21:55:20.056673+0000","last_became_peered":"2024-09-15T21:55:20.056673+0000","last_unstale":"2024-09-15T21:55:22.034646+0000","last_undegraded":"2024-09-15T21:55:22.034646+0000","last_fullsized":"2024-09-15T21:55:22.034646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:06.723350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.482625+0000","last_change":"2024-09-15T21:55:21.042285+0000","last_active":"2024-09-15T21:55:22.482625+0000","last_peered":"2024-09-15T21:55:22.482625+0000","last_clean":"2024-09-15T21:55:22.482625+0000","last_became_active":"2024-09-15T21:55:21.041896+0000","last_became_peered":"2024-09-15T21:55:21.041896+0000","last_unstale":"2024-09-15T21:55:22.482625+0000","last_undegraded":"2024-09-15T21:55:22.482625+0000","last_fullsized":"2024-09-15T21:55:22.482625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:03:15.769453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.034611+0000","last_change":"2024-09-15T21:55:20.053890+0000","last_active":"2024-09-15T21:55:22.034611+0000","last_peered":"2024-09-15T21:55:22.034611+0000","last_clean":"2024-09-15T21:55:22.034611+0000","last_became_active":"2024-09-15T21:55:20.053359+0000","last_became_peered":"2024-09-15T21:55:20.053359+0000","last_unstale":"2024-09-15T21:55:22.034611+0000","last_undegraded":"2024-09-15T21:55:22.034611+0000","last_fullsized":"2024-09-15T21:55:22.034611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:03:17.530256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483756+0000","last_change":"2024-09-15T21:55:21.060275+0000","last_active":"2024-09-15T21:55:22.483756+0000","last_peered":"2024-09-15T21:55:22.483756+0000","last_clean":"2024-09-15T21:55:22.483756+0000","last_became_active":"2024-09-15T21:55:21.059657+0000","last_became_peered":"2024-09-15T21:55:21.059657+0000","last_unstale":"2024-09-15T21:55:22.483756+0000","last_undegraded":"2024-09-15T21:55:22.483756+0000","last_fullsized":"2024-09-15T21:55:22.483756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:56.272087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484372+0000","last_change":"2024-09-15T21:55:20.066502+0000","last_active":"2024-09-15T21:55:22.484372+0000","last_peered":"2024-09-15T21:55:22.484372+0000","last_clean":"2024-09-15T21:55:22.484372+0000","last_became_active":"2024-09-15T21:55:20.066143+0000","last_became_peered":"2024-09-15T21:55:20.066143+0000","last_unstale":"2024-09-15T21:55:22.484372+0000","last_undegraded":"2024-09-15T21:55:22.484372+0000","last_fullsized":"2024-09-15T21:55:22.484372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:26.132589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.037228+0000","last_change":"2024-09-15T21:55:21.056694+0000","last_active":"2024-09-15T21:55:22.037228+0000","last_peered":"2024-09-15T21:55:22.037228+0000","last_clean":"2024-09-15T21:55:22.037228+0000","last_became_active":"2024-09-15T21:55:21.055728+0000","last_became_peered":"2024-09-15T21:55:21.055728+0000","last_unstale":"2024-09-15T21:55:22.037228+0000","last_undegraded":"2024-09-15T21:55:22.037228+0000","last_fullsized":"2024-09-15T21:55:22.037228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:45.407449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.039691+0000","last_change":"2024-09-15T21:55:21.083720+0000","last_active":"2024-09-15T21:55:22.039691+0000","last_peered":"2024-09-15T21:55:22.039691+0000","last_clean":"2024-09-15T21:55:22.039691+0000","last_became_active":"2024-09-15T21:55:21.083110+0000","last_became_peered":"2024-09-15T21:55:21.083110+0000","last_unstale":"2024-09-15T21:55:22.039691+0000","last_undegraded":"2024-09-15T21:55:22.039691+0000","last_fullsized":"2024-09-15T21:55:22.039691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:45:22.889914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483812+0000","last_change":"2024-09-15T21:55:20.069937+0000","last_active":"2024-09-15T21:55:22.483812+0000","last_peered":"2024-09-15T21:55:22.483812+0000","last_clean":"2024-09-15T21:55:22.483812+0000","last_became_active":"2024-09-15T21:55:20.069454+0000","last_became_peered":"2024-09-15T21:55:20.069454+0000","last_unstale":"2024-09-15T21:55:22.483812+0000","last_undegraded":"2024-09-15T21:55:22.483812+0000","last_fullsized":"2024-09-15T21:55:22.483812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:40.942879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.038724+0000","last_change":"2024-09-15T21:55:21.082991+0000","last_active":"2024-09-15T21:55:22.038724+0000","last_peered":"2024-09-15T21:55:22.038724+0000","last_clean":"2024-09-15T21:55:22.038724+0000","last_became_active":"2024-09-15T21:55:21.082634+0000","last_became_peered":"2024-09-15T21:55:21.082634+0000","last_unstale":"2024-09-15T21:55:22.038724+0000","last_undegraded":"2024-09-15T21:55:22.038724+0000","last_fullsized":"2024-09-15T21:55:22.038724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:23:53.907941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484270+0000","last_change":"2024-09-15T21:55:20.068019+0000","last_active":"2024-09-15T21:55:22.484270+0000","last_peered":"2024-09-15T21:55:22.484270+0000","last_clean":"2024-09-15T21:55:22.484270+0000","last_became_active":"2024-09-15T21:55:20.067127+0000","last_became_peered":"2024-09-15T21:55:20.067127+0000","last_unstale":"2024-09-15T21:55:22.484270+0000","last_undegraded":"2024-09-15T21:55:22.484270+0000","last_fullsized":"2024-09-15T21:55:22.484270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:10.484227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484179+0000","last_change":"2024-09-15T21:55:21.091582+0000","last_active":"2024-09-15T21:55:22.484179+0000","last_peered":"2024-09-15T21:55:22.484179+0000","last_clean":"2024-09-15T21:55:22.484179+0000","last_became_active":"2024-09-15T21:55:21.091286+0000","last_became_peered":"2024-09-15T21:55:21.091286+0000","last_unstale":"2024-09-15T21:55:22.484179+0000","last_undegraded":"2024-09-15T21:55:22.484179+0000","last_fullsized":"2024-09-15T21:55:22.484179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:29.617932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484237+0000","last_change":"2024-09-15T21:55:20.055671+0000","last_active":"2024-09-15T21:55:22.484237+0000","last_peered":"2024-09-15T21:55:22.484237+0000","last_clean":"2024-09-15T21:55:22.484237+0000","last_became_active":"2024-09-15T21:55:20.054385+0000","last_became_peered":"2024-09-15T21:55:20.054385+0000","last_unstale":"2024-09-15T21:55:22.484237+0000","last_undegraded":"2024-09-15T21:55:22.484237+0000","last_fullsized":"2024-09-15T21:55:22.484237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:15.076825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.483963+0000","last_change":"2024-09-15T21:55:21.051450+0000","last_active":"2024-09-15T21:55:22.483963+0000","last_peered":"2024-09-15T21:55:22.483963+0000","last_clean":"2024-09-15T21:55:22.483963+0000","last_became_active":"2024-09-15T21:55:21.051151+0000","last_became_peered":"2024-09-15T21:55:21.051151+0000","last_unstale":"2024-09-15T21:55:22.483963+0000","last_undegraded":"2024-09-15T21:55:22.483963+0000","last_fullsized":"2024-09-15T21:55:22.483963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:20.015969+0000","last_clean_scrub_stamp":"2024-09-15T21:55:20.015969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:04:44.705672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T21:55:22.484447+0000","last_change":"2024-09-15T21:55:20.057739+0000","last_active":"2024-09-15T21:55:22.484447+0000","last_peered":"2024-09-15T21:55:22.484447+0000","last_clean":"2024-09-15T21:55:22.484447+0000","last_became_active":"2024-09-15T21:55:20.056988+0000","last_became_peered":"2024-09-15T21:55:20.056988+0000","last_unstale":"2024-09-15T21:55:22.484447+0000","last_undegraded":"2024-09-15T21:55:22.484447+0000","last_fullsized":"2024-09-15T21:55:22.484447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:19.005505+0000","last_clean_scrub_stamp":"2024-09-15T21:55:19.005505+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:39.905255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":72837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":74359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":217088,"data_stored":72907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":663753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":806912,"data_stored":663697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":72747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:55:34.198 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T21:55:34.198 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T21:55:34.198 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-15T21:55:34.198 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T21:55:34.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f51334fb640 1 Processor -- start 2024-09-15T21:55:34.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f51334fb640 1 -- start start 2024-09-15T21:55:34.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f51334fb640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f512c0baed0 0x7f512c151320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f51334fb640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512c0b98f0 con 0x7f512c0b9510 2024-09-15T21:55:34.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f51334fb640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512c072b30 con 0x7f512c145990 2024-09-15T21:55:34.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f51334fb640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f512c1464e0 con 0x7f512c0baed0 2024-09-15T21:55:34.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5131297640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f512c0b9510 0x7f512c0b6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49806/0 (socket says 172.21.15.1:49806) 2024-09-15T21:55:34.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5131297640 1 -- 172.21.15.1:0/2720401745 learned_addr learned my addr 172.21.15.1:0/2720401745 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:34.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5131a98640 1 --2- 172.21.15.1:0/2720401745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f512c0baed0 0x7f512c151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2497316660 0 0) 0x7f512c0b98f0 con 0x7f512c0b9510 2024-09-15T21:55:34.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5118003530 con 0x7f512c0b9510 2024-09-15T21:55:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1208292112 0 0) 0x7f5118003530 con 0x7f512c0b9510 2024-09-15T21:55:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f512c0baed0 msgr2=0x7f512c151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 --2- 172.21.15.1:0/2720401745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f512c0baed0 0x7f512c151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 >> v1:172.21.15.70:6789/0 conn(0x7f512c145990 legacy=0x7f512c0730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512c145e90 con 0x7f512c0b9510 2024-09-15T21:55:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f5128001680 con 0x7f512c0b9510 2024-09-15T21:55:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 >> v1:172.21.15.1:6789/0 conn(0x7f512c0b9510 legacy=0x7f512c0b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 --2- 172.21.15.1:0/2720401745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51180039f0 0x7f5118003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 --2- 172.21.15.1:0/2720401745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f512c0baed0 0x7f5118004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 --2- 172.21.15.1:0/2720401745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5118004d50 0x7f51180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f512c1464e0 con 0x7f5118004d50 2024-09-15T21:55:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f511800ba80 con 0x7f51180039f0 2024-09-15T21:55:34.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f511800bc00 con 0x7f512c0baed0 2024-09-15T21:55:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5131a98640 1 --2- 172.21.15.1:0/2720401745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5118004d50 0x7f51180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5131a98640 1 -- 172.21.15.1:0/2720401745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f512c0baed0 msgr2=0x7f5118004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5131a98640 1 --2- 172.21.15.1:0/2720401745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f512c0baed0 0x7f5118004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5131297640 1 --2- 172.21.15.1:0/2720401745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51180039f0 0x7f5118003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5131a98640 1 -- 172.21.15.1:0/2720401745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51180039f0 msgr2=0x7f5118003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5131a98640 1 --2- 172.21.15.1:0/2720401745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51180039f0 0x7f5118003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5131a98640 1 -- 172.21.15.1:0/2720401745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512c145e90 con 0x7f5118004d50 2024-09-15T21:55:34.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.353+0000 7f5131297640 1 --2- 172.21.15.1:0/2720401745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51180039f0 0x7f5118003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:34.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5131a98640 1 --2- 172.21.15.1:0/2720401745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5118004d50 0x7f51180051d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5124009fc0 tx=0x7f512401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a5cddec24c1c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:34.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240b2070 con 0x7f5118004d50 2024-09-15T21:55:34.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51240a5cd0 con 0x7f5118004d50 2024-09-15T21:55:34.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5123fff640 1 -- 172.21.15.1:0/2720401745 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124009c10 con 0x7f5118004d50 2024-09-15T21:55:34.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 -- 172.21.15.1:0/2720401745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5118004d50 msgr2=0x7f51180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 --2- 172.21.15.1:0/2720401745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5118004d50 0x7f51180051d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5124009fc0 tx=0x7f512401ccc0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5131a98640 1 -- 172.21.15.1:0/2720401745 reap_dead start 2024-09-15T21:55:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 -- 172.21.15.1:0/2720401745 shutdown_connections 2024-09-15T21:55:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 -- 172.21.15.1:0/2720401745 >> 172.21.15.1:0/2720401745 conn(0x7f512c09d260 msgr2=0x7f512c09d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 -- 172.21.15.1:0/2720401745 shutdown_connections 2024-09-15T21:55:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 -- 172.21.15.1:0/2720401745 wait complete. 2024-09-15T21:55:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 Processor -- start 2024-09-15T21:55:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 -- start start 2024-09-15T21:55:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5118004d50 0x7f512c06e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f512c0b1b20 0x7f512c0b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f512c09e560 0x7f512c09e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f512c0737c0 con 0x7f512c09e560 2024-09-15T21:55:34.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f512c0b75d0 con 0x7f512c0b1b20 2024-09-15T21:55:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f512c073940 con 0x7f5118004d50 2024-09-15T21:55:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5131a98640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f512c09e560 0x7f512c09e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5131a98640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f512c09e560 0x7f512c09e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60662/0 (socket says 172.21.15.1:60662) 2024-09-15T21:55:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5131a98640 1 -- 172.21.15.1:0/3787816830 learned_addr learned my addr 172.21.15.1:0/3787816830 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5131297640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5118004d50 0x7f512c06e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5130a96640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f512c0b1b20 0x7f512c0b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5131a98640 1 -- 172.21.15.1:0/3787816830 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5118004d50 msgr2=0x7f512c06e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5131a98640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5118004d50 0x7f512c06e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5131a98640 1 -- 172.21.15.1:0/3787816830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f512c0b1b20 msgr2=0x7f512c0b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5131a98640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f512c0b1b20 0x7f512c0b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5131a98640 1 -- 172.21.15.1:0/3787816830 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512c0a1470 con 0x7f512c09e560 2024-09-15T21:55:34.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5130a96640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f512c0b1b20 0x7f512c0b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5131a98640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f512c09e560 0x7f512c09e9e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5124002240 tx=0x7f5124009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5121ffb640 1 -- 172.21.15.1:0/3787816830 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240bd070 con 0x7f512c09e560 2024-09-15T21:55:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5121ffb640 1 -- 172.21.15.1:0/3787816830 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51240a5ad0 con 0x7f512c09e560 2024-09-15T21:55:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 -- 172.21.15.1:0/3787816830 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512c0b1690 con 0x7f512c09e560 2024-09-15T21:55:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f5121ffb640 1 -- 172.21.15.1:0/3787816830 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240b2040 con 0x7f512c09e560 2024-09-15T21:55:34.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.357+0000 7f51334fb640 1 -- 172.21.15.1:0/3787816830 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512c0a0c70 con 0x7f512c09e560 2024-09-15T21:55:34.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.361+0000 7f51334fb640 1 -- 172.21.15.1:0/3787816830 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f512c0b6ec0 con 0x7f512c09e560 2024-09-15T21:55:34.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.361+0000 7f5121ffb640 1 -- 172.21.15.1:0/3787816830 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f51240039a0 con 0x7f512c09e560 2024-09-15T21:55:34.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.361+0000 7f5121ffb640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f51100678c0 0x7f5110069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.361+0000 7f5131297640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f51100678c0 0x7f5110069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.361+0000 7f5121ffb640 1 -- 172.21.15.1:0/3787816830 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f512411fdb0 con 0x7f512c09e560 2024-09-15T21:55:34.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.361+0000 7f5131297640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f51100678c0 0x7f5110069d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5128001ec0 tx=0x7f5128009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:34.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.365+0000 7f5121ffb640 1 -- 172.21.15.1:0/3787816830 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f51240169d0 con 0x7f512c09e560 2024-09-15T21:55:34.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.553+0000 7f51334fb640 1 -- 172.21.15.1:0/3787816830 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f512c0ba760 con 0x7f512c09e560 2024-09-15T21:55:34.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.553+0000 7f5121ffb640 1 -- 172.21.15.1:0/3787816830 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f51240f0290 con 0x7f512c09e560 2024-09-15T21:55:34.559 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:34.559 INFO:teuthology.orchestra.run.smithi001.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T21:55:34.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.557+0000 7f51334fb640 1 -- 172.21.15.1:0/3787816830 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f51100678c0 msgr2=0x7f5110069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.557+0000 7f51334fb640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f51100678c0 0x7f5110069d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5128001ec0 tx=0x7f5128009040 comp rx=0 tx=0).stop 2024-09-15T21:55:34.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.557+0000 7f51334fb640 1 -- 172.21.15.1:0/3787816830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f512c09e560 msgr2=0x7f512c09e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.557+0000 7f51334fb640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f512c09e560 0x7f512c09e9e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5124002240 tx=0x7f5124009750 comp rx=0 tx=0).stop 2024-09-15T21:55:34.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.557+0000 7f51334fb640 1 -- 172.21.15.1:0/3787816830 shutdown_connections 2024-09-15T21:55:34.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.557+0000 7f51334fb640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f512c09e560 0x7f512c09e9e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.557+0000 7f51334fb640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f51100678c0 0x7f5110069d80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.557+0000 7f51334fb640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f512c0b1b20 0x7f512c0b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.557+0000 7f51334fb640 1 --2- 172.21.15.1:0/3787816830 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5118004d50 0x7f512c06e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.557+0000 7f51334fb640 1 -- 172.21.15.1:0/3787816830 >> 172.21.15.1:0/3787816830 conn(0x7f512c09d260 msgr2=0x7f512c09c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:34.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.557+0000 7f51334fb640 1 -- 172.21.15.1:0/3787816830 shutdown_connections 2024-09-15T21:55:34.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.557+0000 7f51334fb640 1 -- 172.21.15.1:0/3787816830 wait complete. 2024-09-15T21:55:34.577 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-15T21:55:34.577 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:55:34.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.685+0000 7fa86de4d640 1 Processor -- start 2024-09-15T21:55:34.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.685+0000 7fa86de4d640 1 -- start start 2024-09-15T21:55:34.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa86de4d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa8680b5220 0x7fa86809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa86de4d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa8680b5600 0x7fa86809ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa86de4d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8680b6a50 con 0x7fa868148f20 2024-09-15T21:55:34.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa86de4d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fa86809b800 con 0x7fa8680b5600 2024-09-15T21:55:34.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa86de4d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa8680b4dd0 con 0x7fa8680b5220 2024-09-15T21:55:34.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa866ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa8680b5600 0x7fa86809ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa866ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa8680b5600 0x7fa86809ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60664/0 (socket says 172.21.15.1:60664) 2024-09-15T21:55:34.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa866ffd640 1 -- 172.21.15.1:0/3464653246 learned_addr learned my addr 172.21.15.1:0/3464653246 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:34.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa8677fe640 1 --2- 172.21.15.1:0/3464653246 >> v2:172.21.15.70:3300/0 conn(0x7fa8680b5220 0x7fa86809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa866ffd640 1 -- 172.21.15.1:0/3464653246 >> v2:172.21.15.70:3300/0 conn(0x7fa8680b5220 msgr2=0x7fa86809aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:34.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa866ffd640 1 --2- 172.21.15.1:0/3464653246 >> v2:172.21.15.70:3300/0 conn(0x7fa8680b5220 0x7fa86809aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa866ffd640 1 -- 172.21.15.1:0/3464653246 >> v1:172.21.15.70:6789/0 conn(0x7fa868148f20 legacy=0x7fa868149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa866ffd640 1 -- 172.21.15.1:0/3464653246 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86809af90 con 0x7fa8680b5600 2024-09-15T21:55:34.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa866ffd640 1 --2- 172.21.15.1:0/3464653246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8680b5600 0x7fa86809ee10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa8680b0400 tx=0x7fa85801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae95927d014b1d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:34.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa8667fc640 1 -- 172.21.15.1:0/3464653246 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8580b1070 con 0x7fa8680b5600 2024-09-15T21:55:34.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa8667fc640 1 -- 172.21.15.1:0/3464653246 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8580ac630 con 0x7fa8680b5600 2024-09-15T21:55:34.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.689+0000 7fa8667fc640 1 -- 172.21.15.1:0/3464653246 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8580a8050 con 0x7fa8680b5600 2024-09-15T21:55:34.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 -- 172.21.15.1:0/3464653246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8680b5600 msgr2=0x7fa86809ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 --2- 172.21.15.1:0/3464653246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8680b5600 0x7fa86809ee10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa8680b0400 tx=0x7fa85801c3d0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 -- 172.21.15.1:0/3464653246 shutdown_connections 2024-09-15T21:55:34.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 --2- 172.21.15.1:0/3464653246 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8680b5600 0x7fa86809ee10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 --2- 172.21.15.1:0/3464653246 >> v2:172.21.15.70:3300/0 conn(0x7fa8680b5220 0x7fa86809aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 -- 172.21.15.1:0/3464653246 >> 172.21.15.1:0/3464653246 conn(0x7fa8680b5c40 msgr2=0x7fa8680b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:34.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 -- 172.21.15.1:0/3464653246 shutdown_connections 2024-09-15T21:55:34.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 -- 172.21.15.1:0/3464653246 wait complete. 2024-09-15T21:55:34.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 Processor -- start 2024-09-15T21:55:34.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 -- start start 2024-09-15T21:55:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8680b5220 0x7fa8681434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8680b5600 0x7fa8680aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa868148f20 0x7fa8681e3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa868152700 con 0x7fa8680b5600 2024-09-15T21:55:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa868152880 con 0x7fa8680b5220 2024-09-15T21:55:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa868152a00 con 0x7fa868148f20 2024-09-15T21:55:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa866ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8680b5600 0x7fa8680aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa866ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8680b5600 0x7fa8680aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60678/0 (socket says 172.21.15.1:60678) 2024-09-15T21:55:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa866ffd640 1 -- 172.21.15.1:0/1989083489 learned_addr learned my addr 172.21.15.1:0/1989083489 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa8677fe640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8680b5220 0x7fa8681434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa867fff640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa868148f20 0x7fa8681e3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa866ffd640 1 -- 172.21.15.1:0/1989083489 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa868148f20 msgr2=0x7fa8681e3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa866ffd640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa868148f20 0x7fa8681e3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa866ffd640 1 -- 172.21.15.1:0/1989083489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8680b5220 msgr2=0x7fa8681434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa866ffd640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8680b5220 0x7fa8681434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa866ffd640 1 -- 172.21.15.1:0/1989083489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8681476f0 con 0x7fa8680b5600 2024-09-15T21:55:34.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa8677fe640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8680b5220 0x7fa8681434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:34.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa866ffd640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8680b5600 0x7fa8680aed50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa8580af040 tx=0x7fa858019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:34.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa84ffff640 1 -- 172.21.15.1:0/1989083489 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8580b1040 con 0x7fa8680b5600 2024-09-15T21:55:34.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa84ffff640 1 -- 172.21.15.1:0/1989083489 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8580b5420 con 0x7fa8680b5600 2024-09-15T21:55:34.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa84ffff640 1 -- 172.21.15.1:0/1989083489 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8580b57f0 con 0x7fa8680b5600 2024-09-15T21:55:34.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 -- 172.21.15.1:0/1989083489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa868144880 con 0x7fa8680b5600 2024-09-15T21:55:34.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.693+0000 7fa86de4d640 1 -- 172.21.15.1:0/1989083489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa86814e090 con 0x7fa8680b5600 2024-09-15T21:55:34.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.697+0000 7fa86de4d640 1 -- 172.21.15.1:0/1989083489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa86809aa50 con 0x7fa8680b5600 2024-09-15T21:55:34.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.697+0000 7fa84ffff640 1 -- 172.21.15.1:0/1989083489 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa8580b5990 con 0x7fa8680b5600 2024-09-15T21:55:34.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.697+0000 7fa84ffff640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa8540678f0 0x7fa854069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:34.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.697+0000 7fa84ffff640 1 -- 172.21.15.1:0/1989083489 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa85811f740 con 0x7fa8680b5600 2024-09-15T21:55:34.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.697+0000 7fa8677fe640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa8540678f0 0x7fa854069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:34.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.697+0000 7fa8677fe640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa8540678f0 0x7fa854069db0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00b9f0 tx=0x7fa85c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:34.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.701+0000 7fa84ffff640 1 -- 172.21.15.1:0/1989083489 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa8580c3020 con 0x7fa8680b5600 2024-09-15T21:55:34.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.893+0000 7fa86de4d640 1 -- 172.21.15.1:0/1989083489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8680b82a0 con 0x7fa8680b5600 2024-09-15T21:55:34.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.893+0000 7fa84ffff640 1 -- 172.21.15.1:0/1989083489 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3566 (secure 0 0 0) 0x7fa858016110 con 0x7fa8680b5600 2024-09-15T21:55:34.898 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:34.898 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-09-15T21:55:24:061270+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/2650682187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2650682187},{"type":"v1","addr":"172.21.15.70:6833","nonce":2650682187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:20.400358+0000","modified":"2024-09-15T21:55:23.425841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3288963990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3288963990},{"type":"v1","addr":"172.21.15.1:6835","nonce":3288963990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4245,"qdb_cluster":[4245]},"id":1}]} 2024-09-15T21:55:34.898 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-09-15T21:55:34.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.897+0000 7fa86de4d640 1 -- 172.21.15.1:0/1989083489 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa8540678f0 msgr2=0x7fa854069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.897+0000 7fa86de4d640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa8540678f0 0x7fa854069db0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00b9f0 tx=0x7fa85c008040 comp rx=0 tx=0).stop 2024-09-15T21:55:34.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.897+0000 7fa86de4d640 1 -- 172.21.15.1:0/1989083489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8680b5600 msgr2=0x7fa8680aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:34.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.897+0000 7fa86de4d640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8680b5600 0x7fa8680aed50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa8580af040 tx=0x7fa858019170 comp rx=0 tx=0).stop 2024-09-15T21:55:34.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.897+0000 7fa86de4d640 1 -- 172.21.15.1:0/1989083489 shutdown_connections 2024-09-15T21:55:34.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.897+0000 7fa86de4d640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa868148f20 0x7fa8681e3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.897+0000 7fa86de4d640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8680b5600 0x7fa8680aed50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.897+0000 7fa86de4d640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa8540678f0 0x7fa854069db0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.897+0000 7fa86de4d640 1 --2- 172.21.15.1:0/1989083489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8680b5220 0x7fa8681434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:34.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.897+0000 7fa86de4d640 1 -- 172.21.15.1:0/1989083489 >> 172.21.15.1:0/1989083489 conn(0x7fa8680b5c40 msgr2=0x7fa86809d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:34.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.897+0000 7fa86de4d640 1 -- 172.21.15.1:0/1989083489 shutdown_connections 2024-09-15T21:55:34.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:34.897+0000 7fa86de4d640 1 -- 172.21.15.1:0/1989083489 wait complete. 2024-09-15T21:55:34.916 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:55:35.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc03277e640 1 Processor -- start 2024-09-15T21:55:35.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc03277e640 1 -- start start 2024-09-15T21:55:35.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc03277e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc02c0b5220 0x7fc02c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc03277e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc02c0b5600 0x7fc02c09ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc03277e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc02c148f20 0x7fc02c1493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc03277e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fc02c09b800 con 0x7fc02c0b5220 2024-09-15T21:55:35.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc03277e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fc02c0b4dd0 con 0x7fc02c148f20 2024-09-15T21:55:35.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc03277e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc02c1498f0 con 0x7fc02c0b5600 2024-09-15T21:55:35.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc02bfff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc02c0b5220 0x7fc02c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc02bfff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc02c0b5220 0x7fc02c09aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60680/0 (socket says 172.21.15.1:60680) 2024-09-15T21:55:35.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc02bfff640 1 -- 172.21.15.1:0/1277876219 learned_addr learned my addr 172.21.15.1:0/1277876219 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:35.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc030d1b640 1 --2- 172.21.15.1:0/1277876219 >> v2:172.21.15.70:3300/0 conn(0x7fc02c148f20 0x7fc02c1493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc02b7fe640 1 --2- 172.21.15.1:0/1277876219 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc02c0b5600 0x7fc02c09ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc02bfff640 1 -- 172.21.15.1:0/1277876219 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc02c0b5600 msgr2=0x7fc02c09ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:35.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc02bfff640 1 --2- 172.21.15.1:0/1277876219 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc02c0b5600 0x7fc02c09ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc02bfff640 1 -- 172.21.15.1:0/1277876219 >> v2:172.21.15.70:3300/0 conn(0x7fc02c148f20 msgr2=0x7fc02c1493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:35.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc02bfff640 1 --2- 172.21.15.1:0/1277876219 >> v2:172.21.15.70:3300/0 conn(0x7fc02c148f20 0x7fc02c1493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc02bfff640 1 -- 172.21.15.1:0/1277876219 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c0b6a50 con 0x7fc02c0b5220 2024-09-15T21:55:35.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc02b7fe640 1 --2- 172.21.15.1:0/1277876219 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc02c0b5600 0x7fc02c09ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:35.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.037+0000 7fc02bfff640 1 --2- 172.21.15.1:0/1277876219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc02c0b5220 0x7fc02c09aa50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc02c06cd40 tx=0x7fc01c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8ec80a25a60331 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:35.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc02affd640 1 -- 172.21.15.1:0/1277876219 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0a5750 con 0x7fc02c0b5220 2024-09-15T21:55:35.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc02affd640 1 -- 172.21.15.1:0/1277876219 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01c0a58f0 con 0x7fc02c0b5220 2024-09-15T21:55:35.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc02affd640 1 -- 172.21.15.1:0/1277876219 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c0a5cc0 con 0x7fc02c0b5220 2024-09-15T21:55:35.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 -- 172.21.15.1:0/1277876219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc02c0b5220 msgr2=0x7fc02c09aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 --2- 172.21.15.1:0/1277876219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc02c0b5220 0x7fc02c09aa50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc02c06cd40 tx=0x7fc01c01c8d0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 -- 172.21.15.1:0/1277876219 shutdown_connections 2024-09-15T21:55:35.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 --2- 172.21.15.1:0/1277876219 >> v2:172.21.15.70:3300/0 conn(0x7fc02c148f20 0x7fc02c1493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 --2- 172.21.15.1:0/1277876219 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc02c0b5600 0x7fc02c09ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 --2- 172.21.15.1:0/1277876219 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc02c0b5220 0x7fc02c09aa50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 -- 172.21.15.1:0/1277876219 >> 172.21.15.1:0/1277876219 conn(0x7fc02c0b5c40 msgr2=0x7fc02c0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:35.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 -- 172.21.15.1:0/1277876219 shutdown_connections 2024-09-15T21:55:35.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 -- 172.21.15.1:0/1277876219 wait complete. 2024-09-15T21:55:35.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 Processor -- start 2024-09-15T21:55:35.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 -- start start 2024-09-15T21:55:35.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc02c0b5220 0x7fc02c1418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c0b5600 0x7fc02c13e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc02c148f20 0x7fc02c14e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c09f4d0 con 0x7fc02c148f20 2024-09-15T21:55:35.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c09f350 con 0x7fc02c0b5600 2024-09-15T21:55:35.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc02c0b4350 con 0x7fc02c0b5220 2024-09-15T21:55:35.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc030d1b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc02c148f20 0x7fc02c14e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc030d1b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc02c148f20 0x7fc02c14e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60692/0 (socket says 172.21.15.1:60692) 2024-09-15T21:55:35.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc030d1b640 1 -- 172.21.15.1:0/3589852200 learned_addr learned my addr 172.21.15.1:0/3589852200 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:35.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc02bfff640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc02c0b5220 0x7fc02c1418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc02b7fe640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c0b5600 0x7fc02c13e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc030d1b640 1 -- 172.21.15.1:0/3589852200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc02c0b5220 msgr2=0x7fc02c1418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc030d1b640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc02c0b5220 0x7fc02c1418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc030d1b640 1 -- 172.21.15.1:0/3589852200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c0b5600 msgr2=0x7fc02c13e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc030d1b640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c0b5600 0x7fc02c13e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc030d1b640 1 -- 172.21.15.1:0/3589852200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c140940 con 0x7fc02c148f20 2024-09-15T21:55:35.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc02bfff640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc02c0b5220 0x7fc02c1418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:35.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc02b7fe640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c0b5600 0x7fc02c13e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:35.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc030d1b640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc02c148f20 0x7fc02c14e090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc02400e960 tx=0x7fc02400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:35.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc028ff9640 1 -- 172.21.15.1:0/3589852200 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024017070 con 0x7fc02c148f20 2024-09-15T21:55:35.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc028ff9640 1 -- 172.21.15.1:0/3589852200 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc02400c9a0 con 0x7fc02c148f20 2024-09-15T21:55:35.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc028ff9640 1 -- 172.21.15.1:0/3589852200 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02400cd70 con 0x7fc02c148f20 2024-09-15T21:55:35.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 -- 172.21.15.1:0/3589852200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02c140c20 con 0x7fc02c148f20 2024-09-15T21:55:35.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.041+0000 7fc03277e640 1 -- 172.21.15.1:0/3589852200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02c1410b0 con 0x7fc02c148f20 2024-09-15T21:55:35.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.045+0000 7fc03277e640 1 -- 172.21.15.1:0/3589852200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc02c0b46e0 con 0x7fc02c148f20 2024-09-15T21:55:35.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.045+0000 7fc028ff9640 1 -- 172.21.15.1:0/3589852200 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc02401a070 con 0x7fc02c148f20 2024-09-15T21:55:35.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.045+0000 7fc028ff9640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc00c0678c0 0x7fc00c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.045+0000 7fc028ff9640 1 -- 172.21.15.1:0/3589852200 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc024085c70 con 0x7fc02c148f20 2024-09-15T21:55:35.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.045+0000 7fc02bfff640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc00c0678c0 0x7fc00c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.045+0000 7fc02bfff640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc00c0678c0 0x7fc00c069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0ae000 tx=0x7fc01c0a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:35.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.049+0000 7fc028ff9640 1 -- 172.21.15.1:0/3589852200 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc0240567a0 con 0x7fc02c148f20 2024-09-15T21:55:35.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.249+0000 7fc03277e640 1 -- 172.21.15.1:0/3589852200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc02c0b8b90 con 0x7fc02c148f20 2024-09-15T21:55:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.249+0000 7fc028ff9640 1 -- 172.21.15.1:0/3589852200 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3566 (secure 0 0 0) 0x7fc0240560a0 con 0x7fc02c148f20 2024-09-15T21:55:35.253 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:35.253 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-09-15T21:55:24:061270+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/2650682187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2650682187},{"type":"v1","addr":"172.21.15.70:6833","nonce":2650682187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:20.400358+0000","modified":"2024-09-15T21:55:23.425841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3288963990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3288963990},{"type":"v1","addr":"172.21.15.1:6835","nonce":3288963990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4245,"qdb_cluster":[4245]},"id":1}]} 2024-09-15T21:55:35.253 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-09-15T21:55:35.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.249+0000 7fc03277e640 1 -- 172.21.15.1:0/3589852200 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc00c0678c0 msgr2=0x7fc00c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.249+0000 7fc03277e640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc00c0678c0 0x7fc00c069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0ae000 tx=0x7fc01c0a7070 comp rx=0 tx=0).stop 2024-09-15T21:55:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.249+0000 7fc03277e640 1 -- 172.21.15.1:0/3589852200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc02c148f20 msgr2=0x7fc02c14e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.249+0000 7fc03277e640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc02c148f20 0x7fc02c14e090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc02400e960 tx=0x7fc02400ee20 comp rx=0 tx=0).stop 2024-09-15T21:55:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.249+0000 7fc03277e640 1 -- 172.21.15.1:0/3589852200 shutdown_connections 2024-09-15T21:55:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.249+0000 7fc03277e640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc02c148f20 0x7fc02c14e090 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.249+0000 7fc03277e640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc00c0678c0 0x7fc00c069d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.249+0000 7fc03277e640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c0b5600 0x7fc02c13e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.249+0000 7fc03277e640 1 --2- 172.21.15.1:0/3589852200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc02c0b5220 0x7fc02c1418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.249+0000 7fc03277e640 1 -- 172.21.15.1:0/3589852200 >> 172.21.15.1:0/3589852200 conn(0x7fc02c0b5c40 msgr2=0x7fc02c0b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.253+0000 7fc03277e640 1 -- 172.21.15.1:0/3589852200 shutdown_connections 2024-09-15T21:55:35.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.253+0000 7fc03277e640 1 -- 172.21.15.1:0/3589852200 wait complete. 2024-09-15T21:55:35.273 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:35.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.381+0000 7fc644c03640 1 Processor -- start 2024-09-15T21:55:35.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.381+0000 7fc644c03640 1 -- start start 2024-09-15T21:55:35.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc644c03640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc6400b5220 0x7fc64009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc644c03640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc64009f520 con 0x7fc6400b5600 2024-09-15T21:55:35.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc644c03640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6400b6a50 con 0x7fc640148f20 2024-09-15T21:55:35.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc644c03640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fc64009b800 con 0x7fc6400b5220 2024-09-15T21:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63dd9b640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc6400b5600 0x7fc64009ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49818/0 (socket says 172.21.15.1:49818) 2024-09-15T21:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63dd9b640 1 -- 172.21.15.1:0/2592920185 learned_addr learned my addr 172.21.15.1:0/2592920185 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63e59c640 1 --2- 172.21.15.1:0/2592920185 >> v2:172.21.15.70:3300/0 conn(0x7fc6400b5220 0x7fc64009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3204970696 0 0) 0x7fc64009f520 con 0x7fc6400b5600 2024-09-15T21:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc628003530 con 0x7fc6400b5600 2024-09-15T21:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 134653755 0 0) 0x7fc628003530 con 0x7fc6400b5600 2024-09-15T21:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 >> v2:172.21.15.70:3300/0 conn(0x7fc6400b5220 msgr2=0x7fc64009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 --2- 172.21.15.1:0/2592920185 >> v2:172.21.15.70:3300/0 conn(0x7fc6400b5220 0x7fc64009aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 >> v1:172.21.15.70:6789/0 conn(0x7fc640148f20 legacy=0x7fc640149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64009af90 con 0x7fc6400b5600 2024-09-15T21:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7fc634001680 con 0x7fc6400b5600 2024-09-15T21:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 >> v1:172.21.15.1:6789/0 conn(0x7fc6400b5600 legacy=0x7fc64009ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 --2- 172.21.15.1:0/2592920185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6280039c0 0x7fc628003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 --2- 172.21.15.1:0/2592920185 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc628004810 0x7fc628004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 --2- 172.21.15.1:0/2592920185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6280052f0 0x7fc62800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc64009b800 con 0x7fc6280039c0 2024-09-15T21:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc62800c1c0 con 0x7fc6280052f0 2024-09-15T21:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc62800c3c0 con 0x7fc628004810 2024-09-15T21:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63e59c640 1 --2- 172.21.15.1:0/2592920185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6280039c0 0x7fc628003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63e59c640 1 -- 172.21.15.1:0/2592920185 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc628004810 msgr2=0x7fc628004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63e59c640 1 --2- 172.21.15.1:0/2592920185 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc628004810 0x7fc628004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63e59c640 1 -- 172.21.15.1:0/2592920185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6280052f0 msgr2=0x7fc62800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63e59c640 1 --2- 172.21.15.1:0/2592920185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6280052f0 0x7fc62800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63e59c640 1 -- 172.21.15.1:0/2592920185 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc628003530 con 0x7fc6280039c0 2024-09-15T21:55:35.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63ed9d640 1 -- 172.21.15.1:0/2592920185 reap_dead start 2024-09-15T21:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63e59c640 1 --2- 172.21.15.1:0/2592920185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6280039c0 0x7fc628003de0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc630009ab0 tx=0x7fc63001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d3b7e35a50108c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6300096b0 con 0x7fc6280039c0 2024-09-15T21:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6300a6450 con 0x7fc6280039c0 2024-09-15T21:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.385+0000 7fc63d59a640 1 -- 172.21.15.1:0/2592920185 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6300a6840 con 0x7fc6280039c0 2024-09-15T21:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 -- 172.21.15.1:0/2592920185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6280039c0 msgr2=0x7fc628003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 --2- 172.21.15.1:0/2592920185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6280039c0 0x7fc628003de0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc630009ab0 tx=0x7fc63001ca70 comp rx=0 tx=0).stop 2024-09-15T21:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 -- 172.21.15.1:0/2592920185 shutdown_connections 2024-09-15T21:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 --2- 172.21.15.1:0/2592920185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc6280039c0 0x7fc628003de0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 -- 172.21.15.1:0/2592920185 >> 172.21.15.1:0/2592920185 conn(0x7fc6400b5c40 msgr2=0x7fc6400b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:35.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 -- 172.21.15.1:0/2592920185 shutdown_connections 2024-09-15T21:55:35.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 -- 172.21.15.1:0/2592920185 wait complete. 2024-09-15T21:55:35.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 Processor -- start 2024-09-15T21:55:35.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 -- start start 2024-09-15T21:55:35.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6280039c0 0x7fc640072b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc640071d90 0x7fc6400721f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6400b1f60 0x7fc6400b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc6401494b0 con 0x7fc640071d90 2024-09-15T21:55:35.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc640149330 con 0x7fc6280039c0 2024-09-15T21:55:35.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc640149630 con 0x7fc6400b1f60 2024-09-15T21:55:35.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc63dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc640071d90 0x7fc6400721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc63dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc640071d90 0x7fc6400721f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60714/0 (socket says 172.21.15.1:60714) 2024-09-15T21:55:35.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc63dd9b640 1 -- 172.21.15.1:0/3272105602 learned_addr learned my addr 172.21.15.1:0/3272105602 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:35.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc63e59c640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6280039c0 0x7fc640072b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc63ed9d640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6400b1f60 0x7fc6400b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc63dd9b640 1 -- 172.21.15.1:0/3272105602 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6400b1f60 msgr2=0x7fc6400b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc63dd9b640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6400b1f60 0x7fc6400b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc63dd9b640 1 -- 172.21.15.1:0/3272105602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6280039c0 msgr2=0x7fc640072b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc63dd9b640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6280039c0 0x7fc640072b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc63dd9b640 1 -- 172.21.15.1:0/3272105602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6400b2920 con 0x7fc640071d90 2024-09-15T21:55:35.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc63ed9d640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6400b1f60 0x7fc6400b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:35.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc63e59c640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6280039c0 0x7fc640072b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:35.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc63dd9b640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc640071d90 0x7fc6400721f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c760 tx=0x7fc63400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:35.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc62effd640 1 -- 172.21.15.1:0/3272105602 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634018070 con 0x7fc640071d90 2024-09-15T21:55:35.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc62effd640 1 -- 172.21.15.1:0/3272105602 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc634007500 con 0x7fc640071d90 2024-09-15T21:55:35.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 -- 172.21.15.1:0/3272105602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc640070e30 con 0x7fc640071d90 2024-09-15T21:55:35.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc62effd640 1 -- 172.21.15.1:0/3272105602 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634004a30 con 0x7fc640071d90 2024-09-15T21:55:35.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 -- 172.21.15.1:0/3272105602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6400716e0 con 0x7fc640071d90 2024-09-15T21:55:35.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.389+0000 7fc644c03640 1 -- 172.21.15.1:0/3272105602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc64009f430 con 0x7fc640071d90 2024-09-15T21:55:35.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.393+0000 7fc62effd640 1 -- 172.21.15.1:0/3272105602 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc63401b070 con 0x7fc640071d90 2024-09-15T21:55:35.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.393+0000 7fc62effd640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc6200678c0 0x7fc620069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.393+0000 7fc63e59c640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc6200678c0 0x7fc620069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.393+0000 7fc62effd640 1 -- 172.21.15.1:0/3272105602 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc634085150 con 0x7fc640071d90 2024-09-15T21:55:35.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.393+0000 7fc63e59c640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc6200678c0 0x7fc620069d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc6300ad000 tx=0x7fc6300a9040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:35.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.397+0000 7fc62effd640 1 -- 172.21.15.1:0/3272105602 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc6400b2920 con 0x7fc640071d90 2024-09-15T21:55:35.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.561+0000 7fc644c03640 1 -- 172.21.15.1:0/3272105602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6400b1be0 con 0x7fc640071d90 2024-09-15T21:55:35.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.561+0000 7fc62effd640 1 -- 172.21.15.1:0/3272105602 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16593 (secure 0 0 0) 0x7fc634055c80 con 0x7fc640071d90 2024-09-15T21:55:35.566 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:35.566 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:22.028149+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:18.271646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:19.444906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:35.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.565+0000 7fc644c03640 1 -- 172.21.15.1:0/3272105602 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc6200678c0 msgr2=0x7fc620069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.565+0000 7fc644c03640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc6200678c0 0x7fc620069d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc6300ad000 tx=0x7fc6300a9040 comp rx=0 tx=0).stop 2024-09-15T21:55:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.565+0000 7fc644c03640 1 -- 172.21.15.1:0/3272105602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc640071d90 msgr2=0x7fc6400721f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.565+0000 7fc644c03640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc640071d90 0x7fc6400721f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c760 tx=0x7fc63400cc20 comp rx=0 tx=0).stop 2024-09-15T21:55:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.565+0000 7fc644c03640 1 -- 172.21.15.1:0/3272105602 shutdown_connections 2024-09-15T21:55:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.565+0000 7fc644c03640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc6400b1f60 0x7fc6400b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.565+0000 7fc644c03640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc640071d90 0x7fc6400721f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.565+0000 7fc644c03640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc6200678c0 0x7fc620069d80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.565+0000 7fc644c03640 1 --2- 172.21.15.1:0/3272105602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6280039c0 0x7fc640072b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.565+0000 7fc644c03640 1 -- 172.21.15.1:0/3272105602 >> 172.21.15.1:0/3272105602 conn(0x7fc6400b5c40 msgr2=0x7fc6401456b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.565+0000 7fc644c03640 1 -- 172.21.15.1:0/3272105602 shutdown_connections 2024-09-15T21:55:35.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.565+0000 7fc644c03640 1 -- 172.21.15.1:0/3272105602 wait complete. 2024-09-15T21:55:35.586 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:55:35.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f431ef1d640 1 Processor -- start 2024-09-15T21:55:35.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f431ef1d640 1 -- start start 2024-09-15T21:55:35.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f431ef1d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f43180b5600 0x7f431809ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f431ef1d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43180b6a50 con 0x7f43180b5220 2024-09-15T21:55:35.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f431ef1d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431809b240 con 0x7f4318148f20 2024-09-15T21:55:35.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f431ef1d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f431809b800 con 0x7f43180b5600 2024-09-15T21:55:35.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f4317fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f43180b5600 0x7f431809ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f431ccb9640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f43180b5220 0x7f431809aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:49832/0 (socket says 172.21.15.1:49832) 2024-09-15T21:55:35.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f431ccb9640 1 -- 172.21.15.1:0/3420397411 learned_addr learned my addr 172.21.15.1:0/3420397411 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:35.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f4317fff640 1 -- 172.21.15.1:0/3420397411 >> v1:172.21.15.70:6789/0 conn(0x7f4318148f20 legacy=0x7f4318149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f4317fff640 1 -- 172.21.15.1:0/3420397411 >> v1:172.21.15.1:6789/0 conn(0x7f43180b5220 legacy=0x7f431809aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f4317fff640 1 -- 172.21.15.1:0/3420397411 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431809b520 con 0x7f43180b5600 2024-09-15T21:55:35.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f43177fe640 1 -- 172.21.15.1:0/3420397411 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004540345 0 0) 0x7f43180b6a50 con 0x7f43180b5220 2024-09-15T21:55:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f4317fff640 1 --2- 172.21.15.1:0/3420397411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43180b5600 0x7f431809ee10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f430c0097c0 tx=0x7f430c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0dd46cbbb334b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f43177fe640 1 -- 172.21.15.1:0/3420397411 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c0b0070 con 0x7f43180b5600 2024-09-15T21:55:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f43177fe640 1 -- 172.21.15.1:0/3420397411 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430c0ab600 con 0x7f43180b5600 2024-09-15T21:55:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.705+0000 7f43177fe640 1 -- 172.21.15.1:0/3420397411 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c0ab9d0 con 0x7f43180b5600 2024-09-15T21:55:35.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 -- 172.21.15.1:0/3420397411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43180b5600 msgr2=0x7f431809ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 --2- 172.21.15.1:0/3420397411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43180b5600 0x7f431809ee10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f430c0097c0 tx=0x7f430c01c380 comp rx=0 tx=0).stop 2024-09-15T21:55:35.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 -- 172.21.15.1:0/3420397411 shutdown_connections 2024-09-15T21:55:35.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 --2- 172.21.15.1:0/3420397411 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43180b5600 0x7f431809ee10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 -- 172.21.15.1:0/3420397411 >> 172.21.15.1:0/3420397411 conn(0x7f43180b5c40 msgr2=0x7f43180b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:35.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 -- 172.21.15.1:0/3420397411 shutdown_connections 2024-09-15T21:55:35.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 -- 172.21.15.1:0/3420397411 wait complete. 2024-09-15T21:55:35.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 Processor -- start 2024-09-15T21:55:35.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 -- start start 2024-09-15T21:55:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43180b5220 0x7f4318145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f43180b5600 0x7f4318145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4318148f20 0x7f431813b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4318153aa0 con 0x7f43180b5220 2024-09-15T21:55:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4318153920 con 0x7f4318148f20 2024-09-15T21:55:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4318153c20 con 0x7f43180b5600 2024-09-15T21:55:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ccb9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43180b5220 0x7f4318145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ccb9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43180b5220 0x7f4318145db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60722/0 (socket says 172.21.15.1:60722) 2024-09-15T21:55:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ccb9640 1 -- 172.21.15.1:0/1088551999 learned_addr learned my addr 172.21.15.1:0/1088551999 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431d4ba640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4318148f20 0x7f431813b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f4317fff640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f43180b5600 0x7f4318145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ccb9640 1 -- 172.21.15.1:0/1088551999 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f43180b5600 msgr2=0x7f4318145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ccb9640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f43180b5600 0x7f4318145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ccb9640 1 -- 172.21.15.1:0/1088551999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4318148f20 msgr2=0x7f431813b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ccb9640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4318148f20 0x7f431813b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ccb9640 1 -- 172.21.15.1:0/1088551999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4318070360 con 0x7f43180b5220 2024-09-15T21:55:35.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ccb9640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43180b5220 0x7f4318145db0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f430800c440 tx=0x7f430800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:35.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f43157fa640 1 -- 172.21.15.1:0/1088551999 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308018070 con 0x7f43180b5220 2024-09-15T21:55:35.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f43157fa640 1 -- 172.21.15.1:0/1088551999 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43080074e0 con 0x7f43180b5220 2024-09-15T21:55:35.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 -- 172.21.15.1:0/1088551999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4318144230 con 0x7f43180b5220 2024-09-15T21:55:35.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f43157fa640 1 -- 172.21.15.1:0/1088551999 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308004a10 con 0x7f43180b5220 2024-09-15T21:55:35.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 -- 172.21.15.1:0/1088551999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4318144d70 con 0x7f43180b5220 2024-09-15T21:55:35.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.709+0000 7f431ef1d640 1 -- 172.21.15.1:0/1088551999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f431809ee10 con 0x7f43180b5220 2024-09-15T21:55:35.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.713+0000 7f43157fa640 1 -- 172.21.15.1:0/1088551999 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f430801b070 con 0x7f43180b5220 2024-09-15T21:55:35.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.713+0000 7f43157fa640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f43040678c0 0x7f4304069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:35.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.713+0000 7f43157fa640 1 -- 172.21.15.1:0/1088551999 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4308084dd0 con 0x7f43180b5220 2024-09-15T21:55:35.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.713+0000 7f4317fff640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f43040678c0 0x7f4304069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:35.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.713+0000 7f4317fff640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f43040678c0 0x7f4304069d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f430c0ad000 tx=0x7f430c0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:35.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.717+0000 7f43157fa640 1 -- 172.21.15.1:0/1088551999 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4308055350 con 0x7f43180b5220 2024-09-15T21:55:35.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f431ef1d640 1 -- 172.21.15.1:0/1088551999 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4318144fb0 con 0x7f43180b5220 2024-09-15T21:55:35.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f43157fa640 1 -- 172.21.15.1:0/1088551999 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3566 (secure 0 0 0) 0x7f4308086090 con 0x7f43180b5220 2024-09-15T21:55:35.917 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:35.917 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-09-15T21:55:24:061270+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/2650682187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2650682187},{"type":"v1","addr":"172.21.15.70:6833","nonce":2650682187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:20.400358+0000","modified":"2024-09-15T21:55:23.425841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3288963990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3288963990},{"type":"v1","addr":"172.21.15.1:6835","nonce":3288963990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4245,"qdb_cluster":[4245]},"id":1}]} 2024-09-15T21:55:35.917 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-09-15T21:55:35.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f431ef1d640 1 -- 172.21.15.1:0/1088551999 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f43040678c0 msgr2=0x7f4304069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f431ef1d640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f43040678c0 0x7f4304069d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f430c0ad000 tx=0x7f430c0a6000 comp rx=0 tx=0).stop 2024-09-15T21:55:35.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f431ef1d640 1 -- 172.21.15.1:0/1088551999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43180b5220 msgr2=0x7f4318145db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:35.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f431ef1d640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43180b5220 0x7f4318145db0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f430800c440 tx=0x7f430800c900 comp rx=0 tx=0).stop 2024-09-15T21:55:35.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f431ef1d640 1 -- 172.21.15.1:0/1088551999 shutdown_connections 2024-09-15T21:55:35.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f431ef1d640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f43040678c0 0x7f4304069d80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f431ef1d640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4318148f20 0x7f431813b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f431ef1d640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f43180b5600 0x7f4318145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f431ef1d640 1 --2- 172.21.15.1:0/1088551999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43180b5220 0x7f4318145db0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:35.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f431ef1d640 1 -- 172.21.15.1:0/1088551999 >> 172.21.15.1:0/1088551999 conn(0x7f43180b5c40 msgr2=0x7f43180b7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:35.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f431ef1d640 1 -- 172.21.15.1:0/1088551999 shutdown_connections 2024-09-15T21:55:35.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:35.913+0000 7f431ef1d640 1 -- 172.21.15.1:0/1088551999 wait complete. 2024-09-15T21:55:36.136 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T21:55:20.400358+0000', 'modified': '2024-09-15T21:55:23.425841+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4245}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4245': {'gid': 4245, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.1:6835/3288963990', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6834', 'nonce': 3288963990}, {'type': 'v1', 'addr': '172.21.15.1:6835', 'nonce': 3288963990}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4245, 'qdb_cluster': [4245]} 2024-09-15T21:55:36.136 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T21:55:36.137 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T21:55:36.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.261+0000 7f5bd89fd640 1 Processor -- start 2024-09-15T21:55:36.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.261+0000 7f5bd89fd640 1 -- start start 2024-09-15T21:55:36.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bd89fd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5bd406d0d0 0x7f5bd40b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bd89fd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5bd4149450 0x7f5bd409dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bd89fd640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bd406d5b0 con 0x7f5bd40b4560 2024-09-15T21:55:36.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bd89fd640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f5bd406dc00 con 0x7f5bd406d0d0 2024-09-15T21:55:36.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bd89fd640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f5bd406d890 con 0x7f5bd4149450 2024-09-15T21:55:36.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bc9d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5bd406d0d0 0x7f5bd40b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bc9d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5bd406d0d0 0x7f5bd40b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60730/0 (socket says 172.21.15.1:60730) 2024-09-15T21:55:36.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bc9d9b640 1 -- 172.21.15.1:0/3176247893 learned_addr learned my addr 172.21.15.1:0/3176247893 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:36.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bd2d9d640 1 --2- 172.21.15.1:0/3176247893 >> v2:172.21.15.70:3300/0 conn(0x7f5bd4149450 0x7f5bd409dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bc9d9b640 1 -- 172.21.15.1:0/3176247893 >> v2:172.21.15.70:3300/0 conn(0x7f5bd4149450 msgr2=0x7f5bd409dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:36.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bc9d9b640 1 --2- 172.21.15.1:0/3176247893 >> v2:172.21.15.70:3300/0 conn(0x7f5bd4149450 0x7f5bd409dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bc9d9b640 1 -- 172.21.15.1:0/3176247893 >> v1:172.21.15.70:6789/0 conn(0x7f5bd40b4560 legacy=0x7f5bd4148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:36.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bc9d9b640 1 -- 172.21.15.1:0/3176247893 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd40b3ad0 con 0x7f5bd406d0d0 2024-09-15T21:55:36.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bc9d9b640 1 --2- 172.21.15.1:0/3176247893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bd406d0d0 0x7f5bd40b4940 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5bd41456d0 tx=0x7f5bbc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6748031ab4692758 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:36.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bd1d9b640 1 -- 172.21.15.1:0/3176247893 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc0b2070 con 0x7f5bd406d0d0 2024-09-15T21:55:36.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bd1d9b640 1 -- 172.21.15.1:0/3176247893 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bbc0a9070 con 0x7f5bd406d0d0 2024-09-15T21:55:36.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bd1d9b640 1 -- 172.21.15.1:0/3176247893 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc0ad880 con 0x7f5bd406d0d0 2024-09-15T21:55:36.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bd89fd640 1 -- 172.21.15.1:0/3176247893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bd406d0d0 msgr2=0x7f5bd40b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.265+0000 7f5bd89fd640 1 --2- 172.21.15.1:0/3176247893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bd406d0d0 0x7f5bd40b4940 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5bd41456d0 tx=0x7f5bbc01c450 comp rx=0 tx=0).stop 2024-09-15T21:55:36.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 -- 172.21.15.1:0/3176247893 shutdown_connections 2024-09-15T21:55:36.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 --2- 172.21.15.1:0/3176247893 >> v2:172.21.15.70:3300/0 conn(0x7f5bd4149450 0x7f5bd409dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 --2- 172.21.15.1:0/3176247893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bd406d0d0 0x7f5bd40b4940 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 -- 172.21.15.1:0/3176247893 >> 172.21.15.1:0/3176247893 conn(0x7f5bd406c730 msgr2=0x7f5bd40b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:36.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 -- 172.21.15.1:0/3176247893 shutdown_connections 2024-09-15T21:55:36.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 -- 172.21.15.1:0/3176247893 wait complete. 2024-09-15T21:55:36.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 Processor -- start 2024-09-15T21:55:36.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 -- start start 2024-09-15T21:55:36.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bd406d0d0 0x7f5bd40b8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bd40b4560 0x7f5bd41e0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bd4149450 0x7f5bd41423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd4152b20 con 0x7f5bd40b4560 2024-09-15T21:55:36.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd41529a0 con 0x7f5bd406d0d0 2024-09-15T21:55:36.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5bd4152ca0 con 0x7f5bd4149450 2024-09-15T21:55:36.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bc9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bd40b4560 0x7f5bd41e0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bc9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bd40b4560 0x7f5bd41e0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60734/0 (socket says 172.21.15.1:60734) 2024-09-15T21:55:36.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bc9d9b640 1 -- 172.21.15.1:0/1203584272 learned_addr learned my addr 172.21.15.1:0/1203584272 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:36.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd259c640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bd406d0d0 0x7f5bd40b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd2d9d640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bd4149450 0x7f5bd41423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bc9d9b640 1 -- 172.21.15.1:0/1203584272 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bd4149450 msgr2=0x7f5bd41423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bc9d9b640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bd4149450 0x7f5bd41423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bc9d9b640 1 -- 172.21.15.1:0/1203584272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bd406d0d0 msgr2=0x7f5bd40b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bc9d9b640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bd406d0d0 0x7f5bd40b8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bc9d9b640 1 -- 172.21.15.1:0/1203584272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd41e3820 con 0x7f5bd40b4560 2024-09-15T21:55:36.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bc9d9b640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bd40b4560 0x7f5bd41e0180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc01a080 tx=0x7f5bbc0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:36.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bcb7fe640 1 -- 172.21.15.1:0/1203584272 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc0b2040 con 0x7f5bd40b4560 2024-09-15T21:55:36.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bcb7fe640 1 -- 172.21.15.1:0/1203584272 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bbc0bb070 con 0x7f5bd40b4560 2024-09-15T21:55:36.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 -- 172.21.15.1:0/1203584272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd41e3b00 con 0x7f5bd40b4560 2024-09-15T21:55:36.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bcb7fe640 1 -- 172.21.15.1:0/1203584272 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc0b6860 con 0x7f5bd40b4560 2024-09-15T21:55:36.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.269+0000 7f5bd89fd640 1 -- 172.21.15.1:0/1203584272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd41e06c0 con 0x7f5bd40b4560 2024-09-15T21:55:36.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bcb7fe640 1 -- 172.21.15.1:0/1203584272 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5bbc0ab070 con 0x7f5bd40b4560 2024-09-15T21:55:36.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bcb7fe640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5bb40678c0 0x7f5bb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bcb7fe640 1 -- 172.21.15.1:0/1203584272 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5bbc11fab0 con 0x7f5bd40b4560 2024-09-15T21:55:36.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bd259c640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5bb40678c0 0x7f5bb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bd259c640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5bb40678c0 0x7f5bb4069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4004e30 tx=0x7f5bc4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:36.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bdbab9000 1 Processor -- start 2024-09-15T21:55:36.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bdbab9000 1 -- start start 2024-09-15T21:55:36.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bdbab9000 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 0x560eeafe9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bdbab9000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9670 0x560eeafe9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bdbab9000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafe9f90 0x560eeafea370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bdbab9000 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560eeaed0b60 con 0x560eeafef010 2024-09-15T21:55:36.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bdbab9000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560eeae37c70 con 0x560eeafe9f90 2024-09-15T21:55:36.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bdbab9000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x560eeaddded0 con 0x560eeafe9670 2024-09-15T21:55:36.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bd259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 0x560eeafe9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bd259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 0x560eeafe9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60744/0 (socket says 172.21.15.1:60744) 2024-09-15T21:55:36.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bd259c640 1 -- 172.21.15.1:0/1311104566 learned_addr learned my addr 172.21.15.1:0/1311104566 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:36.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bc9d9b640 1 --2- 172.21.15.1:0/1311104566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9670 0x560eeafe9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bd2d9d640 1 --2- 172.21.15.1:0/1311104566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafe9f90 0x560eeafea370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bd259c640 1 -- 172.21.15.1:0/1311104566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9670 msgr2=0x560eeafe9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:36.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bd259c640 1 --2- 172.21.15.1:0/1311104566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9670 0x560eeafe9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bd259c640 1 -- 172.21.15.1:0/1311104566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafe9f90 msgr2=0x560eeafea370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:36.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bd259c640 1 --2- 172.21.15.1:0/1311104566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafe9f90 0x560eeafea370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bd259c640 1 -- 172.21.15.1:0/1311104566 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eeadefe50 con 0x560eeafef010 2024-09-15T21:55:36.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bc9d9b640 1 --2- 172.21.15.1:0/1311104566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9670 0x560eeafe9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bd2d9d640 1 --2- 172.21.15.1:0/1311104566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafe9f90 0x560eeafea370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bd259c640 1 --2- 172.21.15.1:0/1311104566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 0x560eeafe9130 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4005630 tx=0x7f5bc4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd56009c5d3a297 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bb3fff640 1 -- 172.21.15.1:0/1311104566 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4025070 con 0x560eeafef010 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bb3fff640 1 -- 172.21.15.1:0/1311104566 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc40158b0 con 0x560eeafef010 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bb3fff640 1 -- 172.21.15.1:0/1311104566 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4015c60 con 0x560eeafef010 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bdbab9000 1 -- 172.21.15.1:0/1311104566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 msgr2=0x560eeafe9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/1311104566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 0x560eeafe9130 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4005630 tx=0x7f5bc4011000 comp rx=0 tx=0).stop 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.273+0000 7f5bdbab9000 1 -- 172.21.15.1:0/1311104566 shutdown_connections 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/1311104566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafe9f90 0x560eeafea370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/1311104566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9670 0x560eeafe9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/1311104566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 0x560eeafe9130 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 -- 172.21.15.1:0/1311104566 >> 172.21.15.1:0/1311104566 conn(0x560eeafe5620 msgr2=0x560eeafe7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 -- 172.21.15.1:0/1311104566 shutdown_connections 2024-09-15T21:55:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 -- 172.21.15.1:0/1311104566 wait complete. 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 -- start start 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 Processor -- start 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9670 0x560eeb019f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafe9f90 0x560eeb01a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 0x560eeb0223f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560eeae99b00 con 0x560eeafef010 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560eeae12360 con 0x560eeafe9f90 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x560eeae0f2d0 con 0x560eeafe9670 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 10 client.0 _ll_register_callbacks cb 0x560eeafd4820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bd2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 0x560eeb0223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bd2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 0x560eeb0223f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60746/0 (socket says 172.21.15.1:60746) 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bd2d9d640 1 -- 172.21.15.1:0/2421416163 learned_addr learned my addr 172.21.15.1:0/2421416163 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bc9d9b640 1 --2- 172.21.15.1:0/2421416163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafe9f90 0x560eeb01a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bd259c640 1 --2- 172.21.15.1:0/2421416163 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9670 0x560eeb019f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bd2d9d640 1 -- 172.21.15.1:0/2421416163 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9670 msgr2=0x560eeb019f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:36.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bd2d9d640 1 --2- 172.21.15.1:0/2421416163 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9670 0x560eeb019f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bd2d9d640 1 -- 172.21.15.1:0/2421416163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafe9f90 msgr2=0x560eeb01a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:36.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bd2d9d640 1 --2- 172.21.15.1:0/2421416163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafe9f90 0x560eeb01a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bd2d9d640 1 -- 172.21.15.1:0/2421416163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eeadde120 con 0x560eeafef010 2024-09-15T21:55:36.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bd2d9d640 1 --2- 172.21.15.1:0/2421416163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 0x560eeb0223f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0079d0 tx=0x7f5bcc007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3194acd6e96cb14e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:36.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T21:55:36.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bb17fa640 1 -- 172.21.15.1:0/2421416163 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc019020 con 0x560eeafef010 2024-09-15T21:55:36.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 -- 172.21.15.1:0/2421416163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bc40158b0 con 0x560eeafef010 2024-09-15T21:55:36.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bb17fa640 1 -- 172.21.15.1:0/2421416163 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5bcc010c70 con 0x560eeafef010 2024-09-15T21:55:36.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bb17fa640 1 -- 172.21.15.1:0/2421416163 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f5bcc023050 con 0x560eeafef010 2024-09-15T21:55:36.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 10 client.4590 fetch_fsmap learned FSMap version 8 2024-09-15T21:55:36.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 -- 172.21.15.1:0/2421416163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x560eeadd7450 con 0x560eeafef010 2024-09-15T21:55:36.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bb17fa640 1 -- 172.21.15.1:0/2421416163 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc40158b0 con 0x560eeafef010 2024-09-15T21:55:36.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bb17fa640 1 -- 172.21.15.1:0/2421416163 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 8) ==== 2292+0+0 (secure 0 0 0) 0x7f5bcc026020 con 0x560eeafef010 2024-09-15T21:55:36.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 10 client.4590 fetch_fsmap finished waiting for FSMap version 8 2024-09-15T21:55:36.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 10 client.4590 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T21:55:36.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 20 client.4590 populate_metadata read hostname 'smithi001' 2024-09-15T21:55:36.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/2421416163 >> [v2:172.21.15.1:6834/3288963990,v1:172.21.15.1:6835/3288963990] conn(0x560eeb022e00 0x560eeb0231e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 4 client.4590 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T21:55:36.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 -- 172.21.15.1:0/2421416163 --> [v2:172.21.15.1:6834/3288963990,v1:172.21.15.1:6835/3288963990] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560eeadd1c00 con 0x560eeb022e00 2024-09-15T21:55:36.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bd259c640 1 --2- 172.21.15.1:0/2421416163 >> [v2:172.21.15.1:6834/3288963990,v1:172.21.15.1:6835/3288963990] conn(0x560eeb022e00 0x560eeb0231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bb17fa640 10 client.4590 ms_handle_connect on v2:172.21.15.1:6834/3288963990 2024-09-15T21:55:36.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bd259c640 1 --2- 172.21.15.1:0/2421416163 >> [v2:172.21.15.1:6834/3288963990,v1:172.21.15.1:6835/3288963990] conn(0x560eeb022e00 0x560eeb0231e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a33a208bed777f71 server_cookie=b38d6a49c4475cc2 in_seq=0 out_seq=0 2024-09-15T21:55:36.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bb17fa640 1 -- 172.21.15.1:0/2421416163 <== mds.0 v2:172.21.15.1:6834/3288963990 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560eeadd1c00 con 0x560eeb022e00 2024-09-15T21:55:36.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bb17fa640 10 client.4590 handle_command_reply: tid=0 2024-09-15T21:55:36.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.277+0000 7f5bdbab9000 1 client.4590 shutdown 2024-09-15T21:55:36.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.281+0000 7f5bdbab9000 1 -- 172.21.15.1:0/2421416163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 msgr2=0x560eeb0223f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.281+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/2421416163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 0x560eeb0223f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc0079d0 tx=0x7f5bcc007e90 comp rx=0 tx=0).stop 2024-09-15T21:55:36.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.281+0000 7f5bdbab9000 1 -- 172.21.15.1:0/2421416163 shutdown_connections 2024-09-15T21:55:36.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.281+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/2421416163 >> [v2:172.21.15.1:6834/3288963990,v1:172.21.15.1:6835/3288963990] conn(0x560eeb022e00 0x560eeb0231e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.281+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/2421416163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafef010 0x560eeb0223f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.281+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/2421416163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafe9f90 0x560eeb01a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.281+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/2421416163 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9670 0x560eeb019f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.281+0000 7f5bb17fa640 0 client.4590 ms_handle_reset on v2:172.21.15.1:6834/3288963990 2024-09-15T21:55:36.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.281+0000 7f5bdbab9000 1 -- 172.21.15.1:0/2421416163 >> 172.21.15.1:0/2421416163 conn(0x560eeafe5620 msgr2=0x560eeafe8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:36.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.281+0000 7f5bdbab9000 1 -- 172.21.15.1:0/2421416163 shutdown_connections 2024-09-15T21:55:36.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.281+0000 7f5bdbab9000 1 -- 172.21.15.1:0/2421416163 wait complete. 2024-09-15T21:55:36.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.281+0000 7f5bdbab9000 20 client.4590 trim_cache size 0 max 16384 2024-09-15T21:55:36.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bdbab9000 1 Processor -- start 2024-09-15T21:55:36.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bdbab9000 1 -- start start 2024-09-15T21:55:36.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bdbab9000 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 0x560eeb02a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bdbab9000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9f90 0x560eeb02a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bdbab9000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafef010 0x560eeb0241f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bdbab9000 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd41ecb70 con 0x560eeafe9670 2024-09-15T21:55:36.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bdbab9000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd41ebd00 con 0x560eeafef010 2024-09-15T21:55:36.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bdbab9000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x560eeadefca0 con 0x560eeafe9f90 2024-09-15T21:55:36.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bd259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 0x560eeb02a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bd259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 0x560eeb02a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60748/0 (socket says 172.21.15.1:60748) 2024-09-15T21:55:36.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bd259c640 1 -- 172.21.15.1:0/1027021518 learned_addr learned my addr 172.21.15.1:0/1027021518 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:36.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bd2d9d640 1 --2- 172.21.15.1:0/1027021518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafef010 0x560eeb0241f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bc9d9b640 1 --2- 172.21.15.1:0/1027021518 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9f90 0x560eeb02a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bd259c640 1 -- 172.21.15.1:0/1027021518 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9f90 msgr2=0x560eeb02a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bd259c640 1 --2- 172.21.15.1:0/1027021518 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9f90 0x560eeb02a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bd259c640 1 -- 172.21.15.1:0/1027021518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafef010 msgr2=0x560eeb0241f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bd259c640 1 --2- 172.21.15.1:0/1027021518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafef010 0x560eeb0241f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.297+0000 7f5bd259c640 1 -- 172.21.15.1:0/1027021518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eeadbefd0 con 0x560eeafe9670 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bd259c640 1 --2- 172.21.15.1:0/1027021518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 0x560eeb02a3a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4005600 tx=0x7f5bc4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3e17ee8434644d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bb37fe640 1 -- 172.21.15.1:0/1027021518 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4025040 con 0x560eeafe9670 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bb37fe640 1 -- 172.21.15.1:0/1027021518 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc4026040 con 0x560eeafe9670 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bb37fe640 1 -- 172.21.15.1:0/1027021518 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4003a10 con 0x560eeafe9670 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 -- 172.21.15.1:0/1027021518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 msgr2=0x560eeb02a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/1027021518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 0x560eeb02a3a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4005600 tx=0x7f5bc4013000 comp rx=0 tx=0).stop 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 -- 172.21.15.1:0/1027021518 shutdown_connections 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/1027021518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafef010 0x560eeb0241f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/1027021518 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9f90 0x560eeb02a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/1027021518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 0x560eeb02a3a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 -- 172.21.15.1:0/1027021518 >> 172.21.15.1:0/1027021518 conn(0x560eeafe5620 msgr2=0x560eeb0219c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:36.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 -- 172.21.15.1:0/1027021518 shutdown_connections 2024-09-15T21:55:36.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 -- 172.21.15.1:0/1027021518 wait complete. 2024-09-15T21:55:36.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 -- start start 2024-09-15T21:55:36.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 Processor -- start 2024-09-15T21:55:36.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 0x560eeb035120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9f90 0x560eeb02a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafef010 0x560eeb0276a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560eeae3c2a0 con 0x560eeafe9670 2024-09-15T21:55:36.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560eeae36f80 con 0x560eeafef010 2024-09-15T21:55:36.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x560eeadf60f0 con 0x560eeafe9f90 2024-09-15T21:55:36.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 10 client.0 _ll_register_callbacks cb 0x7f5bcc0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T21:55:36.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bd259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 0x560eeb035120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bd259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 0x560eeb035120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60762/0 (socket says 172.21.15.1:60762) 2024-09-15T21:55:36.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bd259c640 1 -- 172.21.15.1:0/3217814148 learned_addr learned my addr 172.21.15.1:0/3217814148 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:36.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bd2d9d640 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafef010 0x560eeb0276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bc9d9b640 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9f90 0x560eeb02a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bd259c640 1 -- 172.21.15.1:0/3217814148 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9f90 msgr2=0x560eeb02a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:36.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bd259c640 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9f90 0x560eeb02a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bd259c640 1 -- 172.21.15.1:0/3217814148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafef010 msgr2=0x560eeb0276a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:36.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bd259c640 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafef010 0x560eeb0276a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bd259c640 1 -- 172.21.15.1:0/3217814148 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eeaeba750 con 0x560eeafe9670 2024-09-15T21:55:36.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bd2d9d640 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafef010 0x560eeb0276a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:36.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bc9d9b640 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9f90 0x560eeb02a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:36.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bd259c640 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 0x560eeb035120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009010 tx=0x7f5bc4003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb38d7a814cd11fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:36.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T21:55:36.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bb17fa640 1 -- 172.21.15.1:0/3217814148 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc403a070 con 0x560eeafe9670 2024-09-15T21:55:36.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bb17fa640 1 -- 172.21.15.1:0/3217814148 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5bc4036710 con 0x560eeafe9670 2024-09-15T21:55:36.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 -- 172.21.15.1:0/3217814148 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bc4026040 con 0x560eeafe9670 2024-09-15T21:55:36.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bb17fa640 1 -- 172.21.15.1:0/3217814148 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f5bc4044050 con 0x560eeafe9670 2024-09-15T21:55:36.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 10 client.4596 fetch_fsmap learned FSMap version 8 2024-09-15T21:55:36.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 -- 172.21.15.1:0/3217814148 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x560eeadc5a30 con 0x560eeafe9670 2024-09-15T21:55:36.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bb17fa640 1 -- 172.21.15.1:0/3217814148 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc4026040 con 0x560eeafe9670 2024-09-15T21:55:36.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bb17fa640 1 -- 172.21.15.1:0/3217814148 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 8) ==== 2292+0+0 (secure 0 0 0) 0x7f5bc4047020 con 0x560eeafe9670 2024-09-15T21:55:36.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 10 client.4596 fetch_fsmap finished waiting for FSMap version 8 2024-09-15T21:55:36.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 10 client.4596 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T21:55:36.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 20 client.4596 populate_metadata read hostname 'smithi001' 2024-09-15T21:55:36.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.1:6834/3288963990,v1:172.21.15.1:6835/3288963990] conn(0x560eeb027be0 0x560eeb027fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 4 client.4596 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T21:55:36.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bdbab9000 1 -- 172.21.15.1:0/3217814148 --> [v2:172.21.15.1:6834/3288963990,v1:172.21.15.1:6835/3288963990] -- command(tid 0: {"prefix": "status"}) -- 0x560eeae453a0 con 0x560eeb027be0 2024-09-15T21:55:36.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.301+0000 7f5bc9d9b640 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.1:6834/3288963990,v1:172.21.15.1:6835/3288963990] conn(0x560eeb027be0 0x560eeb027fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bc9d9b640 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.1:6834/3288963990,v1:172.21.15.1:6835/3288963990] conn(0x560eeb027be0 0x560eeb027fc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8346937d1018073 server_cookie=fbb93a768c795e18 in_seq=0 out_seq=0 2024-09-15T21:55:36.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bb17fa640 10 client.4596 ms_handle_connect on v2:172.21.15.1:6834/3288963990 2024-09-15T21:55:36.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bb17fa640 1 -- 172.21.15.1:0/3217814148 <== mds.0 v2:172.21.15.1:6834/3288963990 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x560eeae453a0 con 0x560eeb027be0 2024-09-15T21:55:36.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bb17fa640 10 client.4596 handle_command_reply: tid=0 2024-09-15T21:55:36.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bdbab9000 1 client.4596 shutdown 2024-09-15T21:55:36.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bdbab9000 1 -- 172.21.15.1:0/3217814148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 msgr2=0x560eeb035120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 0x560eeb035120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009010 tx=0x7f5bc4003700 comp rx=0 tx=0).stop 2024-09-15T21:55:36.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bdbab9000 1 -- 172.21.15.1:0/3217814148 shutdown_connections 2024-09-15T21:55:36.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.1:6834/3288963990,v1:172.21.15.1:6835/3288963990] conn(0x560eeb027be0 0x560eeb027fc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eeafef010 0x560eeb0276a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560eeafe9f90 0x560eeb02a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bb17fa640 0 client.4596 ms_handle_reset on v2:172.21.15.1:6834/3288963990 2024-09-15T21:55:36.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bdbab9000 1 --2- 172.21.15.1:0/3217814148 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560eeafe9670 0x560eeb035120 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bdbab9000 1 -- 172.21.15.1:0/3217814148 >> 172.21.15.1:0/3217814148 conn(0x560eeafe5620 msgr2=0x560eeb0211a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:36.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bdbab9000 1 -- 172.21.15.1:0/3217814148 shutdown_connections 2024-09-15T21:55:36.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bdbab9000 1 -- 172.21.15.1:0/3217814148 wait complete. 2024-09-15T21:55:36.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bdbab9000 20 client.4596 trim_cache size 0 max 16384 2024-09-15T21:55:36.315 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T21:55:36.315 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "a77d0aed-4b44-4b66-9239-aae9fcdd297c", 2024-09-15T21:55:36.316 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-15T21:55:36.316 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 4245, 2024-09-15T21:55:36.316 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-15T21:55:36.316 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-15T21:55:36.316 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-15T21:55:36.316 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 15.278722525999999, 2024-09-15T21:55:36.316 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 8, 2024-09-15T21:55:36.316 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 21, 2024-09-15T21:55:36.316 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 21, 2024-09-15T21:55:36.316 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 21.351306000000001 2024-09-15T21:55:36.316 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T21:55:36.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bd89fd640 1 -- 172.21.15.1:0/1203584272 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5bb40678c0 msgr2=0x7f5bb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bd89fd640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5bb40678c0 0x7f5bb4069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4004e30 tx=0x7f5bc4009040 comp rx=0 tx=0).stop 2024-09-15T21:55:36.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bd89fd640 1 -- 172.21.15.1:0/1203584272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bd40b4560 msgr2=0x7f5bd41e0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bd89fd640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bd40b4560 0x7f5bd41e0180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc01a080 tx=0x7f5bbc0191f0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bd89fd640 1 -- 172.21.15.1:0/1203584272 shutdown_connections 2024-09-15T21:55:36.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bd89fd640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5bd4149450 0x7f5bd41423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bd89fd640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5bd40b4560 0x7f5bd41e0180 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bd89fd640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5bb40678c0 0x7f5bb4069d80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bd89fd640 1 --2- 172.21.15.1:0/1203584272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bd406d0d0 0x7f5bd40b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bd89fd640 1 -- 172.21.15.1:0/1203584272 >> 172.21.15.1:0/1203584272 conn(0x7f5bd406c730 msgr2=0x7f5bd413f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:36.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bd89fd640 1 -- 172.21.15.1:0/1203584272 shutdown_connections 2024-09-15T21:55:36.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.305+0000 7f5bd89fd640 1 -- 172.21.15.1:0/1203584272 wait complete. 2024-09-15T21:55:36.324 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T21:55:36.334 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T21:55:36.334 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T21:55:36.334 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T21:55:36.334 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-15T21:55:36.366 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-15T21:55:36.366 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-15T21:55:36.366 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-15T21:55:36.367 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T21:55:36.367 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T21:55:36.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:36.367 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-15T21:55:36.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:36.372 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-15T21:55:36.425 INFO:teuthology.orchestra.run.smithi001.stderr:Cannot find device "ceph-brx" 2024-09-15T21:55:36.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:55:36.427 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-15T21:55:36.427 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-15T21:55:36.427 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T21:55:36.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f767622c640 1 Processor -- start 2024-09-15T21:55:36.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f767622c640 1 -- start start 2024-09-15T21:55:36.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f767622c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f76700ae3a0 0x7f767009eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f767622c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76700b4c50 0x7f7670147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f767622c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76700b00f0 con 0x7f76700af160 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f767622c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f76700afe10 con 0x7f76700ae3a0 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f767622c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f76700b50e0 con 0x7f76700b4c50 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f766f7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f76700ae3a0 0x7f767009eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f7667fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76700b4c50 0x7f7670147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f7667fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76700b4c50 0x7f7670147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:34808/0 (socket says 172.21.15.1:34808) 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f766ffff640 1 --1- 172.21.15.1:0/1503064566 >> v1:172.21.15.70:6789/0 conn(0x7f76700af160 0x7f767009aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.1:59146/0 (socket says 172.21.15.1:59146) 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f7667fff640 1 -- 172.21.15.1:0/1503064566 learned_addr learned my addr 172.21.15.1:0/1503064566 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f766f7fe640 1 -- 172.21.15.1:0/1503064566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76700b4c50 msgr2=0x7f7670147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f766f7fe640 1 --2- 172.21.15.1:0/1503064566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76700b4c50 0x7f7670147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f766f7fe640 1 -- 172.21.15.1:0/1503064566 >> v1:172.21.15.70:6789/0 conn(0x7f76700af160 legacy=0x7f767009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f766f7fe640 1 -- 172.21.15.1:0/1503064566 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76700b53c0 con 0x7f76700ae3a0 2024-09-15T21:55:36.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.597+0000 7f7667fff640 1 --2- 172.21.15.1:0/1503064566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76700b4c50 0x7f7670147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:55:36.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f766f7fe640 1 --2- 172.21.15.1:0/1503064566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76700ae3a0 0x7f767009eb50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f76600097c0 tx=0x7f766001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1011f1f8d402af1d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:36.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f766effd640 1 -- 172.21.15.1:0/1503064566 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76600ab600 con 0x7f76700ae3a0 2024-09-15T21:55:36.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f766effd640 1 -- 172.21.15.1:0/1503064566 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76600b0070 con 0x7f76700ae3a0 2024-09-15T21:55:36.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f766effd640 1 -- 172.21.15.1:0/1503064566 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76600ab9c0 con 0x7f76700ae3a0 2024-09-15T21:55:36.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 -- 172.21.15.1:0/1503064566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76700ae3a0 msgr2=0x7f767009eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 --2- 172.21.15.1:0/1503064566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76700ae3a0 0x7f767009eb50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f76600097c0 tx=0x7f766001c3e0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 -- 172.21.15.1:0/1503064566 shutdown_connections 2024-09-15T21:55:36.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 --2- 172.21.15.1:0/1503064566 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76700b4c50 0x7f7670147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 --2- 172.21.15.1:0/1503064566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76700ae3a0 0x7f767009eb50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 -- 172.21.15.1:0/1503064566 >> 172.21.15.1:0/1503064566 conn(0x7f76700b5c40 msgr2=0x7f76700b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:36.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 -- 172.21.15.1:0/1503064566 shutdown_connections 2024-09-15T21:55:36.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 -- 172.21.15.1:0/1503064566 wait complete. 2024-09-15T21:55:36.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 Processor -- start 2024-09-15T21:55:36.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 -- start start 2024-09-15T21:55:36.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76700ae3a0 0x7f7670141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76700af160 0x7f767014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76701e3850 0x7f76701e3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7670150060 con 0x7f76700af160 2024-09-15T21:55:36.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f767014fee0 con 0x7f76700ae3a0 2024-09-15T21:55:36.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f767622c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f76701501e0 con 0x7f76701e3850 2024-09-15T21:55:36.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f7667fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76700af160 0x7f767014ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f7667fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76700af160 0x7f767014ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60776/0 (socket says 172.21.15.1:60776) 2024-09-15T21:55:36.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f7667fff640 1 -- 172.21.15.1:0/2493565973 learned_addr learned my addr 172.21.15.1:0/2493565973 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:36.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f766f7fe640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76700ae3a0 0x7f7670141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.601+0000 7f766ffff640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76701e3850 0x7f76701e3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f7667fff640 1 -- 172.21.15.1:0/2493565973 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76701e3850 msgr2=0x7f76701e3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f7667fff640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76701e3850 0x7f76701e3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f7667fff640 1 -- 172.21.15.1:0/2493565973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76700ae3a0 msgr2=0x7f7670141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f7667fff640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76700ae3a0 0x7f7670141640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f7667fff640 1 -- 172.21.15.1:0/2493565973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767013ffa0 con 0x7f76700af160 2024-09-15T21:55:36.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f766f7fe640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76700ae3a0 0x7f7670141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:36.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f766ffff640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76701e3850 0x7f76701e3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:36.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f7667fff640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76700af160 0x7f767014ea20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f765800ea00 tx=0x7f765800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:36.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f766cff9640 1 -- 172.21.15.1:0/2493565973 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7658017070 con 0x7f76700af160 2024-09-15T21:55:36.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f766cff9640 1 -- 172.21.15.1:0/2493565973 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f765800ca60 con 0x7f76700af160 2024-09-15T21:55:36.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f767622c640 1 -- 172.21.15.1:0/2493565973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76701464b0 con 0x7f76700af160 2024-09-15T21:55:36.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f766cff9640 1 -- 172.21.15.1:0/2493565973 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765800ce10 con 0x7f76700af160 2024-09-15T21:55:36.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f767622c640 1 -- 172.21.15.1:0/2493565973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7670146a70 con 0x7f76700af160 2024-09-15T21:55:36.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f767622c640 1 -- 172.21.15.1:0/2493565973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f767009eb50 con 0x7f76700af160 2024-09-15T21:55:36.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f766cff9640 1 -- 172.21.15.1:0/2493565973 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f765801a070 con 0x7f76700af160 2024-09-15T21:55:36.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f766cff9640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f76500678f0 0x7f7650069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:36.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f766cff9640 1 -- 172.21.15.1:0/2493565973 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7658085b50 con 0x7f76700af160 2024-09-15T21:55:36.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f766f7fe640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f76500678f0 0x7f7650069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:36.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.605+0000 7f766f7fe640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f76500678f0 0x7f7650069db0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f76600af000 tx=0x7f76600a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:36.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.609+0000 7f766cff9640 1 -- 172.21.15.1:0/2493565973 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f767013ffa0 con 0x7f76700af160 2024-09-15T21:55:36.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.801+0000 7f767622c640 1 -- 172.21.15.1:0/2493565973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7670146280 con 0x7f76700af160 2024-09-15T21:55:36.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.805+0000 7f766cff9640 1 -- 172.21.15.1:0/2493565973 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f7658056720 con 0x7f76700af160 2024-09-15T21:55:36.808 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T21:55:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.805+0000 7f767622c640 1 -- 172.21.15.1:0/2493565973 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f76500678f0 msgr2=0x7f7650069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.805+0000 7f767622c640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f76500678f0 0x7f7650069db0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f76600af000 tx=0x7f76600a7000 comp rx=0 tx=0).stop 2024-09-15T21:55:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.805+0000 7f767622c640 1 -- 172.21.15.1:0/2493565973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76700af160 msgr2=0x7f767014ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.805+0000 7f767622c640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76700af160 0x7f767014ea20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f765800ea00 tx=0x7f765800eec0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.805+0000 7f767622c640 1 -- 172.21.15.1:0/2493565973 shutdown_connections 2024-09-15T21:55:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.805+0000 7f767622c640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76701e3850 0x7f76701e3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.805+0000 7f767622c640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76700af160 0x7f767014ea20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.805+0000 7f767622c640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f76500678f0 0x7f7650069db0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.805+0000 7f767622c640 1 --2- 172.21.15.1:0/2493565973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76700ae3a0 0x7f7670141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.805+0000 7f767622c640 1 -- 172.21.15.1:0/2493565973 >> 172.21.15.1:0/2493565973 conn(0x7f76700b5c40 msgr2=0x7f7670074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.805+0000 7f767622c640 1 -- 172.21.15.1:0/2493565973 shutdown_connections 2024-09-15T21:55:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36.805+0000 7f767622c640 1 -- 172.21.15.1:0/2493565973 wait complete. 2024-09-15T21:55:36.825 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T21:55:36.825 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T21:55:36.825 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2024-09-15T21:55:36.825 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T21:55:36.825 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T21:55:36.826 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T21:55:36.826 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T21:55:36.826 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T21:55:36.826 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T21:55:36.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:36.826 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2024-09-15T21:55:36.832 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T21:55:36.833 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T21:55:36.833 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T21:55:36.833 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T21:55:36.833 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2024-09-15T21:55:36.833 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T21:55:36.833 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T21:55:36.833 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2024-09-15T21:55:36.833 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2024-09-15T21:55:36.833 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T21:55:36.833 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2024-09-15T21:55:36.834 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2024-09-15T21:55:36.834 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T21:55:36.834 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T21:55:36.834 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2024-09-15T21:55:36.834 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T21:55:36.834 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42465sec preferred_lft 42465sec 2024-09-15T21:55:36.834 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-15T21:55:36.834 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T21:55:36.834 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T21:55:36.834 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T21:55:36.835 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2024-09-15T21:55:36.835 INFO:teuthology.orchestra.run.smithi001.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T21:55:36.835 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 02:42:4b:69:f7:bb brd ff:ff:ff:ff:ff:ff 2024-09-15T21:55:36.835 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T21:55:36.835 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T21:55:36.835 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T21:55:36.835 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T21:55:36.836 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-15T21:55:36.836 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add name ceph-brx type bridge 2024-09-15T21:55:36.836 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr flush dev ceph-brx 2024-09-15T21:55:36.836 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set ceph-brx up 2024-09-15T21:55:36.836 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T21:55:36.836 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-15T21:55:36.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T21:55:36.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T21:55:36.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:36.964 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T21:55:36.973 INFO:teuthology.orchestra.run.smithi001.stdout:1 2024-09-15T21:55:36.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:36.974 DEBUG:teuthology.orchestra.run.smithi001:> route 2024-09-15T21:55:37.033 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2024-09-15T21:55:37.033 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T21:55:37.033 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T21:55:37.033 INFO:teuthology.orchestra.run.smithi001.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T21:55:37.033 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T21:55:37.033 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T21:55:37.034 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T21:55:37.034 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-15T21:55:37.034 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T21:55:37.034 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T21:55:37.034 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T21:55:37.034 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-15T21:55:37.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T21:55:37.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T21:55:37.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:37.154 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-15T21:55:37.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:37.242 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2024-09-15T21:55:37.249 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T21:55:37.249 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-15T21:55:37.249 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:55:37.249 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T21:55:37.249 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-15T21:55:37.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T21:55:37.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T21:55:37.367 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T21:55:37.367 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T21:55:37.367 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-15T21:55:37.368 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T21:55:37.368 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T21:55:37.368 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T21:55:37.368 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T21:55:37.368 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T21:55:37.368 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-15T21:55:37.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T21:55:37.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T21:55:37.469 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T21:55:37.470 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-15T21:55:37.470 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2024-09-15T21:55:37.470 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T21:55:37.470 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-15T21:55:37.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T21:55:37.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T21:55:37.576 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T21:55:37.576 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T21:55:37.576 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T21:55:37.627 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T21:55:37.628 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T21:55:37.628 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T21:55:37.675 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-09-15T21:55:37.732 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T21:55:37.781 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-09-15T21:55:37.784 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-09-15T21:55:37.784 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-09-15T21:55:37.784 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/run/lock 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-09-15T21:55:37.785 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/fs/nfsd 2024-09-15T21:55:37.786 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-09-15T21:55:37.786 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-09-15T21:55:37.786 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T21:55:37.786 INFO:teuthology.orchestra.run.smithi001.stdout:/run/rpc_pipefs 2024-09-15T21:55:37.786 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-09-15T21:55:37.786 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-09-15T21:55:37.786 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T21:55:37.786 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T21:55:37.786 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T21:55:37.786 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T21:55:37.786 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-09-15T21:55:37.786 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:55:37.786 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:55:37.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:37.787 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-09-15T21:55:37.836 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T21:55:37.836 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T21:55:37.881 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-09-15T21:55:37.896 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T21:55:37.944 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-09-15T21:55:37.945 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-09-15T21:55:37.945 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-09-15T21:55:37.945 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-09-15T21:55:37.945 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/run/lock 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/fs/nfsd 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-09-15T21:55:37.946 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-09-15T21:55:37.947 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T21:55:37.947 INFO:teuthology.orchestra.run.smithi001.stdout:/run/rpc_pipefs 2024-09-15T21:55:37.947 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-09-15T21:55:37.947 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-09-15T21:55:37.947 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T21:55:37.947 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T21:55:37.947 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T21:55:37.947 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T21:55:37.947 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-09-15T21:55:37.947 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:55:37.947 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:55:37.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:37.948 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-09-15T21:55:37.960 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:2024-09-15T21:55:37.957+0000 7f16c1fd8580 -1 init, newargv = 0x55ffb9cc96d0 newargc=15 2024-09-15T21:55:37.960 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:ceph-fuse[34763]: starting ceph client 2024-09-15T21:55:37.967 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:ceph-fuse[34763]: starting fuse 2024-09-15T21:55:39.066 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-09-15T21:55:39.082 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T21:55:39.131 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-09-15T21:55:39.131 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-09-15T21:55:39.131 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-09-15T21:55:39.131 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-09-15T21:55:39.131 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-09-15T21:55:39.131 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-09-15T21:55:39.131 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-09-15T21:55:39.131 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-09-15T21:55:39.132 INFO:teuthology.orchestra.run.smithi001.stdout:/run/lock 2024-09-15T21:55:39.132 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-09-15T21:55:39.132 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-09-15T21:55:39.132 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-09-15T21:55:39.132 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T21:55:39.132 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-09-15T21:55:39.132 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-09-15T21:55:39.132 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-09-15T21:55:39.132 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-09-15T21:55:39.132 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/fs/nfsd 2024-09-15T21:55:39.132 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-09-15T21:55:39.132 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-09-15T21:55:39.132 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T21:55:39.133 INFO:teuthology.orchestra.run.smithi001.stdout:/run/rpc_pipefs 2024-09-15T21:55:39.133 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-09-15T21:55:39.133 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-09-15T21:55:39.133 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T21:55:39.133 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T21:55:39.133 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T21:55:39.133 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T21:55:39.133 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-09-15T21:55:39.133 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:55:39.133 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:55:39.133 INFO:teuthology.orchestra.run.smithi001.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T21:55:39.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:39.134 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-09-15T21:55:39.180 INFO:teuthology.orchestra.run.smithi001.stdout:45 2024-09-15T21:55:39.181 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T21:55:39.181 DEBUG:teuthology.orchestra.run.smithi001:> sudo stdin-killer -- python3 -c ' 2024-09-15T21:55:39.181 DEBUG:teuthology.orchestra.run.smithi001:> import glob 2024-09-15T21:55:39.181 DEBUG:teuthology.orchestra.run.smithi001:> import re 2024-09-15T21:55:39.181 DEBUG:teuthology.orchestra.run.smithi001:> import os 2024-09-15T21:55:39.181 DEBUG:teuthology.orchestra.run.smithi001:> import subprocess 2024-09-15T21:55:39.181 DEBUG:teuthology.orchestra.run.smithi001:> 2024-09-15T21:55:39.181 DEBUG:teuthology.orchestra.run.smithi001:> def _find_admin_socket(client_name): 2024-09-15T21:55:39.181 DEBUG:teuthology.orchestra.run.smithi001:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T21:55:39.181 DEBUG:teuthology.orchestra.run.smithi001:> files = glob.glob(asok_path) 2024-09-15T21:55:39.181 DEBUG:teuthology.orchestra.run.smithi001:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T21:55:39.181 DEBUG:teuthology.orchestra.run.smithi001:> 2024-09-15T21:55:39.181 DEBUG:teuthology.orchestra.run.smithi001:> # Given a non-glob path, it better be there 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> if "*" not in asok_path: 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> assert(len(files) == 1) 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> return files[0] 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> for f in files: 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> contents = proc_f.read() 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> if mountpoint in contents: 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> return f 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> print(_find_admin_socket("client.0")) 2024-09-15T21:55:39.182 DEBUG:teuthology.orchestra.run.smithi001:> ' 2024-09-15T21:55:39.310 INFO:teuthology.orchestra.run.smithi001.stdout:/var/run/ceph/ceph-client.0.34763.asok 2024-09-15T21:55:39.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T21:55:39.323 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34763.asok 2024-09-15T21:55:39.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:39.324 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34763.asok status 2024-09-15T21:55:39.484 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T21:55:39.484 INFO:teuthology.orchestra.run.smithi001.stdout: "metadata": { 2024-09-15T21:55:39.484 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T21:55:39.485 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T21:55:39.485 INFO:teuthology.orchestra.run.smithi001.stdout: "entity_id": "0", 2024-09-15T21:55:39.485 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": "smithi001", 2024-09-15T21:55:39.485 INFO:teuthology.orchestra.run.smithi001.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T21:55:39.485 INFO:teuthology.orchestra.run.smithi001.stdout: "pid": "34763", 2024-09-15T21:55:39.485 INFO:teuthology.orchestra.run.smithi001.stdout: "root": "/" 2024-09-15T21:55:39.485 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:39.485 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_count": 0, 2024-09-15T21:55:39.485 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_pinned_count": 0, 2024-09-15T21:55:39.485 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 4605, 2024-09-15T21:55:39.485 INFO:teuthology.orchestra.run.smithi001.stdout: "inst": { 2024-09-15T21:55:39.485 INFO:teuthology.orchestra.run.smithi001.stdout: "name": { 2024-09-15T21:55:39.486 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "client", 2024-09-15T21:55:39.486 INFO:teuthology.orchestra.run.smithi001.stdout: "num": 4605 2024-09-15T21:55:39.486 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:39.486 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2024-09-15T21:55:39.486 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-15T21:55:39.486 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "192.168.0.1:0", 2024-09-15T21:55:39.486 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3194679133 2024-09-15T21:55:39.486 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:39.486 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:39.486 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2024-09-15T21:55:39.486 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-15T21:55:39.486 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "192.168.0.1:0", 2024-09-15T21:55:39.487 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3194679133 2024-09-15T21:55:39.487 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:39.487 INFO:teuthology.orchestra.run.smithi001.stdout: "inst_str": "client.4605 192.168.0.1:0/3194679133", 2024-09-15T21:55:39.487 INFO:teuthology.orchestra.run.smithi001.stdout: "addr_str": "192.168.0.1:0/3194679133", 2024-09-15T21:55:39.487 INFO:teuthology.orchestra.run.smithi001.stdout: "inode_count": 1, 2024-09-15T21:55:39.487 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_epoch": 8, 2024-09-15T21:55:39.487 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch": 21, 2024-09-15T21:55:39.487 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch_barrier": 0, 2024-09-15T21:55:39.487 INFO:teuthology.orchestra.run.smithi001.stdout: "blocklisted": false, 2024-09-15T21:55:39.487 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs" 2024-09-15T21:55:39.487 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T21:55:39.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:39.498 DEBUG:teuthology.orchestra.run.smithi001:> stat --file-system '--printf=%T 2024-09-15T21:55:39.499 DEBUG:teuthology.orchestra.run.smithi001:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T21:55:39.504 INFO:teuthology.orchestra.run.smithi001.stdout:fuseblk 2024-09-15T21:55:39.505 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T21:55:39.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:39.505 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T21:55:39.561 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-15T21:55:39.611 INFO:tasks.cephfs_test_runner:Starting test: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) Test that when cd is issued with an argument, CWD is changed 2024-09-15T21:55:39.612 INFO:tasks.cephfs_test_runner:test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-09-15T21:55:39.612 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:39.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.737+0000 7fd7b4ffb640 1 Processor -- start 2024-09-15T21:55:39.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.737+0000 7fd7b4ffb640 1 -- start start 2024-09-15T21:55:39.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7b4ffb640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7b00ae3a0 0x7fd7b009eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:39.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7b4ffb640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd7b00b4c50 0x7fd7b0147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:39.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7b4ffb640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b00b00f0 con 0x7fd7b00af160 2024-09-15T21:55:39.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7b4ffb640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b00afe10 con 0x7fd7b00b4c50 2024-09-15T21:55:39.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7b4ffb640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b00b50e0 con 0x7fd7b00ae3a0 2024-09-15T21:55:39.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7ae59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7b00ae3a0 0x7fd7b009eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:39.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7add9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd7b00b4c50 0x7fd7b0147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:39.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7add9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd7b00b4c50 0x7fd7b0147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:60882/0 (socket says 172.21.15.1:60882) 2024-09-15T21:55:39.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7aed9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd7b00af160 0x7fd7b009aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.1:54482/0 (socket says 172.21.15.1:54482) 2024-09-15T21:55:39.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7add9b640 1 -- 172.21.15.1:0/3515566816 learned_addr learned my addr 172.21.15.1:0/3515566816 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:39.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7add9b640 1 -- 172.21.15.1:0/3515566816 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7b00ae3a0 msgr2=0x7fd7b009eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:39.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7add9b640 1 --2- 172.21.15.1:0/3515566816 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7b00ae3a0 0x7fd7b009eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:39.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7add9b640 1 -- 172.21.15.1:0/3515566816 >> v1:172.21.15.70:6789/0 conn(0x7fd7b00af160 legacy=0x7fd7b009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:39.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.741+0000 7fd7add9b640 1 -- 172.21.15.1:0/3515566816 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b00b53c0 con 0x7fd7b00b4c50 2024-09-15T21:55:39.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7add9b640 1 --2- 172.21.15.1:0/3515566816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7b00b4c50 0x7fd7b0147ba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd79800bb10 tx=0x7fd79801eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdfadb4b68be6a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:39.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7ad59a640 1 -- 172.21.15.1:0/3515566816 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7980b4070 con 0x7fd7b00b4c50 2024-09-15T21:55:39.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7ad59a640 1 -- 172.21.15.1:0/3515566816 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7980a7c60 con 0x7fd7b00b4c50 2024-09-15T21:55:39.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7ad59a640 1 -- 172.21.15.1:0/3515566816 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7980af660 con 0x7fd7b00b4c50 2024-09-15T21:55:39.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3515566816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7b00b4c50 msgr2=0x7fd7b0147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:39.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 --2- 172.21.15.1:0/3515566816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7b00b4c50 0x7fd7b0147ba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd79800bb10 tx=0x7fd79801eb70 comp rx=0 tx=0).stop 2024-09-15T21:55:39.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3515566816 shutdown_connections 2024-09-15T21:55:39.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 --2- 172.21.15.1:0/3515566816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7b00b4c50 0x7fd7b0147ba0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:39.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 --2- 172.21.15.1:0/3515566816 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7b00ae3a0 0x7fd7b009eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:39.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3515566816 >> 172.21.15.1:0/3515566816 conn(0x7fd7b00b5c40 msgr2=0x7fd7b00b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:39.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3515566816 shutdown_connections 2024-09-15T21:55:39.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3515566816 wait complete. 2024-09-15T21:55:39.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 Processor -- start 2024-09-15T21:55:39.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 -- start start 2024-09-15T21:55:39.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7b00ae3a0 0x7fd7b01dbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:39.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7b00af160 0x7fd7b0140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:39.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b00730e0 0x7fd7b01df4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:39.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b00b3cc0 con 0x7fd7b00730e0 2024-09-15T21:55:39.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b00b3b40 con 0x7fd7b00af160 2024-09-15T21:55:39.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.745+0000 7fd7b4ffb640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b00b3e40 con 0x7fd7b00ae3a0 2024-09-15T21:55:39.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7aed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b00730e0 0x7fd7b01df4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:39.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7aed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b00730e0 0x7fd7b01df4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43156/0 (socket says 172.21.15.1:43156) 2024-09-15T21:55:39.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7aed9d640 1 -- 172.21.15.1:0/3606539456 learned_addr learned my addr 172.21.15.1:0/3606539456 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:39.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7add9b640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7b00af160 0x7fd7b0140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:39.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7ae59c640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7b00ae3a0 0x7fd7b01dbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:39.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7aed9d640 1 -- 172.21.15.1:0/3606539456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7b00ae3a0 msgr2=0x7fd7b01dbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:39.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7aed9d640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7b00ae3a0 0x7fd7b01dbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:39.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7aed9d640 1 -- 172.21.15.1:0/3606539456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7b00af160 msgr2=0x7fd7b0140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:39.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7aed9d640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7b00af160 0x7fd7b0140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:39.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7aed9d640 1 -- 172.21.15.1:0/3606539456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b01438b0 con 0x7fd7b00730e0 2024-09-15T21:55:39.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7ae59c640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7b00ae3a0 0x7fd7b01dbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:39.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7aed9d640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b00730e0 0x7fd7b01df4d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000c3c0 tx=0x7fd7a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:39.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7a6ffd640 1 -- 172.21.15.1:0/3606539456 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00074e0 con 0x7fd7b00730e0 2024-09-15T21:55:39.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7a6ffd640 1 -- 172.21.15.1:0/3606539456 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a0007680 con 0x7fd7b00730e0 2024-09-15T21:55:39.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7a6ffd640 1 -- 172.21.15.1:0/3606539456 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0004a30 con 0x7fd7b00730e0 2024-09-15T21:55:39.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3606539456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b0143b90 con 0x7fd7b00730e0 2024-09-15T21:55:39.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3606539456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b0072350 con 0x7fd7b00730e0 2024-09-15T21:55:39.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3606539456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b009eb50 con 0x7fd7b00730e0 2024-09-15T21:55:39.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7a6ffd640 1 -- 172.21.15.1:0/3606539456 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd7a001a020 con 0x7fd7b00730e0 2024-09-15T21:55:39.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7a6ffd640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd7900678c0 0x7fd790069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:39.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7ae59c640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd7900678c0 0x7fd790069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:39.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7a6ffd640 1 -- 172.21.15.1:0/3606539456 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd7a00852f0 con 0x7fd7b00730e0 2024-09-15T21:55:39.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.749+0000 7fd7ae59c640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd7900678c0 0x7fd790069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009fd0 tx=0x7fd7a800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:39.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.753+0000 7fd7a6ffd640 1 -- 172.21.15.1:0/3606539456 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd7a0055ec0 con 0x7fd7b00730e0 2024-09-15T21:55:39.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.921+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3606539456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7b0068850 con 0x7fd7b00730e0 2024-09-15T21:55:39.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.921+0000 7fd7a6ffd640 1 -- 172.21.15.1:0/3606539456 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16593 (secure 0 0 0) 0x7fd7a00557c0 con 0x7fd7b00730e0 2024-09-15T21:55:39.926 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:39.926 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:22.028149+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:18.271646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:19.444906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:39.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.925+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3606539456 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd7900678c0 msgr2=0x7fd790069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:39.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.925+0000 7fd7b4ffb640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd7900678c0 0x7fd790069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009fd0 tx=0x7fd7a800b040 comp rx=0 tx=0).stop 2024-09-15T21:55:39.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.925+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3606539456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b00730e0 msgr2=0x7fd7b01df4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:39.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.925+0000 7fd7b4ffb640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b00730e0 0x7fd7b01df4d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000c3c0 tx=0x7fd7a000c880 comp rx=0 tx=0).stop 2024-09-15T21:55:39.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.925+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3606539456 shutdown_connections 2024-09-15T21:55:39.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.925+0000 7fd7b4ffb640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7b00730e0 0x7fd7b01df4d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:39.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.925+0000 7fd7b4ffb640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd7900678c0 0x7fd790069d80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:39.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.925+0000 7fd7b4ffb640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd7b00af160 0x7fd7b0140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:39.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.925+0000 7fd7b4ffb640 1 --2- 172.21.15.1:0/3606539456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd7b00ae3a0 0x7fd7b01dbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:39.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.925+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3606539456 >> 172.21.15.1:0/3606539456 conn(0x7fd7b00b5c40 msgr2=0x7fd7b0141660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:39.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.925+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3606539456 shutdown_connections 2024-09-15T21:55:39.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:39.925+0000 7fd7b4ffb640 1 -- 172.21.15.1:0/3606539456 wait complete. 2024-09-15T21:55:39.945 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T21:55:09.137939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T21:55:18.271646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T21:55:19.444906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T21:55:39.946 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T21:55:40.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa20ed58640 1 Processor -- start 2024-09-15T21:55:40.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa20ed58640 1 -- start start 2024-09-15T21:55:40.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa20ed58640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa2080b6220 0x7fa2080b6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa20ed58640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa20806f340 0x7fa2081494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa20ed58640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20806fc30 con 0x7fa20806f740 2024-09-15T21:55:40.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa20ed58640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa208072580 con 0x7fa20806f340 2024-09-15T21:55:40.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa20ed58640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa208148fa0 con 0x7fa2080b6220 2024-09-15T21:55:40.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa20d2f5640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa20806f740 0x7fa208142a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44098/0 (socket says 172.21.15.1:44098) 2024-09-15T21:55:40.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa207fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa20806f340 0x7fa2081494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa20d2f5640 1 -- 172.21.15.1:0/762093312 learned_addr learned my addr 172.21.15.1:0/762093312 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:40.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa20caf4640 1 --2- 172.21.15.1:0/762093312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa2080b6220 0x7fa2080b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa2077fe640 1 -- 172.21.15.1:0/762093312 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1322741211 0 0) 0x7fa20806fc30 con 0x7fa20806f740 2024-09-15T21:55:40.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa2077fe640 1 -- 172.21.15.1:0/762093312 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f0003530 con 0x7fa20806f740 2024-09-15T21:55:40.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa207fff640 1 -- 172.21.15.1:0/762093312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa2080b6220 msgr2=0x7fa2080b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:40.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa207fff640 1 --2- 172.21.15.1:0/762093312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa2080b6220 0x7fa2080b6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa207fff640 1 -- 172.21.15.1:0/762093312 >> v1:172.21.15.1:6789/0 conn(0x7fa20806f740 legacy=0x7fa208142a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.073+0000 7fa207fff640 1 -- 172.21.15.1:0/762093312 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2081431a0 con 0x7fa20806f340 2024-09-15T21:55:40.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa207fff640 1 --2- 172.21.15.1:0/762093312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa20806f340 0x7fa2081494c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0097c0 tx=0x7fa1fc01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84ea9d2afa40c350 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:40.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa2077fe640 1 -- 172.21.15.1:0/762093312 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0b0070 con 0x7fa20806f340 2024-09-15T21:55:40.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa2077fe640 1 -- 172.21.15.1:0/762093312 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc0ab600 con 0x7fa20806f340 2024-09-15T21:55:40.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa2077fe640 1 -- 172.21.15.1:0/762093312 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0ab9b0 con 0x7fa20806f340 2024-09-15T21:55:40.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa20ed58640 1 -- 172.21.15.1:0/762093312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa20806f340 msgr2=0x7fa2081494c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa20ed58640 1 --2- 172.21.15.1:0/762093312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa20806f340 0x7fa2081494c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0097c0 tx=0x7fa1fc01c3e0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa20ed58640 1 -- 172.21.15.1:0/762093312 shutdown_connections 2024-09-15T21:55:40.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa20ed58640 1 --2- 172.21.15.1:0/762093312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa20806f340 0x7fa2081494c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa20ed58640 1 --2- 172.21.15.1:0/762093312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa2080b6220 0x7fa2080b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa20ed58640 1 -- 172.21.15.1:0/762093312 >> 172.21.15.1:0/762093312 conn(0x7fa20809d160 msgr2=0x7fa20809d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:40.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa20ed58640 1 -- 172.21.15.1:0/762093312 shutdown_connections 2024-09-15T21:55:40.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa20ed58640 1 -- 172.21.15.1:0/762093312 wait complete. 2024-09-15T21:55:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa20ed58640 1 Processor -- start 2024-09-15T21:55:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.077+0000 7fa20ed58640 1 -- start start 2024-09-15T21:55:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20ed58640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa20806f340 0x7fa2081e16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20ed58640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa20806f740 0x7fa2080b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20ed58640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2080b6220 0x7fa2080b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20ed58640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa208152d40 con 0x7fa20806f340 2024-09-15T21:55:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20ed58640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa208152bc0 con 0x7fa2080b6220 2024-09-15T21:55:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20ed58640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa208152ec0 con 0x7fa20806f740 2024-09-15T21:55:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20caf4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa20806f340 0x7fa2081e16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20caf4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa20806f340 0x7fa2081e16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43168/0 (socket says 172.21.15.1:43168) 2024-09-15T21:55:40.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20caf4640 1 -- 172.21.15.1:0/4191379380 learned_addr learned my addr 172.21.15.1:0/4191379380 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20d2f5640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2080b6220 0x7fa2080b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa207fff640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa20806f740 0x7fa2080b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20caf4640 1 -- 172.21.15.1:0/4191379380 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa20806f740 msgr2=0x7fa2080b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20caf4640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa20806f740 0x7fa2080b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20caf4640 1 -- 172.21.15.1:0/4191379380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2080b6220 msgr2=0x7fa2080b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20caf4640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2080b6220 0x7fa2080b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20caf4640 1 -- 172.21.15.1:0/4191379380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2081438a0 con 0x7fa20806f340 2024-09-15T21:55:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20caf4640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa20806f340 0x7fa2081e16a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800e9b0 tx=0x7fa1f800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa2057fa640 1 -- 172.21.15.1:0/4191379380 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8017070 con 0x7fa20806f340 2024-09-15T21:55:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa2057fa640 1 -- 172.21.15.1:0/4191379380 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f800c9a0 con 0x7fa20806f340 2024-09-15T21:55:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20ed58640 1 -- 172.21.15.1:0/4191379380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa208144750 con 0x7fa20806f340 2024-09-15T21:55:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa2057fa640 1 -- 172.21.15.1:0/4191379380 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f800cd70 con 0x7fa20806f340 2024-09-15T21:55:40.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20ed58640 1 -- 172.21.15.1:0/4191379380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2080b5080 con 0x7fa20806f340 2024-09-15T21:55:40.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa20ed58640 1 -- 172.21.15.1:0/4191379380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2081494c0 con 0x7fa20806f340 2024-09-15T21:55:40.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa2057fa640 1 -- 172.21.15.1:0/4191379380 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa1f801a070 con 0x7fa20806f340 2024-09-15T21:55:40.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa2057fa640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa1f40678c0 0x7fa1f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa2057fa640 1 -- 172.21.15.1:0/4191379380 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa1f8085c00 con 0x7fa20806f340 2024-09-15T21:55:40.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa207fff640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa1f40678c0 0x7fa1f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.081+0000 7fa207fff640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa1f40678c0 0x7fa1f4069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0ad000 tx=0x7fa1fc0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:40.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.085+0000 7fa2057fa640 1 -- 172.21.15.1:0/4191379380 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa1f808c080 con 0x7fa20806f340 2024-09-15T21:55:40.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.253+0000 7fa20ed58640 1 -- 172.21.15.1:0/4191379380 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa208140070 con 0x7fa20806f340 2024-09-15T21:55:40.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.253+0000 7fa2057fa640 1 -- 172.21.15.1:0/4191379380 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fa1f8056100 con 0x7fa20806f340 2024-09-15T21:55:40.257 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-15T21:55:40.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.253+0000 7fa20ed58640 1 -- 172.21.15.1:0/4191379380 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa1f40678c0 msgr2=0x7fa1f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.253+0000 7fa20ed58640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa1f40678c0 0x7fa1f4069d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0ad000 tx=0x7fa1fc0a6000 comp rx=0 tx=0).stop 2024-09-15T21:55:40.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.257+0000 7fa20ed58640 1 -- 172.21.15.1:0/4191379380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa20806f340 msgr2=0x7fa2081e16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.257+0000 7fa20ed58640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa20806f340 0x7fa2081e16a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800e9b0 tx=0x7fa1f800ee70 comp rx=0 tx=0).stop 2024-09-15T21:55:40.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.257+0000 7fa20ed58640 1 -- 172.21.15.1:0/4191379380 shutdown_connections 2024-09-15T21:55:40.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.257+0000 7fa20ed58640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa1f40678c0 0x7fa1f4069d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.257+0000 7fa20ed58640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa2080b6220 0x7fa2080b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.257+0000 7fa20ed58640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa20806f740 0x7fa2080b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.257+0000 7fa20ed58640 1 --2- 172.21.15.1:0/4191379380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa20806f340 0x7fa2081e16a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.257+0000 7fa20ed58640 1 -- 172.21.15.1:0/4191379380 >> 172.21.15.1:0/4191379380 conn(0x7fa20809d160 msgr2=0x7fa20809b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:40.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.257+0000 7fa20ed58640 1 -- 172.21.15.1:0/4191379380 shutdown_connections 2024-09-15T21:55:40.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.257+0000 7fa20ed58640 1 -- 172.21.15.1:0/4191379380 wait complete. 2024-09-15T21:55:40.277 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T21:55:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.401+0000 7f3d699d0640 1 Processor -- start 2024-09-15T21:55:40.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.401+0000 7f3d699d0640 1 -- start start 2024-09-15T21:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d699d0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3d640b62f0 0x7f3d64147d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d699d0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3d640b9070 0x7f3d640b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d699d0640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d64148240 con 0x7f3d640b5050 2024-09-15T21:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d699d0640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f3d640b9a00 con 0x7f3d640b62f0 2024-09-15T21:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d699d0640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f3d640b48e0 con 0x7f3d640b9070 2024-09-15T21:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d62ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3d640b62f0 0x7f3d64147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d62ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3d640b62f0 0x7f3d64147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43178/0 (socket says 172.21.15.1:43178) 2024-09-15T21:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d62ffd640 1 -- 172.21.15.1:0/3135005917 learned_addr learned my addr 172.21.15.1:0/3135005917 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d627fc640 1 --2- 172.21.15.1:0/3135005917 >> v2:172.21.15.70:3300/0 conn(0x7f3d640b9070 0x7f3d640b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d62ffd640 1 -- 172.21.15.1:0/3135005917 >> v2:172.21.15.70:3300/0 conn(0x7f3d640b9070 msgr2=0x7f3d640b94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d62ffd640 1 --2- 172.21.15.1:0/3135005917 >> v2:172.21.15.70:3300/0 conn(0x7f3d640b9070 0x7f3d640b94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d62ffd640 1 -- 172.21.15.1:0/3135005917 >> v1:172.21.15.70:6789/0 conn(0x7f3d640b5050 legacy=0x7f3d640b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d62ffd640 1 -- 172.21.15.1:0/3135005917 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d640b66d0 con 0x7f3d640b62f0 2024-09-15T21:55:40.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d62ffd640 1 --2- 172.21.15.1:0/3135005917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d640b62f0 0x7f3d64147d00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3d6413e7e0 tx=0x7f3d5401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d824daa4d68d10e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:40.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d61ffb640 1 -- 172.21.15.1:0/3135005917 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d540b0070 con 0x7f3d640b62f0 2024-09-15T21:55:40.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d61ffb640 1 -- 172.21.15.1:0/3135005917 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d540ab600 con 0x7f3d640b62f0 2024-09-15T21:55:40.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.405+0000 7f3d61ffb640 1 -- 172.21.15.1:0/3135005917 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d540ab9d0 con 0x7f3d640b62f0 2024-09-15T21:55:40.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 -- 172.21.15.1:0/3135005917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d640b62f0 msgr2=0x7f3d64147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 --2- 172.21.15.1:0/3135005917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d640b62f0 0x7f3d64147d00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3d6413e7e0 tx=0x7f3d5401c490 comp rx=0 tx=0).stop 2024-09-15T21:55:40.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 -- 172.21.15.1:0/3135005917 shutdown_connections 2024-09-15T21:55:40.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 --2- 172.21.15.1:0/3135005917 >> v2:172.21.15.70:3300/0 conn(0x7f3d640b9070 0x7f3d640b94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 --2- 172.21.15.1:0/3135005917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d640b62f0 0x7f3d64147d00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 -- 172.21.15.1:0/3135005917 >> 172.21.15.1:0/3135005917 conn(0x7f3d640b9ea0 msgr2=0x7f3d640ba2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:40.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 -- 172.21.15.1:0/3135005917 shutdown_connections 2024-09-15T21:55:40.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 -- 172.21.15.1:0/3135005917 wait complete. 2024-09-15T21:55:40.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 Processor -- start 2024-09-15T21:55:40.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 -- start start 2024-09-15T21:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d640b5050 0x7f3d64149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d640b62f0 0x7f3d6414a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d640b9070 0x7f3d64142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3d64154aa0 con 0x7f3d640b9070 2024-09-15T21:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3d64154920 con 0x7f3d640b5050 2024-09-15T21:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3d64154c20 con 0x7f3d640b62f0 2024-09-15T21:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d637fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d640b9070 0x7f3d64142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d637fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d640b9070 0x7f3d64142050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43190/0 (socket says 172.21.15.1:43190) 2024-09-15T21:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d637fe640 1 -- 172.21.15.1:0/2021906576 learned_addr learned my addr 172.21.15.1:0/2021906576 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:40.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d62ffd640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d640b5050 0x7f3d64149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d627fc640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d640b62f0 0x7f3d6414a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d637fe640 1 -- 172.21.15.1:0/2021906576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d640b62f0 msgr2=0x7f3d6414a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d637fe640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d640b62f0 0x7f3d6414a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d637fe640 1 -- 172.21.15.1:0/2021906576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d640b5050 msgr2=0x7f3d64149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d637fe640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d640b5050 0x7f3d64149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d637fe640 1 -- 172.21.15.1:0/2021906576 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d64151180 con 0x7f3d640b9070 2024-09-15T21:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d62ffd640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d640b5050 0x7f3d64149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d637fe640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d640b9070 0x7f3d64142050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00c730 tx=0x7f3d5c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d4bfff640 1 -- 172.21.15.1:0/2021906576 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c003b80 con 0x7f3d640b9070 2024-09-15T21:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d4bfff640 1 -- 172.21.15.1:0/2021906576 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c003d20 con 0x7f3d640b9070 2024-09-15T21:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 -- 172.21.15.1:0/2021906576 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6414ab70 con 0x7f3d640b9070 2024-09-15T21:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d4bfff640 1 -- 172.21.15.1:0/2021906576 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c00aa30 con 0x7f3d640b9070 2024-09-15T21:55:40.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.409+0000 7f3d699d0640 1 -- 172.21.15.1:0/2021906576 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d6414b0d0 con 0x7f3d640b9070 2024-09-15T21:55:40.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.413+0000 7f3d699d0640 1 -- 172.21.15.1:0/2021906576 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d64143e80 con 0x7f3d640b9070 2024-09-15T21:55:40.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.413+0000 7f3d4bfff640 1 -- 172.21.15.1:0/2021906576 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d5c00abd0 con 0x7f3d640b9070 2024-09-15T21:55:40.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.413+0000 7f3d4bfff640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3d500678c0 0x7f3d50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.413+0000 7f3d4bfff640 1 -- 172.21.15.1:0/2021906576 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3d5c085ab0 con 0x7f3d640b9070 2024-09-15T21:55:40.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.413+0000 7f3d62ffd640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3d500678c0 0x7f3d50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.413+0000 7f3d62ffd640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3d500678c0 0x7f3d50069d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3d540ad000 tx=0x7f3d54008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:40.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.417+0000 7f3d4bfff640 1 -- 172.21.15.1:0/2021906576 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3d6414ab70 con 0x7f3d640b9070 2024-09-15T21:55:40.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.577+0000 7f3d699d0640 1 -- 172.21.15.1:0/2021906576 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3d64147d00 con 0x7f3d640b9070 2024-09-15T21:55:40.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.581+0000 7f3d4bfff640 1 -- 172.21.15.1:0/2021906576 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f3d5c056680 con 0x7f3d640b9070 2024-09-15T21:55:40.584 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2024-09-15T21:55:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.581+0000 7f3d699d0640 1 -- 172.21.15.1:0/2021906576 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3d500678c0 msgr2=0x7f3d50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.581+0000 7f3d699d0640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3d500678c0 0x7f3d50069d80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3d540ad000 tx=0x7f3d54008040 comp rx=0 tx=0).stop 2024-09-15T21:55:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.581+0000 7f3d699d0640 1 -- 172.21.15.1:0/2021906576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d640b9070 msgr2=0x7f3d64142050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.581+0000 7f3d699d0640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d640b9070 0x7f3d64142050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00c730 tx=0x7f3d5c00cbf0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.581+0000 7f3d699d0640 1 -- 172.21.15.1:0/2021906576 shutdown_connections 2024-09-15T21:55:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.581+0000 7f3d699d0640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d640b9070 0x7f3d64142050 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.581+0000 7f3d699d0640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d640b62f0 0x7f3d6414a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.581+0000 7f3d699d0640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3d500678c0 0x7f3d50069d80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.581+0000 7f3d699d0640 1 --2- 172.21.15.1:0/2021906576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d640b5050 0x7f3d64149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.581+0000 7f3d699d0640 1 -- 172.21.15.1:0/2021906576 >> 172.21.15.1:0/2021906576 conn(0x7f3d640b9ea0 msgr2=0x7f3d641456f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:40.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.581+0000 7f3d699d0640 1 -- 172.21.15.1:0/2021906576 shutdown_connections 2024-09-15T21:55:40.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.581+0000 7f3d699d0640 1 -- 172.21.15.1:0/2021906576 wait complete. 2024-09-15T21:55:40.604 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T21:55:40.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.729+0000 7ff442e0d640 1 Processor -- start 2024-09-15T21:55:40.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.729+0000 7ff442e0d640 1 -- start start 2024-09-15T21:55:40.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff442e0d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff43c0b62f0 0x7ff43c147d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff442e0d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff43c0b9070 0x7ff43c0b9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff442e0d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43c148240 con 0x7ff43c0b5050 2024-09-15T21:55:40.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff442e0d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7ff43c0b48e0 con 0x7ff43c0b62f0 2024-09-15T21:55:40.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff442e0d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff43c0b4bc0 con 0x7ff43c0b9070 2024-09-15T21:55:40.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff440ba9640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff43c0b62f0 0x7ff43c147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff440ba9640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff43c0b62f0 0x7ff43c147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43202/0 (socket says 172.21.15.1:43202) 2024-09-15T21:55:40.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff440ba9640 1 -- 172.21.15.1:0/3252761492 learned_addr learned my addr 172.21.15.1:0/3252761492 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:40.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff43bfff640 1 --2- 172.21.15.1:0/3252761492 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff43c0b9070 0x7ff43c0b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff440ba9640 1 -- 172.21.15.1:0/3252761492 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff43c0b9070 msgr2=0x7ff43c0b9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:40.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff440ba9640 1 --2- 172.21.15.1:0/3252761492 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff43c0b9070 0x7ff43c0b9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff440ba9640 1 -- 172.21.15.1:0/3252761492 >> v1:172.21.15.70:6789/0 conn(0x7ff43c0b5050 legacy=0x7ff43c0b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff440ba9640 1 -- 172.21.15.1:0/3252761492 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c0b66d0 con 0x7ff43c0b62f0 2024-09-15T21:55:40.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff43bfff640 1 --2- 172.21.15.1:0/3252761492 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff43c0b9070 0x7ff43c0b9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:40.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff440ba9640 1 --2- 172.21.15.1:0/3252761492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff43c0b62f0 0x7ff43c147d00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff430009870 tx=0x7ff43001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe0d52fe418f811 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:40.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff43b7fe640 1 -- 172.21.15.1:0/3252761492 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4300b0070 con 0x7ff43c0b62f0 2024-09-15T21:55:40.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff43b7fe640 1 -- 172.21.15.1:0/3252761492 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4300ab600 con 0x7ff43c0b62f0 2024-09-15T21:55:40.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.733+0000 7ff43b7fe640 1 -- 172.21.15.1:0/3252761492 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4300ab9d0 con 0x7ff43c0b62f0 2024-09-15T21:55:40.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 -- 172.21.15.1:0/3252761492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff43c0b62f0 msgr2=0x7ff43c147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 --2- 172.21.15.1:0/3252761492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff43c0b62f0 0x7ff43c147d00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff430009870 tx=0x7ff43001c4d0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 -- 172.21.15.1:0/3252761492 shutdown_connections 2024-09-15T21:55:40.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 --2- 172.21.15.1:0/3252761492 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff43c0b9070 0x7ff43c0b9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 --2- 172.21.15.1:0/3252761492 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff43c0b62f0 0x7ff43c147d00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 -- 172.21.15.1:0/3252761492 >> 172.21.15.1:0/3252761492 conn(0x7ff43c0b9ea0 msgr2=0x7ff43c0ba2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:40.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 -- 172.21.15.1:0/3252761492 shutdown_connections 2024-09-15T21:55:40.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 -- 172.21.15.1:0/3252761492 wait complete. 2024-09-15T21:55:40.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 Processor -- start 2024-09-15T21:55:40.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 -- start start 2024-09-15T21:55:40.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff43c0b5050 0x7ff43c13a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff43c0b62f0 0x7ff43c1350c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff43c0b9070 0x7ff43c1e3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c154aa0 con 0x7ff43c0b9070 2024-09-15T21:55:40.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c154920 con 0x7ff43c0b62f0 2024-09-15T21:55:40.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff43c154c20 con 0x7ff43c0b5050 2024-09-15T21:55:40.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff4413aa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff43c0b9070 0x7ff43c1e3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff4413aa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff43c0b9070 0x7ff43c1e3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43208/0 (socket says 172.21.15.1:43208) 2024-09-15T21:55:40.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff4413aa640 1 -- 172.21.15.1:0/255535803 learned_addr learned my addr 172.21.15.1:0/255535803 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:40.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff440ba9640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff43c0b5050 0x7ff43c13a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff43bfff640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff43c0b62f0 0x7ff43c1350c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff4413aa640 1 -- 172.21.15.1:0/255535803 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff43c0b5050 msgr2=0x7ff43c13a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff4413aa640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff43c0b5050 0x7ff43c13a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff4413aa640 1 -- 172.21.15.1:0/255535803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff43c0b62f0 msgr2=0x7ff43c1350c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff4413aa640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff43c0b62f0 0x7ff43c1350c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff4413aa640 1 -- 172.21.15.1:0/255535803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c141430 con 0x7ff43c0b9070 2024-09-15T21:55:40.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff440ba9640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff43c0b5050 0x7ff43c13a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:40.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff4413aa640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff43c0b9070 0x7ff43c1e3870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c770 tx=0x7ff43400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:40.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff4397fa640 1 -- 172.21.15.1:0/255535803 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff434003b80 con 0x7ff43c0b9070 2024-09-15T21:55:40.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff4397fa640 1 -- 172.21.15.1:0/255535803 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff434003d20 con 0x7ff43c0b9070 2024-09-15T21:55:40.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 -- 172.21.15.1:0/255535803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43c143670 con 0x7ff43c0b9070 2024-09-15T21:55:40.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff4397fa640 1 -- 172.21.15.1:0/255535803 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43400aa90 con 0x7ff43c0b9070 2024-09-15T21:55:40.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 -- 172.21.15.1:0/255535803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43c1444b0 con 0x7ff43c0b9070 2024-09-15T21:55:40.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.737+0000 7ff442e0d640 1 -- 172.21.15.1:0/255535803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff43c143e40 con 0x7ff43c0b9070 2024-09-15T21:55:40.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.741+0000 7ff4397fa640 1 -- 172.21.15.1:0/255535803 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff43400ac30 con 0x7ff43c0b9070 2024-09-15T21:55:40.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.741+0000 7ff4397fa640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff4200678c0 0x7ff420069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:40.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.741+0000 7ff4397fa640 1 -- 172.21.15.1:0/255535803 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff434085bd0 con 0x7ff43c0b9070 2024-09-15T21:55:40.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.741+0000 7ff440ba9640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff4200678c0 0x7ff420069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:40.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.741+0000 7ff440ba9640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff4200678c0 0x7ff420069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff4300ad000 tx=0x7ff430008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:40.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.745+0000 7ff4397fa640 1 -- 172.21.15.1:0/255535803 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff434056700 con 0x7ff43c0b9070 2024-09-15T21:55:40.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.909+0000 7ff442e0d640 1 -- 172.21.15.1:0/255535803 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff43c137ed0 con 0x7ff43c0b9070 2024-09-15T21:55:40.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.913+0000 7ff4397fa640 1 -- 172.21.15.1:0/255535803 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7ff434056000 con 0x7ff43c0b9070 2024-09-15T21:55:40.915 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2024-09-15T21:55:40.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.913+0000 7ff442e0d640 1 -- 172.21.15.1:0/255535803 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff4200678c0 msgr2=0x7ff420069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.913+0000 7ff442e0d640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff4200678c0 0x7ff420069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff4300ad000 tx=0x7ff430008040 comp rx=0 tx=0).stop 2024-09-15T21:55:40.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.913+0000 7ff442e0d640 1 -- 172.21.15.1:0/255535803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff43c0b9070 msgr2=0x7ff43c1e3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:40.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.913+0000 7ff442e0d640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff43c0b9070 0x7ff43c1e3870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c770 tx=0x7ff43400cc30 comp rx=0 tx=0).stop 2024-09-15T21:55:40.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.913+0000 7ff442e0d640 1 -- 172.21.15.1:0/255535803 shutdown_connections 2024-09-15T21:55:40.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.913+0000 7ff442e0d640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff43c0b9070 0x7ff43c1e3870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.913+0000 7ff442e0d640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff4200678c0 0x7ff420069d80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.913+0000 7ff442e0d640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff43c0b62f0 0x7ff43c1350c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.913+0000 7ff442e0d640 1 --2- 172.21.15.1:0/255535803 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff43c0b5050 0x7ff43c13a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:40.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.913+0000 7ff442e0d640 1 -- 172.21.15.1:0/255535803 >> 172.21.15.1:0/255535803 conn(0x7ff43c0b9ea0 msgr2=0x7ff43c0bc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:40.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.913+0000 7ff442e0d640 1 -- 172.21.15.1:0/255535803 shutdown_connections 2024-09-15T21:55:40.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:40.913+0000 7ff442e0d640 1 -- 172.21.15.1:0/255535803 wait complete. 2024-09-15T21:55:40.934 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args' 2024-09-15T21:55:41.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b2cc4640 1 Processor -- start 2024-09-15T21:55:41.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b2cc4640 1 -- start start 2024-09-15T21:55:41.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b2cc4640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff1ac0b6120 0x7ff1ac14b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:41.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b2cc4640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1ac1480c0 0x7ff1ac1413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:41.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b2cc4640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1ac0b6500 con 0x7ff1ac148520 2024-09-15T21:55:41.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b2cc4640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7ff1ac14bc60 con 0x7ff1ac0b6120 2024-09-15T21:55:41.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b2cc4640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ac147ba0 con 0x7ff1ac1480c0 2024-09-15T21:55:41.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b1261640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff1ac148520 0x7ff1ac0b4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44106/0 (socket says 172.21.15.1:44106) 2024-09-15T21:55:41.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b0a60640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff1ac0b6120 0x7ff1ac14b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:41.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b1261640 1 -- 172.21.15.1:0/2222754448 learned_addr learned my addr 172.21.15.1:0/2222754448 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:41.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1abfff640 1 --2- 172.21.15.1:0/2222754448 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1ac1480c0 0x7ff1ac1413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:41.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b0a60640 1 -- 172.21.15.1:0/2222754448 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1ac1480c0 msgr2=0x7ff1ac1413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:41.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b0a60640 1 --2- 172.21.15.1:0/2222754448 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1ac1480c0 0x7ff1ac1413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:41.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b0a60640 1 -- 172.21.15.1:0/2222754448 >> v1:172.21.15.1:6789/0 conn(0x7ff1ac148520 legacy=0x7ff1ac0b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:41.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b0a60640 1 -- 172.21.15.1:0/2222754448 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ac0b76c0 con 0x7ff1ac0b6120 2024-09-15T21:55:41.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1ab7fe640 1 -- 172.21.15.1:0/2222754448 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154556380 0 0) 0x7ff1ac0b6500 con 0x7ff1ac148520 2024-09-15T21:55:41.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1abfff640 1 --2- 172.21.15.1:0/2222754448 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1ac1480c0 0x7ff1ac1413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:41.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1b0a60640 1 --2- 172.21.15.1:0/2222754448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1ac0b6120 0x7ff1ac14b320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00097c0 tx=0x7ff1a001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce23b367db356b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:41.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.045+0000 7ff1ab7fe640 1 -- 172.21.15.1:0/2222754448 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a00b0070 con 0x7ff1ac0b6120 2024-09-15T21:55:41.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1ab7fe640 1 -- 172.21.15.1:0/2222754448 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a00ab600 con 0x7ff1ac0b6120 2024-09-15T21:55:41.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1ab7fe640 1 -- 172.21.15.1:0/2222754448 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a00ab9d0 con 0x7ff1ac0b6120 2024-09-15T21:55:41.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/2222754448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1ac0b6120 msgr2=0x7ff1ac14b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:41.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 --2- 172.21.15.1:0/2222754448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1ac0b6120 0x7ff1ac14b320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00097c0 tx=0x7ff1a001c410 comp rx=0 tx=0).stop 2024-09-15T21:55:41.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/2222754448 shutdown_connections 2024-09-15T21:55:41.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 --2- 172.21.15.1:0/2222754448 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1ac1480c0 0x7ff1ac1413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:41.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 --2- 172.21.15.1:0/2222754448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1ac0b6120 0x7ff1ac14b320 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:41.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/2222754448 >> 172.21.15.1:0/2222754448 conn(0x7ff1ac0bd2f0 msgr2=0x7ff1ac0bd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:41.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/2222754448 shutdown_connections 2024-09-15T21:55:41.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/2222754448 wait complete. 2024-09-15T21:55:41.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 Processor -- start 2024-09-15T21:55:41.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 -- start start 2024-09-15T21:55:41.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1ac0b6120 0x7ff1ac149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:41.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1ac1480c0 0x7ff1ac137660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:41.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1ac148520 0x7ff1ac137ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:41.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac14b9e0 con 0x7ff1ac0b6120 2024-09-15T21:55:41.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac14b860 con 0x7ff1ac1480c0 2024-09-15T21:55:41.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ac1551f0 con 0x7ff1ac148520 2024-09-15T21:55:41.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b0a60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1ac0b6120 0x7ff1ac149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:41.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b0a60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1ac0b6120 0x7ff1ac149de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43226/0 (socket says 172.21.15.1:43226) 2024-09-15T21:55:41.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b0a60640 1 -- 172.21.15.1:0/3333422857 learned_addr learned my addr 172.21.15.1:0/3333422857 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:41.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b0a60640 1 -- 172.21.15.1:0/3333422857 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1ac148520 msgr2=0x7ff1ac137ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:41.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1abfff640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1ac1480c0 0x7ff1ac137660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:41.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b1261640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1ac148520 0x7ff1ac137ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:41.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b0a60640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1ac148520 0x7ff1ac137ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:41.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b0a60640 1 -- 172.21.15.1:0/3333422857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1ac1480c0 msgr2=0x7ff1ac137660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:41.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b0a60640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1ac1480c0 0x7ff1ac137660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:41.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b0a60640 1 -- 172.21.15.1:0/3333422857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ac142590 con 0x7ff1ac0b6120 2024-09-15T21:55:41.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1abfff640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1ac1480c0 0x7ff1ac137660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:41.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b0a60640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1ac0b6120 0x7ff1ac149de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00ae040 tx=0x7ff1a001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:41.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1a97fa640 1 -- 172.21.15.1:0/3333422857 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a00b0050 con 0x7ff1ac0b6120 2024-09-15T21:55:41.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1a97fa640 1 -- 172.21.15.1:0/3333422857 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a00b1040 con 0x7ff1ac0b6120 2024-09-15T21:55:41.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1a97fa640 1 -- 172.21.15.1:0/3333422857 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0004220 con 0x7ff1ac0b6120 2024-09-15T21:55:41.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/3333422857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1ac142870 con 0x7ff1ac0b6120 2024-09-15T21:55:41.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/3333422857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1ac148cf0 con 0x7ff1ac0b6120 2024-09-15T21:55:41.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.049+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/3333422857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1ac14b320 con 0x7ff1ac0b6120 2024-09-15T21:55:41.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.053+0000 7ff1a97fa640 1 -- 172.21.15.1:0/3333422857 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff1a00be060 con 0x7ff1ac0b6120 2024-09-15T21:55:41.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.053+0000 7ff1a97fa640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff1900678f0 0x7ff190069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:41.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.053+0000 7ff1abfff640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff1900678f0 0x7ff190069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:41.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.053+0000 7ff1a97fa640 1 -- 172.21.15.1:0/3333422857 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff1a011f740 con 0x7ff1ac0b6120 2024-09-15T21:55:41.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.053+0000 7ff1abfff640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff1900678f0 0x7ff190069db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac075720 tx=0x7ff198008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:41.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.057+0000 7ff1a97fa640 1 -- 172.21.15.1:0/3333422857 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff1a0016090 con 0x7ff1ac0b6120 2024-09-15T21:55:41.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:41.285+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/3333422857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]} v 0) -- 0x7ff1ac145cb0 con 0x7ff1ac0b6120 2024-09-15T21:55:42.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.137+0000 7ff1a97fa640 1 -- 172.21.15.1:0/3333422857 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]}]=0 v43) ==== 137+0+0 (secure 0 0 0) 0x7ff1a00f0310 con 0x7ff1ac0b6120 2024-09-15T21:55:42.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.137+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/3333422857 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff1900678f0 msgr2=0x7ff190069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:42.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.137+0000 7ff1b2cc4640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff1900678f0 0x7ff190069db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac075720 tx=0x7ff198008040 comp rx=0 tx=0).stop 2024-09-15T21:55:42.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.137+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/3333422857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1ac0b6120 msgr2=0x7ff1ac149de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:42.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.137+0000 7ff1b2cc4640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1ac0b6120 0x7ff1ac149de0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00ae040 tx=0x7ff1a001ac50 comp rx=0 tx=0).stop 2024-09-15T21:55:42.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.141+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/3333422857 shutdown_connections 2024-09-15T21:55:42.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.141+0000 7ff1b2cc4640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff1ac148520 0x7ff1ac137ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.141+0000 7ff1b2cc4640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff1900678f0 0x7ff190069db0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.141+0000 7ff1b2cc4640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1ac1480c0 0x7ff1ac137660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.141+0000 7ff1b2cc4640 1 --2- 172.21.15.1:0/3333422857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff1ac0b6120 0x7ff1ac149de0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.141+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/3333422857 >> 172.21.15.1:0/3333422857 conn(0x7ff1ac0bd2f0 msgr2=0x7ff1ac0bc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:42.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.141+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/3333422857 shutdown_connections 2024-09-15T21:55:42.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.141+0000 7ff1b2cc4640 1 -- 172.21.15.1:0/3333422857 wait complete. 2024-09-15T21:55:42.166 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T21:55:42.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13ed028640 1 Processor -- start 2024-09-15T21:55:42.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13ed028640 1 -- start start 2024-09-15T21:55:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13ed028640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13e80b5050 0x7f13e814b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13ed028640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f13e80b54c0 0x7f13e814b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13ed028640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e806d710 con 0x7f13e806d330 2024-09-15T21:55:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13ed028640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f13e806e370 con 0x7f13e80b5050 2024-09-15T21:55:42.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13ed028640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f13e80b3ad0 con 0x7f13e80b54c0 2024-09-15T21:55:42.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13dffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13e80b5050 0x7f13e814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13dffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f13e80b5050 0x7f13e814b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43236/0 (socket says 172.21.15.1:43236) 2024-09-15T21:55:42.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13dffff640 1 -- 172.21.15.1:0/82783291 learned_addr learned my addr 172.21.15.1:0/82783291 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:42.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13e759e640 1 --2- 172.21.15.1:0/82783291 >> v2:172.21.15.70:3300/0 conn(0x7f13e80b54c0 0x7f13e814b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13dffff640 1 -- 172.21.15.1:0/82783291 >> v2:172.21.15.70:3300/0 conn(0x7f13e80b54c0 msgr2=0x7f13e814b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:42.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13dffff640 1 --2- 172.21.15.1:0/82783291 >> v2:172.21.15.70:3300/0 conn(0x7f13e80b54c0 0x7f13e814b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13dffff640 1 -- 172.21.15.1:0/82783291 >> v1:172.21.15.70:6789/0 conn(0x7f13e806d330 legacy=0x7f13e80aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:42.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13dffff640 1 -- 172.21.15.1:0/82783291 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e80ae290 con 0x7f13e80b5050 2024-09-15T21:55:42.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.297+0000 7f13dffff640 1 --2- 172.21.15.1:0/82783291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e80b5050 0x7f13e814b320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f13e80ba170 tx=0x7f13d001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a92c1ef47e5bac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:42.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13e659c640 1 -- 172.21.15.1:0/82783291 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d00b2070 con 0x7f13e80b5050 2024-09-15T21:55:42.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13e659c640 1 -- 172.21.15.1:0/82783291 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d00a9070 con 0x7f13e80b5050 2024-09-15T21:55:42.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13e659c640 1 -- 172.21.15.1:0/82783291 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d00ad880 con 0x7f13e80b5050 2024-09-15T21:55:42.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 -- 172.21.15.1:0/82783291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e80b5050 msgr2=0x7f13e814b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:42.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 --2- 172.21.15.1:0/82783291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e80b5050 0x7f13e814b320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f13e80ba170 tx=0x7f13d001c450 comp rx=0 tx=0).stop 2024-09-15T21:55:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 -- 172.21.15.1:0/82783291 shutdown_connections 2024-09-15T21:55:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 --2- 172.21.15.1:0/82783291 >> v2:172.21.15.70:3300/0 conn(0x7f13e80b54c0 0x7f13e814b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 --2- 172.21.15.1:0/82783291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e80b5050 0x7f13e814b320 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 -- 172.21.15.1:0/82783291 >> 172.21.15.1:0/82783291 conn(0x7f13e806c730 msgr2=0x7f13e80b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 -- 172.21.15.1:0/82783291 shutdown_connections 2024-09-15T21:55:42.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 -- 172.21.15.1:0/82783291 wait complete. 2024-09-15T21:55:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 Processor -- start 2024-09-15T21:55:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 -- start start 2024-09-15T21:55:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e806d330 0x7f13e8141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e80b5050 0x7f13e813fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e80b54c0 0x7f13e813f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f13e814c1b0 con 0x7f13e80b54c0 2024-09-15T21:55:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13e8154fa0 con 0x7f13e80b5050 2024-09-15T21:55:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f13e8140550 con 0x7f13e806d330 2024-09-15T21:55:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13e759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e80b54c0 0x7f13e813f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13e759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e80b54c0 0x7f13e813f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43252/0 (socket says 172.21.15.1:43252) 2024-09-15T21:55:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13e759e640 1 -- 172.21.15.1:0/1626095132 learned_addr learned my addr 172.21.15.1:0/1626095132 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13dffff640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e80b5050 0x7f13e813fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13e6d9d640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e806d330 0x7f13e8141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13e759e640 1 -- 172.21.15.1:0/1626095132 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e806d330 msgr2=0x7f13e8141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13e759e640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e806d330 0x7f13e8141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13e759e640 1 -- 172.21.15.1:0/1626095132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e80b5050 msgr2=0x7f13e813fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13e759e640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e80b5050 0x7f13e813fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13e759e640 1 -- 172.21.15.1:0/1626095132 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e81415d0 con 0x7f13e80b54c0 2024-09-15T21:55:42.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13e759e640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e80b54c0 0x7f13e813f260 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13e0007e60 tx=0x7f13e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:42.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13df7fe640 1 -- 172.21.15.1:0/1626095132 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0014420 con 0x7f13e80b54c0 2024-09-15T21:55:42.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13df7fe640 1 -- 172.21.15.1:0/1626095132 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e0019070 con 0x7f13e80b54c0 2024-09-15T21:55:42.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 -- 172.21.15.1:0/1626095132 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e8141880 con 0x7f13e80b54c0 2024-09-15T21:55:42.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13df7fe640 1 -- 172.21.15.1:0/1626095132 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0014820 con 0x7f13e80b54c0 2024-09-15T21:55:42.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.301+0000 7f13ed028640 1 -- 172.21.15.1:0/1626095132 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e81407a0 con 0x7f13e80b54c0 2024-09-15T21:55:42.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.305+0000 7f13ed028640 1 -- 172.21.15.1:0/1626095132 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e81e02d0 con 0x7f13e80b54c0 2024-09-15T21:55:42.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.305+0000 7f13df7fe640 1 -- 172.21.15.1:0/1626095132 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f13e00149c0 con 0x7f13e80b54c0 2024-09-15T21:55:42.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.305+0000 7f13df7fe640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f13c80678f0 0x7f13c8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.305+0000 7f13df7fe640 1 -- 172.21.15.1:0/1626095132 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f13e0086410 con 0x7f13e80b54c0 2024-09-15T21:55:42.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.305+0000 7f13e6d9d640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f13c80678f0 0x7f13c8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.305+0000 7f13e6d9d640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f13c80678f0 0x7f13c8069db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f13d8004e30 tx=0x7f13d8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:42.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.309+0000 7f13df7fe640 1 -- 172.21.15.1:0/1626095132 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f13e81e02d0 con 0x7f13e80b54c0 2024-09-15T21:55:42.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.473+0000 7f13ed028640 1 -- 172.21.15.1:0/1626095132 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f13e80aee00 con 0x7f13e80b54c0 2024-09-15T21:55:42.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.481+0000 7f13df7fe640 1 -- 172.21.15.1:0/1626095132 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f13e005be20 con 0x7f13e80b54c0 2024-09-15T21:55:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.481+0000 7f13ed028640 1 -- 172.21.15.1:0/1626095132 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f13c80678f0 msgr2=0x7f13c8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.481+0000 7f13ed028640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f13c80678f0 0x7f13c8069db0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f13d8004e30 tx=0x7f13d8009040 comp rx=0 tx=0).stop 2024-09-15T21:55:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.481+0000 7f13ed028640 1 -- 172.21.15.1:0/1626095132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e80b54c0 msgr2=0x7f13e813f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.481+0000 7f13ed028640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e80b54c0 0x7f13e813f260 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13e0007e60 tx=0x7f13e000e4b0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.485+0000 7f13ed028640 1 -- 172.21.15.1:0/1626095132 shutdown_connections 2024-09-15T21:55:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.485+0000 7f13ed028640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f13e80b54c0 0x7f13e813f260 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.485+0000 7f13ed028640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f13c80678f0 0x7f13c8069db0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.485+0000 7f13ed028640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e80b5050 0x7f13e813fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.485+0000 7f13ed028640 1 --2- 172.21.15.1:0/1626095132 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e806d330 0x7f13e8141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.485+0000 7f13ed028640 1 -- 172.21.15.1:0/1626095132 >> 172.21.15.1:0/1626095132 conn(0x7f13e806c730 msgr2=0x7f13e809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.485+0000 7f13ed028640 1 -- 172.21.15.1:0/1626095132 shutdown_connections 2024-09-15T21:55:42.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.485+0000 7f13ed028640 1 -- 172.21.15.1:0/1626095132 wait complete. 2024-09-15T21:55:42.505 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T21:55:42.505 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T21:55:42.613 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T21:55:42.693 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T21:55:42.693 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:55:42.693 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T21:55:42.699 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:55:42.699 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T21:55:42.749 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T21:55:42.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f9906a98640 1 Processor -- start 2024-09-15T21:55:42.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f9906a98640 1 -- start start 2024-09-15T21:55:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f9906a98640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f99000b62f0 0x7f9900147d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f9906a98640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99000b5760 0x7f99000b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f9906a98640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9900148240 con 0x7f99000b9070 2024-09-15T21:55:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f9906a98640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f99000b9a00 con 0x7f99000b62f0 2024-09-15T21:55:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f9906a98640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f99000b48e0 con 0x7f99000b5760 2024-09-15T21:55:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f98fffff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f99000b9070 0x7f99000b5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44118/0 (socket says 172.21.15.1:44118) 2024-09-15T21:55:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f98fffff640 1 -- 172.21.15.1:0/435063445 learned_addr learned my addr 172.21.15.1:0/435063445 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f9905035640 1 --2- 172.21.15.1:0/435063445 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99000b5760 0x7f99000b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f9904834640 1 --2- 172.21.15.1:0/435063445 >> v2:172.21.15.70:3300/0 conn(0x7f99000b62f0 0x7f9900147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3449330508 0 0) 0x7f9900148240 con 0x7f99000b9070 2024-09-15T21:55:42.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98ec003530 con 0x7f99000b9070 2024-09-15T21:55:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2866534852 0 0) 0x7f98ec003530 con 0x7f99000b9070 2024-09-15T21:55:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99000b5760 msgr2=0x7f99000b94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f98ff7fe640 1 --2- 172.21.15.1:0/435063445 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99000b5760 0x7f99000b94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 >> v2:172.21.15.70:3300/0 conn(0x7f99000b62f0 msgr2=0x7f9900147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f98ff7fe640 1 --2- 172.21.15.1:0/435063445 >> v2:172.21.15.70:3300/0 conn(0x7f99000b62f0 0x7f9900147d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99000b66d0 con 0x7f99000b9070 2024-09-15T21:55:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f98e8001680 con 0x7f99000b9070 2024-09-15T21:55:42.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.917+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 >> v1:172.21.15.1:6789/0 conn(0x7f99000b9070 legacy=0x7f99000b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f98ff7fe640 1 --2- 172.21.15.1:0/435063445 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99000b5760 0x7f98ec0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f98ff7fe640 1 --2- 172.21.15.1:0/435063445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec003f40 0x7f98ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f98ff7fe640 1 --2- 172.21.15.1:0/435063445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98ec004d50 0x7f98ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f99000b48e0 con 0x7f98ec004d50 2024-09-15T21:55:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec00b9d0 con 0x7f98ec003f40 2024-09-15T21:55:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f98ec00bba0 con 0x7f99000b5760 2024-09-15T21:55:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9905035640 1 --2- 172.21.15.1:0/435063445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98ec004d50 0x7f98ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9904834640 1 --2- 172.21.15.1:0/435063445 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99000b5760 0x7f98ec0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9905035640 1 -- 172.21.15.1:0/435063445 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99000b5760 msgr2=0x7f98ec0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9905035640 1 --2- 172.21.15.1:0/435063445 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99000b5760 0x7f98ec0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9905035640 1 -- 172.21.15.1:0/435063445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec003f40 msgr2=0x7f98ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9905035640 1 --2- 172.21.15.1:0/435063445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec003f40 0x7f98ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9905035640 1 -- 172.21.15.1:0/435063445 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ec003530 con 0x7f98ec004d50 2024-09-15T21:55:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9905035640 1 --2- 172.21.15.1:0/435063445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98ec004d50 0x7f98ec0051d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f98f800e170 tx=0x7f98f801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967528317172e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f80b2070 con 0x7f98ec004d50 2024-09-15T21:55:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f80a5c70 con 0x7f98ec004d50 2024-09-15T21:55:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f98ff7fe640 1 -- 172.21.15.1:0/435063445 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8009c10 con 0x7f98ec004d50 2024-09-15T21:55:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9906a98640 1 -- 172.21.15.1:0/435063445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98ec004d50 msgr2=0x7f98ec0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9906a98640 1 --2- 172.21.15.1:0/435063445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f98ec004d50 0x7f98ec0051d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f98f800e170 tx=0x7f98f801cc60 comp rx=0 tx=0).stop 2024-09-15T21:55:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9905035640 1 -- 172.21.15.1:0/435063445 reap_dead start 2024-09-15T21:55:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9906a98640 1 -- 172.21.15.1:0/435063445 shutdown_connections 2024-09-15T21:55:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9906a98640 1 -- 172.21.15.1:0/435063445 >> 172.21.15.1:0/435063445 conn(0x7f99000b9ea0 msgr2=0x7f99000ba2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9906a98640 1 -- 172.21.15.1:0/435063445 shutdown_connections 2024-09-15T21:55:42.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.921+0000 7f9906a98640 1 -- 172.21.15.1:0/435063445 wait complete. 2024-09-15T21:55:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9906a98640 1 Processor -- start 2024-09-15T21:55:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9906a98640 1 -- start start 2024-09-15T21:55:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9906a98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec004d50 0x7f99001d1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9906a98640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99001d0a70 0x7f99001d30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9906a98640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99001d3610 0x7f990013d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9906a98640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9900141d90 con 0x7f99001d3610 2024-09-15T21:55:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9906a98640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f99000b4bc0 con 0x7f98ec004d50 2024-09-15T21:55:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9906a98640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f99000b9bc0 con 0x7f99001d0a70 2024-09-15T21:55:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9905035640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99001d3610 0x7f990013d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9905035640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99001d3610 0x7f990013d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43260/0 (socket says 172.21.15.1:43260) 2024-09-15T21:55:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9905035640 1 -- 172.21.15.1:0/2149360950 learned_addr learned my addr 172.21.15.1:0/2149360950 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9904834640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec004d50 0x7f99001d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f98fffff640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99001d0a70 0x7f99001d30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9905035640 1 -- 172.21.15.1:0/2149360950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99001d0a70 msgr2=0x7f99001d30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9905035640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99001d0a70 0x7f99001d30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9905035640 1 -- 172.21.15.1:0/2149360950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec004d50 msgr2=0x7f99001d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9905035640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec004d50 0x7f99001d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9905035640 1 -- 172.21.15.1:0/2149360950 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99001d0630 con 0x7f99001d3610 2024-09-15T21:55:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f98fffff640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99001d0a70 0x7f99001d30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9905035640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99001d3610 0x7f990013d600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f98f800e170 tx=0x7f98f8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f98fd7fa640 1 -- 172.21.15.1:0/2149360950 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f80bc070 con 0x7f99001d3610 2024-09-15T21:55:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f98fd7fa640 1 -- 172.21.15.1:0/2149360950 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f80039a0 con 0x7f99001d3610 2024-09-15T21:55:42.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9906a98640 1 -- 172.21.15.1:0/2149360950 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99001d27d0 con 0x7f99001d3610 2024-09-15T21:55:42.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f98fd7fa640 1 -- 172.21.15.1:0/2149360950 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f80b2040 con 0x7f99001d3610 2024-09-15T21:55:42.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9906a98640 1 -- 172.21.15.1:0/2149360950 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99001cf310 con 0x7f99001d3610 2024-09-15T21:55:42.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9906a98640 1 -- 172.21.15.1:0/2149360950 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99000b94c0 con 0x7f99001d3610 2024-09-15T21:55:42.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f98fd7fa640 1 -- 172.21.15.1:0/2149360950 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f98f80bf070 con 0x7f99001d3610 2024-09-15T21:55:42.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f98fd7fa640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f98e00678c0 0x7f98e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:42.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f98fd7fa640 1 -- 172.21.15.1:0/2149360950 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f98f811fbd0 con 0x7f99001d3610 2024-09-15T21:55:42.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.925+0000 7f9904834640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f98e00678c0 0x7f98e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:42.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.929+0000 7f9904834640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f98e00678c0 0x7f98e0069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009ab0 tx=0x7f98f0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:42.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:42.933+0000 7f98fd7fa640 1 -- 172.21.15.1:0/2149360950 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f98f80a5e20 con 0x7f99001d3610 2024-09-15T21:55:43.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.105+0000 7f9906a98640 1 -- 172.21.15.1:0/2149360950 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9900075a00 con 0x7f99001d3610 2024-09-15T21:55:43.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.109+0000 7f98fd7fa640 1 -- 172.21.15.1:0/2149360950 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f98f80169f0 con 0x7f99001d3610 2024-09-15T21:55:43.112 INFO:teuthology.orchestra.run.smithi001.stderr:listed 0 entries 2024-09-15T21:55:43.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.109+0000 7f9906a98640 1 -- 172.21.15.1:0/2149360950 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f98e00678c0 msgr2=0x7f98e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.109+0000 7f9906a98640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f98e00678c0 0x7f98e0069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009ab0 tx=0x7f98f0008040 comp rx=0 tx=0).stop 2024-09-15T21:55:43.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.109+0000 7f9906a98640 1 -- 172.21.15.1:0/2149360950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99001d3610 msgr2=0x7f990013d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.109+0000 7f9906a98640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99001d3610 0x7f990013d600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f98f800e170 tx=0x7f98f8009750 comp rx=0 tx=0).stop 2024-09-15T21:55:43.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.109+0000 7f9906a98640 1 -- 172.21.15.1:0/2149360950 shutdown_connections 2024-09-15T21:55:43.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.109+0000 7f9906a98640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99001d3610 0x7f990013d600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.109+0000 7f9906a98640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99001d0a70 0x7f99001d30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.109+0000 7f9906a98640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f98e00678c0 0x7f98e0069d80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.109+0000 7f9906a98640 1 --2- 172.21.15.1:0/2149360950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98ec004d50 0x7f99001d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.109+0000 7f9906a98640 1 -- 172.21.15.1:0/2149360950 >> 172.21.15.1:0/2149360950 conn(0x7f99000b9ea0 msgr2=0x7f99000b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:43.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.109+0000 7f9906a98640 1 -- 172.21.15.1:0/2149360950 shutdown_connections 2024-09-15T21:55:43.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.109+0000 7f9906a98640 1 -- 172.21.15.1:0/2149360950 wait complete. 2024-09-15T21:55:43.131 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:55:43.132 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T21:55:43.138 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T21:55:43.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d6138f640 1 Processor -- start 2024-09-15T21:55:43.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d6138f640 1 -- start start 2024-09-15T21:55:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d6138f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2d5c06d0d0 0x7f2d5c0ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d6138f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2d5c0afdc0 0x7f2d5c14edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d6138f640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5c13ec80 con 0x7f2d5c0b5560 2024-09-15T21:55:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d6138f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f2d5c0b5940 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d6138f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f2d5c06dbd0 con 0x7f2d5c0afdc0 2024-09-15T21:55:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d5a7fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2d5c06d0d0 0x7f2d5c0ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d5affd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2d5c0b5560 0x7f2d5c13e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44124/0 (socket says 172.21.15.1:44124) 2024-09-15T21:55:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d5affd640 1 -- 172.21.15.1:0/388733199 learned_addr learned my addr 172.21.15.1:0/388733199 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d5b7fe640 1 --2- 172.21.15.1:0/388733199 >> v2:172.21.15.70:3300/0 conn(0x7f2d5c0afdc0 0x7f2d5c14edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d5a7fc640 1 -- 172.21.15.1:0/388733199 >> v2:172.21.15.70:3300/0 conn(0x7f2d5c0afdc0 msgr2=0x7f2d5c14edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:43.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d5a7fc640 1 --2- 172.21.15.1:0/388733199 >> v2:172.21.15.70:3300/0 conn(0x7f2d5c0afdc0 0x7f2d5c14edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d5a7fc640 1 -- 172.21.15.1:0/388733199 >> v1:172.21.15.1:6789/0 conn(0x7f2d5c0b5560 legacy=0x7f2d5c13e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d5a7fc640 1 -- 172.21.15.1:0/388733199 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c06deb0 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.305+0000 7f2d59ffb640 1 -- 172.21.15.1:0/388733199 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3817430167 0 0) 0x7f2d5c13ec80 con 0x7f2d5c0b5560 2024-09-15T21:55:43.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d5a7fc640 1 --2- 172.21.15.1:0/388733199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d5c06d0d0 0x7f2d5c0ae0f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c073c70 tx=0x7f2d4c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2902da5e51fa75 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:43.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d59ffb640 1 -- 172.21.15.1:0/388733199 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0b0070 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d59ffb640 1 -- 172.21.15.1:0/388733199 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d4c0ab600 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d59ffb640 1 -- 172.21.15.1:0/388733199 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0ab9d0 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 -- 172.21.15.1:0/388733199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d5c06d0d0 msgr2=0x7f2d5c0ae0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 --2- 172.21.15.1:0/388733199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d5c06d0d0 0x7f2d5c0ae0f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c073c70 tx=0x7f2d4c01c3f0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 -- 172.21.15.1:0/388733199 shutdown_connections 2024-09-15T21:55:43.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 --2- 172.21.15.1:0/388733199 >> v2:172.21.15.70:3300/0 conn(0x7f2d5c0afdc0 0x7f2d5c14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 --2- 172.21.15.1:0/388733199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d5c06d0d0 0x7f2d5c0ae0f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 -- 172.21.15.1:0/388733199 >> 172.21.15.1:0/388733199 conn(0x7f2d5c06c730 msgr2=0x7f2d5c0b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:43.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 -- 172.21.15.1:0/388733199 shutdown_connections 2024-09-15T21:55:43.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 -- 172.21.15.1:0/388733199 wait complete. 2024-09-15T21:55:43.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 Processor -- start 2024-09-15T21:55:43.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 -- start start 2024-09-15T21:55:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d5c06d0d0 0x7f2d5c1435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d5c0afdc0 0x7f2d5c1dbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d5c0b5560 0x7f2d5c1df1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c0b4e70 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c0b4cf0 con 0x7f2d5c0b5560 2024-09-15T21:55:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d6138f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2d5c09aa50 con 0x7f2d5c0afdc0 2024-09-15T21:55:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d5affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d5c06d0d0 0x7f2d5c1435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.309+0000 7f2d5affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d5c06d0d0 0x7f2d5c1435c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43278/0 (socket says 172.21.15.1:43278) 2024-09-15T21:55:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d5affd640 1 -- 172.21.15.1:0/1217817203 learned_addr learned my addr 172.21.15.1:0/1217817203 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d5b7fe640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d5c0b5560 0x7f2d5c1df1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d5a7fc640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d5c0afdc0 0x7f2d5c1dbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d5affd640 1 -- 172.21.15.1:0/1217817203 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d5c0afdc0 msgr2=0x7f2d5c1dbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d5affd640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d5c0afdc0 0x7f2d5c1dbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d5affd640 1 -- 172.21.15.1:0/1217817203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d5c0b5560 msgr2=0x7f2d5c1df1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d5affd640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d5c0b5560 0x7f2d5c1df1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d5affd640 1 -- 172.21.15.1:0/1217817203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c144f90 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d5affd640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d5c06d0d0 0x7f2d5c1435c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c480 tx=0x7f2d4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:43.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d537fe640 1 -- 172.21.15.1:0/1217817203 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44018070 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d537fe640 1 -- 172.21.15.1:0/1217817203 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d44007500 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d6138f640 1 -- 172.21.15.1:0/1217817203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5c142ca0 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d537fe640 1 -- 172.21.15.1:0/1217817203 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44004a30 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d6138f640 1 -- 172.21.15.1:0/1217817203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d5c142f40 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d6138f640 1 -- 172.21.15.1:0/1217817203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d5c0ae0f0 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d537fe640 1 -- 172.21.15.1:0/1217817203 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2d4401b070 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d537fe640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2d3c0678c0 0x7f2d3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:43.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d537fe640 1 -- 172.21.15.1:0/1217817203 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2d44084ee0 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d5a7fc640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2d3c0678c0 0x7f2d3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:43.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.313+0000 7f2d5a7fc640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2d3c0678c0 0x7f2d3c069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0ad000 tx=0x7f2d4c0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:43.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.317+0000 7f2d537fe640 1 -- 172.21.15.1:0/1217817203 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2d5c144f90 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d6138f640 1 -- 172.21.15.1:0/1217817203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2d5c0b7cc0 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d537fe640 1 -- 172.21.15.1:0/1217817203 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f2d44055ab0 con 0x7f2d5c06d0d0 2024-09-15T21:55:43.500 INFO:teuthology.orchestra.run.smithi001.stderr:listed 0 entries 2024-09-15T21:55:43.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d6138f640 1 -- 172.21.15.1:0/1217817203 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2d3c0678c0 msgr2=0x7f2d3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d6138f640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2d3c0678c0 0x7f2d3c069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0ad000 tx=0x7f2d4c0a6000 comp rx=0 tx=0).stop 2024-09-15T21:55:43.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d6138f640 1 -- 172.21.15.1:0/1217817203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d5c06d0d0 msgr2=0x7f2d5c1435c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d6138f640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d5c06d0d0 0x7f2d5c1435c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400c480 tx=0x7f2d4400c940 comp rx=0 tx=0).stop 2024-09-15T21:55:43.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d6138f640 1 -- 172.21.15.1:0/1217817203 shutdown_connections 2024-09-15T21:55:43.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d6138f640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2d3c0678c0 0x7f2d3c069d80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d6138f640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d5c0b5560 0x7f2d5c1df1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d6138f640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2d5c0afdc0 0x7f2d5c1dbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d6138f640 1 --2- 172.21.15.1:0/1217817203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2d5c06d0d0 0x7f2d5c1435c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d6138f640 1 -- 172.21.15.1:0/1217817203 >> 172.21.15.1:0/1217817203 conn(0x7f2d5c06c730 msgr2=0x7f2d5c075430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:43.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d6138f640 1 -- 172.21.15.1:0/1217817203 shutdown_connections 2024-09-15T21:55:43.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.497+0000 7f2d6138f640 1 -- 172.21.15.1:0/1217817203 wait complete. 2024-09-15T21:55:43.520 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi001.front.sepia.ceph.com... 2024-09-15T21:55:43.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:43.521 DEBUG:teuthology.orchestra.run.smithi001:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T21:55:43.543 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:55:43.543 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T21:55:43.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:55:43.543 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T21:55:43.599 INFO:tasks.cephfs.cephfs_test_case:[] 2024-09-15T21:55:43.599 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:55:43.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.769+0000 7efe408cb640 1 Processor -- start 2024-09-15T21:55:43.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.769+0000 7efe408cb640 1 -- start start 2024-09-15T21:55:43.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe408cb640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efe3c14fa20 0x7efe3c14fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:43.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe408cb640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efe3c154700 0x7efe3c156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:43.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe408cb640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe3c0708d0 con 0x7efe3c14f640 2024-09-15T21:55:43.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe408cb640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7efe3c09e1a0 con 0x7efe3c14fa20 2024-09-15T21:55:43.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe408cb640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c0b9470 con 0x7efe3c154700 2024-09-15T21:55:43.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe39d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efe3c14fa20 0x7efe3c14fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:43.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe39d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efe3c14fa20 0x7efe3c14fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43284/0 (socket says 172.21.15.1:43284) 2024-09-15T21:55:43.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe39d9b640 1 -- 172.21.15.1:0/467095494 learned_addr learned my addr 172.21.15.1:0/467095494 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:43.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe3ad9d640 1 --2- 172.21.15.1:0/467095494 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efe3c154700 0x7efe3c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:43.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe39d9b640 1 -- 172.21.15.1:0/467095494 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efe3c154700 msgr2=0x7efe3c156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:43.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe39d9b640 1 --2- 172.21.15.1:0/467095494 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efe3c154700 0x7efe3c156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe39d9b640 1 -- 172.21.15.1:0/467095494 >> v1:172.21.15.70:6789/0 conn(0x7efe3c14f640 legacy=0x7efe3c073760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe39d9b640 1 -- 172.21.15.1:0/467095494 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c0ba880 con 0x7efe3c14fa20 2024-09-15T21:55:43.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe39d9b640 1 --2- 172.21.15.1:0/467095494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c14fa20 0x7efe3c14fe80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efe30006fd0 tx=0x7efe3001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993eb0856075bfd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:43.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe3959a640 1 -- 172.21.15.1:0/467095494 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe300b0070 con 0x7efe3c14fa20 2024-09-15T21:55:43.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe3959a640 1 -- 172.21.15.1:0/467095494 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe300ab600 con 0x7efe3c14fa20 2024-09-15T21:55:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe3959a640 1 -- 172.21.15.1:0/467095494 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe300ab9d0 con 0x7efe3c14fa20 2024-09-15T21:55:43.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe408cb640 1 -- 172.21.15.1:0/467095494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c14fa20 msgr2=0x7efe3c14fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe408cb640 1 --2- 172.21.15.1:0/467095494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c14fa20 0x7efe3c14fe80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efe30006fd0 tx=0x7efe3001c420 comp rx=0 tx=0).stop 2024-09-15T21:55:43.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe408cb640 1 -- 172.21.15.1:0/467095494 shutdown_connections 2024-09-15T21:55:43.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe408cb640 1 --2- 172.21.15.1:0/467095494 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efe3c154700 0x7efe3c156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe408cb640 1 --2- 172.21.15.1:0/467095494 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c14fa20 0x7efe3c14fe80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe408cb640 1 -- 172.21.15.1:0/467095494 >> 172.21.15.1:0/467095494 conn(0x7efe3c09d260 msgr2=0x7efe3c09d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:43.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe408cb640 1 -- 172.21.15.1:0/467095494 shutdown_connections 2024-09-15T21:55:43.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.773+0000 7efe408cb640 1 -- 172.21.15.1:0/467095494 wait complete. 2024-09-15T21:55:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe408cb640 1 Processor -- start 2024-09-15T21:55:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe408cb640 1 -- start start 2024-09-15T21:55:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe408cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c14f640 0x7efe3c150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe408cb640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efe3c14fa20 0x7efe3c152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:43.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe408cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe3c154700 0x7efe3c1511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:43.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe408cb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c073e70 con 0x7efe3c14f640 2024-09-15T21:55:43.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe408cb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c0727e0 con 0x7efe3c154700 2024-09-15T21:55:43.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe408cb640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c073ff0 con 0x7efe3c14fa20 2024-09-15T21:55:43.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe3a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c14f640 0x7efe3c150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:43.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe3a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c14f640 0x7efe3c150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43300/0 (socket says 172.21.15.1:43300) 2024-09-15T21:55:43.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe3a59c640 1 -- 172.21.15.1:0/1516308735 learned_addr learned my addr 172.21.15.1:0/1516308735 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:43.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe3ad9d640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe3c154700 0x7efe3c1511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:43.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe39d9b640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efe3c14fa20 0x7efe3c152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:43.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe3a59c640 1 -- 172.21.15.1:0/1516308735 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efe3c14fa20 msgr2=0x7efe3c152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe3a59c640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efe3c14fa20 0x7efe3c152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe3a59c640 1 -- 172.21.15.1:0/1516308735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe3c154700 msgr2=0x7efe3c1511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe3a59c640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe3c154700 0x7efe3c1511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe3a59c640 1 -- 172.21.15.1:0/1516308735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c153d20 con 0x7efe3c14f640 2024-09-15T21:55:43.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe3a59c640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c14f640 0x7efe3c150730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c760 tx=0x7efe3400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:43.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe2affd640 1 -- 172.21.15.1:0/1516308735 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34016020 con 0x7efe3c14f640 2024-09-15T21:55:43.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe2affd640 1 -- 172.21.15.1:0/1516308735 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe34006d60 con 0x7efe3c14f640 2024-09-15T21:55:43.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe2affd640 1 -- 172.21.15.1:0/1516308735 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34003bc0 con 0x7efe3c14f640 2024-09-15T21:55:43.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe408cb640 1 -- 172.21.15.1:0/1516308735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3c153060 con 0x7efe3c14f640 2024-09-15T21:55:43.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe408cb640 1 -- 172.21.15.1:0/1516308735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3c153fc0 con 0x7efe3c14f640 2024-09-15T21:55:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.777+0000 7efe408cb640 1 -- 172.21.15.1:0/1516308735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3c14fe80 con 0x7efe3c14f640 2024-09-15T21:55:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.781+0000 7efe2affd640 1 -- 172.21.15.1:0/1516308735 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe3400a850 con 0x7efe3c14f640 2024-09-15T21:55:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.781+0000 7efe2affd640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efe1c0678c0 0x7efe1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.781+0000 7efe2affd640 1 -- 172.21.15.1:0/1516308735 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efe340858d0 con 0x7efe3c14f640 2024-09-15T21:55:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.781+0000 7efe39d9b640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efe1c0678c0 0x7efe1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:43.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.781+0000 7efe39d9b640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efe1c0678c0 0x7efe1c069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe300ad000 tx=0x7efe30009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:43.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.785+0000 7efe2affd640 1 -- 172.21.15.1:0/1516308735 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe34020020 con 0x7efe3c14f640 2024-09-15T21:55:43.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.981+0000 7efe408cb640 1 -- 172.21.15.1:0/1516308735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe3c150c70 con 0x7efe3c14f640 2024-09-15T21:55:43.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.985+0000 7efe2affd640 1 -- 172.21.15.1:0/1516308735 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3566 (secure 0 0 0) 0x7efe340564a0 con 0x7efe3c14f640 2024-09-15T21:55:43.988 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:43.988 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-09-15T21:55:24:061270+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/2650682187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2650682187},{"type":"v1","addr":"172.21.15.70:6833","nonce":2650682187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:20.400358+0000","modified":"2024-09-15T21:55:23.425841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3288963990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3288963990},{"type":"v1","addr":"172.21.15.1:6835","nonce":3288963990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4245,"qdb_cluster":[4245]},"id":1}]} 2024-09-15T21:55:43.989 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-09-15T21:55:43.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.985+0000 7efe408cb640 1 -- 172.21.15.1:0/1516308735 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efe1c0678c0 msgr2=0x7efe1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.985+0000 7efe408cb640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efe1c0678c0 0x7efe1c069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe300ad000 tx=0x7efe30009040 comp rx=0 tx=0).stop 2024-09-15T21:55:43.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.985+0000 7efe408cb640 1 -- 172.21.15.1:0/1516308735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c14f640 msgr2=0x7efe3c150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:43.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.985+0000 7efe408cb640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c14f640 0x7efe3c150730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c760 tx=0x7efe3400cc20 comp rx=0 tx=0).stop 2024-09-15T21:55:43.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.985+0000 7efe408cb640 1 -- 172.21.15.1:0/1516308735 shutdown_connections 2024-09-15T21:55:43.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.985+0000 7efe408cb640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efe1c0678c0 0x7efe1c069d80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.985+0000 7efe408cb640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe3c154700 0x7efe3c1511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.985+0000 7efe408cb640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efe3c14fa20 0x7efe3c152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.985+0000 7efe408cb640 1 --2- 172.21.15.1:0/1516308735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efe3c14f640 0x7efe3c150730 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:43.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.985+0000 7efe408cb640 1 -- 172.21.15.1:0/1516308735 >> 172.21.15.1:0/1516308735 conn(0x7efe3c09d260 msgr2=0x7efe3c09bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:43.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.985+0000 7efe408cb640 1 -- 172.21.15.1:0/1516308735 shutdown_connections 2024-09-15T21:55:43.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:43.985+0000 7efe408cb640 1 -- 172.21.15.1:0/1516308735 wait complete. 2024-09-15T21:55:44.007 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:55:44.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.121+0000 7f47c91e6640 1 Processor -- start 2024-09-15T21:55:44.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.121+0000 7f47c91e6640 1 -- start start 2024-09-15T21:55:44.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c91e6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47c40b6120 0x7f47c414b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c91e6640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c40b6500 con 0x7f47c41480c0 2024-09-15T21:55:44.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c91e6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c414bc60 con 0x7f47c4141ac0 2024-09-15T21:55:44.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c91e6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f47c4147ba0 con 0x7f47c40b6120 2024-09-15T21:55:44.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c259c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f47c41480c0 0x7f47c41413b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44136/0 (socket says 172.21.15.1:44136) 2024-09-15T21:55:44.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c259c640 1 -- 172.21.15.1:0/1872506735 learned_addr learned my addr 172.21.15.1:0/1872506735 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:44.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c2d9d640 1 --2- 172.21.15.1:0/1872506735 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47c40b6120 0x7f47c414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3966957974 0 0) 0x7f47c40b6500 con 0x7f47c41480c0 2024-09-15T21:55:44.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47ac003530 con 0x7f47c41480c0 2024-09-15T21:55:44.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2705911918 0 0) 0x7f47ac003530 con 0x7f47c41480c0 2024-09-15T21:55:44.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47c40b6120 msgr2=0x7f47c414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:44.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 --2- 172.21.15.1:0/1872506735 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47c40b6120 0x7f47c414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 >> v1:172.21.15.70:6789/0 conn(0x7f47c4141ac0 legacy=0x7f47c41521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c40b76c0 con 0x7f47c41480c0 2024-09-15T21:55:44.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f47b8001680 con 0x7f47c41480c0 2024-09-15T21:55:44.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 >> v1:172.21.15.1:6789/0 conn(0x7f47c41480c0 legacy=0x7f47c41413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 --2- 172.21.15.1:0/1872506735 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47c40b6120 0x7f47ac0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 --2- 172.21.15.1:0/1872506735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac003f70 0x7f47ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 --2- 172.21.15.1:0/1872506735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47ac004d50 0x7f47ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f47c4147ba0 con 0x7f47ac004d50 2024-09-15T21:55:44.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac00bb60 con 0x7f47ac003f70 2024-09-15T21:55:44.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f47ac00bd60 con 0x7f47c40b6120 2024-09-15T21:55:44.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c359e640 1 --2- 172.21.15.1:0/1872506735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47ac004d50 0x7f47ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c2d9d640 1 --2- 172.21.15.1:0/1872506735 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47c40b6120 0x7f47ac0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c259c640 1 --2- 172.21.15.1:0/1872506735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac003f70 0x7f47ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c359e640 1 -- 172.21.15.1:0/1872506735 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47c40b6120 msgr2=0x7f47ac0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:44.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c359e640 1 --2- 172.21.15.1:0/1872506735 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47c40b6120 0x7f47ac0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c359e640 1 -- 172.21.15.1:0/1872506735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac003f70 msgr2=0x7f47ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:44.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c359e640 1 --2- 172.21.15.1:0/1872506735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac003f70 0x7f47ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.125+0000 7f47c359e640 1 -- 172.21.15.1:0/1872506735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ac003530 con 0x7f47ac004d50 2024-09-15T21:55:44.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c359e640 1 --2- 172.21.15.1:0/1872506735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47ac004d50 0x7f47ac0051d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f47bc001e40 tx=0x7f47bc01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8800b9052ee5617e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:44.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc001a90 con 0x7f47ac004d50 2024-09-15T21:55:44.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc003b80 con 0x7f47ac004d50 2024-09-15T21:55:44.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c1d9b640 1 -- 172.21.15.1:0/1872506735 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc005080 con 0x7f47ac004d50 2024-09-15T21:55:44.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 -- 172.21.15.1:0/1872506735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47ac004d50 msgr2=0x7f47ac0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 --2- 172.21.15.1:0/1872506735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47ac004d50 0x7f47ac0051d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f47bc001e40 tx=0x7f47bc01c760 comp rx=0 tx=0).stop 2024-09-15T21:55:44.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c359e640 1 -- 172.21.15.1:0/1872506735 reap_dead start 2024-09-15T21:55:44.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 -- 172.21.15.1:0/1872506735 shutdown_connections 2024-09-15T21:55:44.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 -- 172.21.15.1:0/1872506735 >> 172.21.15.1:0/1872506735 conn(0x7f47c40bd2f0 msgr2=0x7f47c40bd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:44.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 -- 172.21.15.1:0/1872506735 shutdown_connections 2024-09-15T21:55:44.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 -- 172.21.15.1:0/1872506735 wait complete. 2024-09-15T21:55:44.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 Processor -- start 2024-09-15T21:55:44.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 -- start start 2024-09-15T21:55:44.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c41448c0 0x7f47c4144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41e0780 0x7f47c41e0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47c413a3d0 0x7f47c413a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f47c4148520 con 0x7f47c41e0780 2024-09-15T21:55:44.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f47c40b7c70 con 0x7f47c41448c0 2024-09-15T21:55:44.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f47c41486a0 con 0x7f47c413a3d0 2024-09-15T21:55:44.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41e0780 0x7f47c41e0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41e0780 0x7f47c41e0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43316/0 (socket says 172.21.15.1:43316) 2024-09-15T21:55:44.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c259c640 1 -- 172.21.15.1:0/3222054748 learned_addr learned my addr 172.21.15.1:0/3222054748 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:44.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c359e640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47c413a3d0 0x7f47c413a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c2d9d640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c41448c0 0x7f47c4144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c259c640 1 -- 172.21.15.1:0/3222054748 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47c413a3d0 msgr2=0x7f47c413a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c259c640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47c413a3d0 0x7f47c413a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c259c640 1 -- 172.21.15.1:0/3222054748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c41448c0 msgr2=0x7f47c4144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c259c640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c41448c0 0x7f47c4144ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c259c640 1 -- 172.21.15.1:0/3222054748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c41451e0 con 0x7f47c41e0780 2024-09-15T21:55:44.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c2d9d640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c41448c0 0x7f47c4144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:44.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c259c640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41e0780 0x7f47c41e0c00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f47b8012500 tx=0x7f47b80129c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:44.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47ab7fe640 1 -- 172.21.15.1:0/3222054748 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8014810 con 0x7f47c41e0780 2024-09-15T21:55:44.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47ab7fe640 1 -- 172.21.15.1:0/3222054748 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b801b070 con 0x7f47c41e0780 2024-09-15T21:55:44.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 -- 172.21.15.1:0/3222054748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c41e1140 con 0x7f47c41e0780 2024-09-15T21:55:44.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47ab7fe640 1 -- 172.21.15.1:0/3222054748 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8014bf0 con 0x7f47c41e0780 2024-09-15T21:55:44.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.129+0000 7f47c91e6640 1 -- 172.21.15.1:0/3222054748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c413dcb0 con 0x7f47c41e0780 2024-09-15T21:55:44.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.133+0000 7f47c91e6640 1 -- 172.21.15.1:0/3222054748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c41413b0 con 0x7f47c41e0780 2024-09-15T21:55:44.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.133+0000 7f47ab7fe640 1 -- 172.21.15.1:0/3222054748 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47b8016480 con 0x7f47c41e0780 2024-09-15T21:55:44.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.133+0000 7f47ab7fe640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f47b00678c0 0x7f47b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.133+0000 7f47ab7fe640 1 -- 172.21.15.1:0/3222054748 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f47b80891a0 con 0x7f47c41e0780 2024-09-15T21:55:44.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.133+0000 7f47c2d9d640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f47b00678c0 0x7f47b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.133+0000 7f47c2d9d640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f47b00678c0 0x7f47b0069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f47c41da8f0 tx=0x7f47b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:44.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.137+0000 7f47ab7fe640 1 -- 172.21.15.1:0/3222054748 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f47c41e1140 con 0x7f47c41e0780 2024-09-15T21:55:44.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.337+0000 7f47c91e6640 1 -- 172.21.15.1:0/3222054748 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47c4143ec0 con 0x7f47c41e0780 2024-09-15T21:55:44.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.337+0000 7f47ab7fe640 1 -- 172.21.15.1:0/3222054748 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3566 (secure 0 0 0) 0x7f47c4143ec0 con 0x7f47c41e0780 2024-09-15T21:55:44.342 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:44.343 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-09-15T21:55:24:061270+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/2650682187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2650682187},{"type":"v1","addr":"172.21.15.70:6833","nonce":2650682187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:20.400358+0000","modified":"2024-09-15T21:55:23.425841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3288963990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3288963990},{"type":"v1","addr":"172.21.15.1:6835","nonce":3288963990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4245,"qdb_cluster":[4245]},"id":1}]} 2024-09-15T21:55:44.343 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-09-15T21:55:44.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.341+0000 7f47c91e6640 1 -- 172.21.15.1:0/3222054748 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f47b00678c0 msgr2=0x7f47b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.341+0000 7f47c91e6640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f47b00678c0 0x7f47b0069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f47c41da8f0 tx=0x7f47b4008040 comp rx=0 tx=0).stop 2024-09-15T21:55:44.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.341+0000 7f47c91e6640 1 -- 172.21.15.1:0/3222054748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41e0780 msgr2=0x7f47c41e0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.341+0000 7f47c91e6640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41e0780 0x7f47c41e0c00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f47b8012500 tx=0x7f47b80129c0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.341+0000 7f47c91e6640 1 -- 172.21.15.1:0/3222054748 shutdown_connections 2024-09-15T21:55:44.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.341+0000 7f47c91e6640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47c413a3d0 0x7f47c413a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.341+0000 7f47c91e6640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47c41e0780 0x7f47c41e0c00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.341+0000 7f47c91e6640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f47b00678c0 0x7f47b0069d80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.341+0000 7f47c91e6640 1 --2- 172.21.15.1:0/3222054748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47c41448c0 0x7f47c4144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.341+0000 7f47c91e6640 1 -- 172.21.15.1:0/3222054748 >> 172.21.15.1:0/3222054748 conn(0x7f47c40bd2f0 msgr2=0x7f47c40b4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:44.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.341+0000 7f47c91e6640 1 -- 172.21.15.1:0/3222054748 shutdown_connections 2024-09-15T21:55:44.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.341+0000 7f47c91e6640 1 -- 172.21.15.1:0/3222054748 wait complete. 2024-09-15T21:55:44.362 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:44.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.473+0000 7fdfe2bff640 1 Processor -- start 2024-09-15T21:55:44.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.473+0000 7fdfe2bff640 1 -- start start 2024-09-15T21:55:44.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfe2bff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdfdc1480c0 0x7fdfdc1413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfe2bff640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfdc0b6500 con 0x7fdfdc148520 2024-09-15T21:55:44.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfe2bff640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfdc14bc60 con 0x7fdfdc0b6120 2024-09-15T21:55:44.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfe2bff640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fdfdc14ba30 con 0x7fdfdc1480c0 2024-09-15T21:55:44.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfe119c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fdfdc148520 0x7fdfdc1521d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44140/0 (socket says 172.21.15.1:44140) 2024-09-15T21:55:44.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfe119c640 1 -- 172.21.15.1:0/1885061312 learned_addr learned my addr 172.21.15.1:0/1885061312 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:44.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdbfff640 1 --2- 172.21.15.1:0/1885061312 >> v2:172.21.15.70:3300/0 conn(0x7fdfdc1480c0 0x7fdfdc1413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213702663 0 0) 0x7fdfdc0b6500 con 0x7fdfdc148520 2024-09-15T21:55:44.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfc4003530 con 0x7fdfdc148520 2024-09-15T21:55:44.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 952501922 0 0) 0x7fdfc4003530 con 0x7fdfdc148520 2024-09-15T21:55:44.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 >> v2:172.21.15.70:3300/0 conn(0x7fdfdc1480c0 msgr2=0x7fdfdc1413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 --2- 172.21.15.1:0/1885061312 >> v2:172.21.15.70:3300/0 conn(0x7fdfdc1480c0 0x7fdfdc1413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 >> v1:172.21.15.70:6789/0 conn(0x7fdfdc0b6120 legacy=0x7fdfdc14b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc147ba0 con 0x7fdfdc148520 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7fdfd4001a00 con 0x7fdfdc148520 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 >> v1:172.21.15.1:6789/0 conn(0x7fdfdc148520 legacy=0x7fdfdc1521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 --2- 172.21.15.1:0/1885061312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfc40039c0 0x7fdfc4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 --2- 172.21.15.1:0/1885061312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfc4004810 0x7fdfc4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 --2- 172.21.15.1:0/1885061312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfc40051d0 0x7fdfc400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc400c140 con 0x7fdfc40051d0 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc400c2f0 con 0x7fdfc4004810 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc400c4f0 con 0x7fdfc40039c0 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfe119c640 1 --2- 172.21.15.1:0/1885061312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfc40051d0 0x7fdfc400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfe119c640 1 -- 172.21.15.1:0/1885061312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfc40039c0 msgr2=0x7fdfc4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:44.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfe099b640 1 --2- 172.21.15.1:0/1885061312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfc40039c0 0x7fdfc4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfe119c640 1 --2- 172.21.15.1:0/1885061312 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfc40039c0 0x7fdfc4003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfe119c640 1 -- 172.21.15.1:0/1885061312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfc4004810 msgr2=0x7fdfc4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:44.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfe119c640 1 --2- 172.21.15.1:0/1885061312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfc4004810 0x7fdfc4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.477+0000 7fdfe119c640 1 -- 172.21.15.1:0/1885061312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc4003530 con 0x7fdfc40051d0 2024-09-15T21:55:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe119c640 1 -- 172.21.15.1:0/1885061312 reap_dead start 2024-09-15T21:55:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe119c640 1 --2- 172.21.15.1:0/1885061312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfc40051d0 0x7fdfc400b9d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400a810 tx=0x7fdfd401faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53f36c23d4e22d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd400a460 con 0x7fdfc40051d0 2024-09-15T21:55:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd40aa6f0 con 0x7fdfc40051d0 2024-09-15T21:55:44.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfdb7fe640 1 -- 172.21.15.1:0/1885061312 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40aaae0 con 0x7fdfc40051d0 2024-09-15T21:55:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 -- 172.21.15.1:0/1885061312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfc40051d0 msgr2=0x7fdfc400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 --2- 172.21.15.1:0/1885061312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfc40051d0 0x7fdfc400b9d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400a810 tx=0x7fdfd401faa0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 -- 172.21.15.1:0/1885061312 shutdown_connections 2024-09-15T21:55:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 --2- 172.21.15.1:0/1885061312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfc40051d0 0x7fdfc400b9d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 -- 172.21.15.1:0/1885061312 >> 172.21.15.1:0/1885061312 conn(0x7fdfdc0bd2f0 msgr2=0x7fdfdc0bd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 -- 172.21.15.1:0/1885061312 shutdown_connections 2024-09-15T21:55:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 -- 172.21.15.1:0/1885061312 wait complete. 2024-09-15T21:55:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 Processor -- start 2024-09-15T21:55:44.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 -- start start 2024-09-15T21:55:44.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfc40051d0 0x7fdfdc144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfdc1d29f0 0x7fdfdc1d2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfdc13f850 0x7fdfdc13fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc0b7620 con 0x7fdfdc1d29f0 2024-09-15T21:55:44.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc0b7c70 con 0x7fdfdc13f850 2024-09-15T21:55:44.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fdfdc0b77a0 con 0x7fdfc40051d0 2024-09-15T21:55:44.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfdbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfdc1d29f0 0x7fdfdc1d2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfdbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfdc1d29f0 0x7fdfdc1d2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43336/0 (socket says 172.21.15.1:43336) 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfdbfff640 1 -- 172.21.15.1:0/3745933236 learned_addr learned my addr 172.21.15.1:0/3745933236 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe119c640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfdc13f850 0x7fdfdc13fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe099b640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfc40051d0 0x7fdfdc144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfdbfff640 1 -- 172.21.15.1:0/3745933236 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfc40051d0 msgr2=0x7fdfdc144b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfdbfff640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfc40051d0 0x7fdfdc144b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfdbfff640 1 -- 172.21.15.1:0/3745933236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfdc13f850 msgr2=0x7fdfdc13fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfdbfff640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfdc13f850 0x7fdfdc13fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfdbfff640 1 -- 172.21.15.1:0/3745933236 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc0aa4b0 con 0x7fdfdc1d29f0 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfdbfff640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfdc1d29f0 0x7fdfdc1d2e70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000e7c0 tx=0x7fdfd000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfd97fa640 1 -- 172.21.15.1:0/3745933236 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0017070 con 0x7fdfdc1d29f0 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfd97fa640 1 -- 172.21.15.1:0/3745933236 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd000ee70 con 0x7fdfdc1d29f0 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 -- 172.21.15.1:0/3745933236 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfdc1e0800 con 0x7fdfdc1d29f0 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfd97fa640 1 -- 172.21.15.1:0/3745933236 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd000cb40 con 0x7fdfdc1d29f0 2024-09-15T21:55:44.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.481+0000 7fdfe2bff640 1 -- 172.21.15.1:0/3745933236 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfdc0aa1d0 con 0x7fdfdc1d29f0 2024-09-15T21:55:44.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.485+0000 7fdfe2bff640 1 -- 172.21.15.1:0/3745933236 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfdc0b7940 con 0x7fdfdc1d29f0 2024-09-15T21:55:44.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.485+0000 7fdfd97fa640 1 -- 172.21.15.1:0/3745933236 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdfd001a070 con 0x7fdfdc1d29f0 2024-09-15T21:55:44.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.485+0000 7fdfd97fa640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdfc80678c0 0x7fdfc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.485+0000 7fdfd97fa640 1 -- 172.21.15.1:0/3745933236 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdfd0085e60 con 0x7fdfdc1d29f0 2024-09-15T21:55:44.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.485+0000 7fdfe099b640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdfc80678c0 0x7fdfc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.485+0000 7fdfe099b640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdfc80678c0 0x7fdfc8069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc007fd0 tx=0x7fdfcc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:44.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.489+0000 7fdfd97fa640 1 -- 172.21.15.1:0/3745933236 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdfd0056a30 con 0x7fdfdc1d29f0 2024-09-15T21:55:44.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.653+0000 7fdfe2bff640 1 -- 172.21.15.1:0/3745933236 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfdc0691c0 con 0x7fdfdc1d29f0 2024-09-15T21:55:44.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.653+0000 7fdfd97fa640 1 -- 172.21.15.1:0/3745933236 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16593 (secure 0 0 0) 0x7fdfd0056330 con 0x7fdfdc1d29f0 2024-09-15T21:55:44.659 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:44.660 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:22.028149+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:18.271646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:19.444906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.657+0000 7fdfe2bff640 1 -- 172.21.15.1:0/3745933236 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdfc80678c0 msgr2=0x7fdfc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.657+0000 7fdfe2bff640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdfc80678c0 0x7fdfc8069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc007fd0 tx=0x7fdfcc009040 comp rx=0 tx=0).stop 2024-09-15T21:55:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.657+0000 7fdfe2bff640 1 -- 172.21.15.1:0/3745933236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfdc1d29f0 msgr2=0x7fdfdc1d2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.657+0000 7fdfe2bff640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfdc1d29f0 0x7fdfdc1d2e70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000e7c0 tx=0x7fdfd000ec80 comp rx=0 tx=0).stop 2024-09-15T21:55:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.657+0000 7fdfe2bff640 1 -- 172.21.15.1:0/3745933236 shutdown_connections 2024-09-15T21:55:44.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.657+0000 7fdfe2bff640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fdfc80678c0 0x7fdfc8069d80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.657+0000 7fdfe2bff640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfdc13f850 0x7fdfdc13fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.657+0000 7fdfe2bff640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfdc1d29f0 0x7fdfdc1d2e70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.657+0000 7fdfe2bff640 1 --2- 172.21.15.1:0/3745933236 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfc40051d0 0x7fdfdc144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.657+0000 7fdfe2bff640 1 -- 172.21.15.1:0/3745933236 >> 172.21.15.1:0/3745933236 conn(0x7fdfdc0bd2f0 msgr2=0x7fdfdc0bba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:44.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.657+0000 7fdfe2bff640 1 -- 172.21.15.1:0/3745933236 shutdown_connections 2024-09-15T21:55:44.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.657+0000 7fdfe2bff640 1 -- 172.21.15.1:0/3745933236 wait complete. 2024-09-15T21:55:44.678 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T21:55:44.679 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:55:44.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.801+0000 7fd9e6aef640 1 Processor -- start 2024-09-15T21:55:44.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.801+0000 7fd9e6aef640 1 -- start start 2024-09-15T21:55:44.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.801+0000 7fd9e6aef640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd9e00ae3a0 0x7fd9e009eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.801+0000 7fd9e6aef640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9e00b00f0 con 0x7fd9e00b4c50 2024-09-15T21:55:44.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.801+0000 7fd9e6aef640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9e00b50e0 con 0x7fd9e00af160 2024-09-15T21:55:44.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.801+0000 7fd9e6aef640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fd9e00afe10 con 0x7fd9e00ae3a0 2024-09-15T21:55:44.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.801+0000 7fd9e488b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd9e00ae3a0 0x7fd9e009eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.801+0000 7fd9dffff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd9e00b4c50 0x7fd9e0147ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44152/0 (socket says 172.21.15.1:44152) 2024-09-15T21:55:44.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.801+0000 7fd9dffff640 1 -- 172.21.15.1:0/984340181 learned_addr learned my addr 172.21.15.1:0/984340181 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:44.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9e488b640 1 -- 172.21.15.1:0/984340181 >> v1:172.21.15.70:6789/0 conn(0x7fd9e00af160 legacy=0x7fd9e014eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9e488b640 1 -- 172.21.15.1:0/984340181 >> v1:172.21.15.1:6789/0 conn(0x7fd9e00b4c50 legacy=0x7fd9e0147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9df7fe640 1 -- 172.21.15.1:0/984340181 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2802263069 0 0) 0x7fd9e00b00f0 con 0x7fd9e00b4c50 2024-09-15T21:55:44.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9e488b640 1 -- 172.21.15.1:0/984340181 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e00b53c0 con 0x7fd9e00ae3a0 2024-09-15T21:55:44.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9e488b640 1 --2- 172.21.15.1:0/984340181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9e00ae3a0 0x7fd9e009eb50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000bfa0 tx=0x7fd9d001eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b411178ccf5fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:44.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9df7fe640 1 -- 172.21.15.1:0/984340181 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000b2d0 con 0x7fd9e00ae3a0 2024-09-15T21:55:44.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9df7fe640 1 -- 172.21.15.1:0/984340181 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d00a78a0 con 0x7fd9e00ae3a0 2024-09-15T21:55:44.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9df7fe640 1 -- 172.21.15.1:0/984340181 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d00a7c70 con 0x7fd9e00ae3a0 2024-09-15T21:55:44.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9e6aef640 1 -- 172.21.15.1:0/984340181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9e00ae3a0 msgr2=0x7fd9e009eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9e6aef640 1 --2- 172.21.15.1:0/984340181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9e00ae3a0 0x7fd9e009eb50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000bfa0 tx=0x7fd9d001eab0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9e6aef640 1 -- 172.21.15.1:0/984340181 shutdown_connections 2024-09-15T21:55:44.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9e6aef640 1 --2- 172.21.15.1:0/984340181 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9e00ae3a0 0x7fd9e009eb50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9e6aef640 1 -- 172.21.15.1:0/984340181 >> 172.21.15.1:0/984340181 conn(0x7fd9e00b5c40 msgr2=0x7fd9e00b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:44.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9e6aef640 1 -- 172.21.15.1:0/984340181 shutdown_connections 2024-09-15T21:55:44.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.805+0000 7fd9e6aef640 1 -- 172.21.15.1:0/984340181 wait complete. 2024-09-15T21:55:44.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e6aef640 1 Processor -- start 2024-09-15T21:55:44.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e6aef640 1 -- start start 2024-09-15T21:55:44.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e6aef640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9e00ae3a0 0x7fd9e01dfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e6aef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e00af160 0x7fd9e00b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e6aef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9e00b08d0 0x7fd9e00b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e6aef640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e00b46e0 con 0x7fd9e00b08d0 2024-09-15T21:55:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e6aef640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e00b4560 con 0x7fd9e00af160 2024-09-15T21:55:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e6aef640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd9e00b4860 con 0x7fd9e00ae3a0 2024-09-15T21:55:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e508c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9e00b08d0 0x7fd9e00b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e508c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9e00b08d0 0x7fd9e00b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43344/0 (socket says 172.21.15.1:43344) 2024-09-15T21:55:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e508c640 1 -- 172.21.15.1:0/2796804931 learned_addr learned my addr 172.21.15.1:0/2796804931 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e488b640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9e00ae3a0 0x7fd9e01dfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9dffff640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e00af160 0x7fd9e00b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e508c640 1 -- 172.21.15.1:0/2796804931 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9e00ae3a0 msgr2=0x7fd9e01dfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e508c640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9e00ae3a0 0x7fd9e01dfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e508c640 1 -- 172.21.15.1:0/2796804931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e00af160 msgr2=0x7fd9e00b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e508c640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e00af160 0x7fd9e00b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e508c640 1 -- 172.21.15.1:0/2796804931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e00b1280 con 0x7fd9e00b08d0 2024-09-15T21:55:44.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e508c640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9e00b08d0 0x7fd9e00b0d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800c430 tx=0x7fd9d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9dd7fa640 1 -- 172.21.15.1:0/2796804931 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8017070 con 0x7fd9e00b08d0 2024-09-15T21:55:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9dd7fa640 1 -- 172.21.15.1:0/2796804931 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9d80052d0 con 0x7fd9e00b08d0 2024-09-15T21:55:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e6aef640 1 -- 172.21.15.1:0/2796804931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e01e0180 con 0x7fd9e00b08d0 2024-09-15T21:55:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9dd7fa640 1 -- 172.21.15.1:0/2796804931 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8003800 con 0x7fd9e00b08d0 2024-09-15T21:55:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e6aef640 1 -- 172.21.15.1:0/2796804931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e00b2d80 con 0x7fd9e00b08d0 2024-09-15T21:55:44.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9e6aef640 1 -- 172.21.15.1:0/2796804931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e009eb50 con 0x7fd9e00b08d0 2024-09-15T21:55:44.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.809+0000 7fd9dd7fa640 1 -- 172.21.15.1:0/2796804931 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd9d801a070 con 0x7fd9e00b08d0 2024-09-15T21:55:44.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.813+0000 7fd9dd7fa640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd9cc0678c0 0x7fd9cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:44.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.813+0000 7fd9e488b640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd9cc0678c0 0x7fd9cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:44.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.813+0000 7fd9dd7fa640 1 -- 172.21.15.1:0/2796804931 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd9d8084ee0 con 0x7fd9e00b08d0 2024-09-15T21:55:44.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.813+0000 7fd9e488b640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd9cc0678c0 0x7fd9cc069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00b0000 tx=0x7fd9d00a9070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:44.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:44.817+0000 7fd9dd7fa640 1 -- 172.21.15.1:0/2796804931 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd9d8005480 con 0x7fd9e00b08d0 2024-09-15T21:55:45.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.009+0000 7fd9e6aef640 1 -- 172.21.15.1:0/2796804931 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9e0075af0 con 0x7fd9e00b08d0 2024-09-15T21:55:45.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.013+0000 7fd9dd7fa640 1 -- 172.21.15.1:0/2796804931 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3566 (secure 0 0 0) 0x7fd9d80553c0 con 0x7fd9e00b08d0 2024-09-15T21:55:45.016 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:45.016 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-09-15T21:55:24:061270+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/2650682187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2650682187},{"type":"v1","addr":"172.21.15.70:6833","nonce":2650682187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:20.400358+0000","modified":"2024-09-15T21:55:23.425841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3288963990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3288963990},{"type":"v1","addr":"172.21.15.1:6835","nonce":3288963990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4245,"qdb_cluster":[4245]},"id":1}]} 2024-09-15T21:55:45.016 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-09-15T21:55:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.013+0000 7fd9e6aef640 1 -- 172.21.15.1:0/2796804931 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd9cc0678c0 msgr2=0x7fd9cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.013+0000 7fd9e6aef640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd9cc0678c0 0x7fd9cc069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00b0000 tx=0x7fd9d00a9070 comp rx=0 tx=0).stop 2024-09-15T21:55:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.013+0000 7fd9e6aef640 1 -- 172.21.15.1:0/2796804931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9e00b08d0 msgr2=0x7fd9e00b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.013+0000 7fd9e6aef640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9e00b08d0 0x7fd9e00b0d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800c430 tx=0x7fd9d800c8f0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.013+0000 7fd9e6aef640 1 -- 172.21.15.1:0/2796804931 shutdown_connections 2024-09-15T21:55:45.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.013+0000 7fd9e6aef640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9e00b08d0 0x7fd9e00b0d40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.013+0000 7fd9e6aef640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd9cc0678c0 0x7fd9cc069d80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.013+0000 7fd9e6aef640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e00af160 0x7fd9e00b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.013+0000 7fd9e6aef640 1 --2- 172.21.15.1:0/2796804931 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd9e00ae3a0 0x7fd9e01dfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.013+0000 7fd9e6aef640 1 -- 172.21.15.1:0/2796804931 >> 172.21.15.1:0/2796804931 conn(0x7fd9e00b5c40 msgr2=0x7fd9e009dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:45.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.013+0000 7fd9e6aef640 1 -- 172.21.15.1:0/2796804931 shutdown_connections 2024-09-15T21:55:45.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.013+0000 7fd9e6aef640 1 -- 172.21.15.1:0/2796804931 wait complete. 2024-09-15T21:55:45.034 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.141+0000 7faf83a32640 1 Processor -- start 2024-09-15T21:55:45.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.141+0000 7faf83a32640 1 -- start start 2024-09-15T21:55:45.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.145+0000 7faf83a32640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faf7c1480c0 0x7faf7c1413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.145+0000 7faf83a32640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7faf7c148520 0x7faf7c1418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.145+0000 7faf83a32640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf7c0b6500 con 0x7faf7c0b6120 2024-09-15T21:55:45.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.145+0000 7faf83a32640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7faf7c14ba30 con 0x7faf7c148520 2024-09-15T21:55:45.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.145+0000 7faf83a32640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7faf7c14bc60 con 0x7faf7c1480c0 2024-09-15T21:55:45.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.145+0000 7faf80fcd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faf7c1480c0 0x7faf7c1413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.145+0000 7faf80fcd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faf7c1480c0 0x7faf7c1413b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:51522/0 (socket says 172.21.15.1:51522) 2024-09-15T21:55:45.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.145+0000 7faf80fcd640 1 -- 172.21.15.1:0/1213310993 learned_addr learned my addr 172.21.15.1:0/1213310993 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:45.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.145+0000 7faf81fcf640 1 --2- 172.21.15.1:0/1213310993 >> v2:172.21.15.70:3300/0 conn(0x7faf7c148520 0x7faf7c1418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.145+0000 7faf80fcd640 1 -- 172.21.15.1:0/1213310993 >> v2:172.21.15.70:3300/0 conn(0x7faf7c148520 msgr2=0x7faf7c1418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:45.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.145+0000 7faf80fcd640 1 --2- 172.21.15.1:0/1213310993 >> v2:172.21.15.70:3300/0 conn(0x7faf7c148520 0x7faf7c1418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.145+0000 7faf80fcd640 1 -- 172.21.15.1:0/1213310993 >> v1:172.21.15.70:6789/0 conn(0x7faf7c0b6120 legacy=0x7faf7c14b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.145+0000 7faf80fcd640 1 -- 172.21.15.1:0/1213310993 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7c147ba0 con 0x7faf7c1480c0 2024-09-15T21:55:45.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.149+0000 7faf80fcd640 1 --2- 172.21.15.1:0/1213310993 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faf7c1480c0 0x7faf7c1413b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009870 tx=0x7faf6c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0db5af1bef59717 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:45.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.149+0000 7faf73fff640 1 -- 172.21.15.1:0/1213310993 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0b0070 con 0x7faf7c1480c0 2024-09-15T21:55:45.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.149+0000 7faf73fff640 1 -- 172.21.15.1:0/1213310993 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf6c0ab600 con 0x7faf7c1480c0 2024-09-15T21:55:45.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.149+0000 7faf73fff640 1 -- 172.21.15.1:0/1213310993 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0ab9d0 con 0x7faf7c1480c0 2024-09-15T21:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.149+0000 7faf83a32640 1 -- 172.21.15.1:0/1213310993 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faf7c1480c0 msgr2=0x7faf7c1413b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.149+0000 7faf83a32640 1 --2- 172.21.15.1:0/1213310993 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faf7c1480c0 0x7faf7c1413b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009870 tx=0x7faf6c01c4d0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.149+0000 7faf83a32640 1 -- 172.21.15.1:0/1213310993 shutdown_connections 2024-09-15T21:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.149+0000 7faf83a32640 1 --2- 172.21.15.1:0/1213310993 >> v2:172.21.15.70:3300/0 conn(0x7faf7c148520 0x7faf7c1418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.149+0000 7faf83a32640 1 --2- 172.21.15.1:0/1213310993 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faf7c1480c0 0x7faf7c1413b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.149+0000 7faf83a32640 1 -- 172.21.15.1:0/1213310993 >> 172.21.15.1:0/1213310993 conn(0x7faf7c0bd2f0 msgr2=0x7faf7c0bd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:45.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.149+0000 7faf83a32640 1 -- 172.21.15.1:0/1213310993 shutdown_connections 2024-09-15T21:55:45.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.149+0000 7faf83a32640 1 -- 172.21.15.1:0/1213310993 wait complete. 2024-09-15T21:55:45.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf83a32640 1 Processor -- start 2024-09-15T21:55:45.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf83a32640 1 -- start start 2024-09-15T21:55:45.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf83a32640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faf7c0b6120 0x7faf7c1448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf83a32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf7c1480c0 0x7faf7c14e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf83a32640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf7c148520 0x7faf7c13e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf83a32640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c154b70 con 0x7faf7c148520 2024-09-15T21:55:45.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf83a32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c1549f0 con 0x7faf7c1480c0 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf83a32640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7faf7c154cf0 con 0x7faf7c0b6120 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf81fcf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf7c148520 0x7faf7c13e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf81fcf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf7c148520 0x7faf7c13e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43348/0 (socket says 172.21.15.1:43348) 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf81fcf640 1 -- 172.21.15.1:0/2073763800 learned_addr learned my addr 172.21.15.1:0/2073763800 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf817ce640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faf7c0b6120 0x7faf7c1448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf80fcd640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf7c1480c0 0x7faf7c14e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf81fcf640 1 -- 172.21.15.1:0/2073763800 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faf7c0b6120 msgr2=0x7faf7c1448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf81fcf640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faf7c0b6120 0x7faf7c1448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf81fcf640 1 -- 172.21.15.1:0/2073763800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf7c1480c0 msgr2=0x7faf7c14e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf81fcf640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf7c1480c0 0x7faf7c14e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf81fcf640 1 -- 172.21.15.1:0/2073763800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7c151980 con 0x7faf7c148520 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf817ce640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faf7c0b6120 0x7faf7c1448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf81fcf640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf7c148520 0x7faf7c13e8d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf7400efc0 tx=0x7faf7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:45.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf71ffb640 1 -- 172.21.15.1:0/2073763800 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74018020 con 0x7faf7c148520 2024-09-15T21:55:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf71ffb640 1 -- 172.21.15.1:0/2073763800 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf74014480 con 0x7faf7c148520 2024-09-15T21:55:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf71ffb640 1 -- 172.21.15.1:0/2073763800 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74009e60 con 0x7faf7c148520 2024-09-15T21:55:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf83a32640 1 -- 172.21.15.1:0/2073763800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7c150cd0 con 0x7faf7c148520 2024-09-15T21:55:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf83a32640 1 -- 172.21.15.1:0/2073763800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf7c151c30 con 0x7faf7c148520 2024-09-15T21:55:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf83a32640 1 -- 172.21.15.1:0/2073763800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf7c0691c0 con 0x7faf7c148520 2024-09-15T21:55:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.153+0000 7faf71ffb640 1 -- 172.21.15.1:0/2073763800 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf7401b020 con 0x7faf7c148520 2024-09-15T21:55:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.157+0000 7faf71ffb640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7faf600678c0 0x7faf60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.157+0000 7faf71ffb640 1 -- 172.21.15.1:0/2073763800 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faf740869e0 con 0x7faf7c148520 2024-09-15T21:55:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.157+0000 7faf817ce640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7faf600678c0 0x7faf60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.157+0000 7faf817ce640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7faf600678c0 0x7faf60069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf7c1e4f50 tx=0x7faf78009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:45.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.161+0000 7faf71ffb640 1 -- 172.21.15.1:0/2073763800 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faf74022030 con 0x7faf7c148520 2024-09-15T21:55:45.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf83a32640 1 -- 172.21.15.1:0/2073763800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf7c075a50 con 0x7faf7c148520 2024-09-15T21:55:45.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf71ffb640 1 -- 172.21.15.1:0/2073763800 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3566 (secure 0 0 0) 0x7faf74010040 con 0x7faf7c148520 2024-09-15T21:55:45.357 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:45.357 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-09-15T21:55:24:061270+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/2650682187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":2650682187},{"type":"v1","addr":"172.21.15.70:6833","nonce":2650682187}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:20.400358+0000","modified":"2024-09-15T21:55:23.425841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3288963990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3288963990},{"type":"v1","addr":"172.21.15.1:6835","nonce":3288963990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4245,"qdb_cluster":[4245]},"id":1}]} 2024-09-15T21:55:45.358 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-09-15T21:55:45.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf83a32640 1 -- 172.21.15.1:0/2073763800 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7faf600678c0 msgr2=0x7faf60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf83a32640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7faf600678c0 0x7faf60069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf7c1e4f50 tx=0x7faf78009040 comp rx=0 tx=0).stop 2024-09-15T21:55:45.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf83a32640 1 -- 172.21.15.1:0/2073763800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf7c148520 msgr2=0x7faf7c13e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf83a32640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf7c148520 0x7faf7c13e8d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf7400efc0 tx=0x7faf7400c490 comp rx=0 tx=0).stop 2024-09-15T21:55:45.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf83a32640 1 -- 172.21.15.1:0/2073763800 shutdown_connections 2024-09-15T21:55:45.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf83a32640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf7c148520 0x7faf7c13e8d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf83a32640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7faf600678c0 0x7faf60069d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf83a32640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf7c1480c0 0x7faf7c14e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf83a32640 1 --2- 172.21.15.1:0/2073763800 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faf7c0b6120 0x7faf7c1448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf83a32640 1 -- 172.21.15.1:0/2073763800 >> 172.21.15.1:0/2073763800 conn(0x7faf7c0bd2f0 msgr2=0x7faf7c0bb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:45.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf83a32640 1 -- 172.21.15.1:0/2073763800 shutdown_connections 2024-09-15T21:55:45.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.353+0000 7faf83a32640 1 -- 172.21.15.1:0/2073763800 wait complete. 2024-09-15T21:55:45.375 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:45.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.481+0000 7f04a37ba640 1 Processor -- start 2024-09-15T21:55:45.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.481+0000 7f04a37ba640 1 -- start start 2024-09-15T21:55:45.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a37ba640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f049c1480c0 0x7f049c1413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a37ba640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f049c0b6500 con 0x7f049c0b6120 2024-09-15T21:55:45.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a37ba640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f049c14bc60 con 0x7f049c148520 2024-09-15T21:55:45.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a37ba640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f049c14ba30 con 0x7f049c1480c0 2024-09-15T21:55:45.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a0d55640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f049c1480c0 0x7f049c1413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a1556640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f049c0b6120 0x7f049c14b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44154/0 (socket says 172.21.15.1:44154) 2024-09-15T21:55:45.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a1556640 1 -- 172.21.15.1:0/3829861418 learned_addr learned my addr 172.21.15.1:0/3829861418 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:45.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a0d55640 1 -- 172.21.15.1:0/3829861418 >> v1:172.21.15.70:6789/0 conn(0x7f049c148520 legacy=0x7f049c1521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:45.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a0d55640 1 -- 172.21.15.1:0/3829861418 >> v1:172.21.15.1:6789/0 conn(0x7f049c0b6120 legacy=0x7f049c14b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a0d55640 1 -- 172.21.15.1:0/3829861418 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c147ba0 con 0x7f049c1480c0 2024-09-15T21:55:45.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f0493fff640 1 -- 172.21.15.1:0/3829861418 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1727503812 0 0) 0x7f049c0b6500 con 0x7f049c0b6120 2024-09-15T21:55:45.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a0d55640 1 --2- 172.21.15.1:0/3829861418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f049c1480c0 0x7f049c1413b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f048c0097c0 tx=0x7f048c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a2bcacb19a2b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:45.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f0493fff640 1 -- 172.21.15.1:0/3829861418 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c0b0070 con 0x7f049c1480c0 2024-09-15T21:55:45.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f0493fff640 1 -- 172.21.15.1:0/3829861418 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c0ab600 con 0x7f049c1480c0 2024-09-15T21:55:45.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f0493fff640 1 -- 172.21.15.1:0/3829861418 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c0a4e60 con 0x7f049c1480c0 2024-09-15T21:55:45.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a37ba640 1 -- 172.21.15.1:0/3829861418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f049c1480c0 msgr2=0x7f049c1413b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a37ba640 1 --2- 172.21.15.1:0/3829861418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f049c1480c0 0x7f049c1413b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f048c0097c0 tx=0x7f048c01c3d0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a37ba640 1 -- 172.21.15.1:0/3829861418 shutdown_connections 2024-09-15T21:55:45.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a37ba640 1 --2- 172.21.15.1:0/3829861418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f049c1480c0 0x7f049c1413b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a37ba640 1 -- 172.21.15.1:0/3829861418 >> 172.21.15.1:0/3829861418 conn(0x7f049c0bd2f0 msgr2=0x7f049c0bd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:45.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a37ba640 1 -- 172.21.15.1:0/3829861418 shutdown_connections 2024-09-15T21:55:45.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.485+0000 7f04a37ba640 1 -- 172.21.15.1:0/3829861418 wait complete. 2024-09-15T21:55:45.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a37ba640 1 Processor -- start 2024-09-15T21:55:45.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a37ba640 1 -- start start 2024-09-15T21:55:45.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a37ba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f049c0b6120 0x7f049c14f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a37ba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f049c1480c0 0x7f049c151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a37ba640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f049c148520 0x7f049c151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a37ba640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f049c156520 con 0x7f049c1480c0 2024-09-15T21:55:45.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a37ba640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f049c0b7c70 con 0x7f049c0b6120 2024-09-15T21:55:45.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a37ba640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f049c1566a0 con 0x7f049c148520 2024-09-15T21:55:45.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a0d55640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f049c1480c0 0x7f049c151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a0d55640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f049c1480c0 0x7f049c151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43378/0 (socket says 172.21.15.1:43378) 2024-09-15T21:55:45.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a0d55640 1 -- 172.21.15.1:0/807748057 learned_addr learned my addr 172.21.15.1:0/807748057 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:45.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a1556640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f049c0b6120 0x7f049c14f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a0d55640 1 -- 172.21.15.1:0/807748057 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f049c148520 msgr2=0x7f049c151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a0d55640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f049c148520 0x7f049c151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a0d55640 1 -- 172.21.15.1:0/807748057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f049c0b6120 msgr2=0x7f049c14f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a0d55640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f049c0b6120 0x7f049c14f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a0d55640 1 -- 172.21.15.1:0/807748057 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c150890 con 0x7f049c1480c0 2024-09-15T21:55:45.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a1556640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f049c0b6120 0x7f049c14f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:45.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a0d55640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f049c1480c0 0x7f049c151550 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f048c0097c0 tx=0x7f048c01ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:45.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f0491ffb640 1 -- 172.21.15.1:0/807748057 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c0b0040 con 0x7f049c1480c0 2024-09-15T21:55:45.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f0491ffb640 1 -- 172.21.15.1:0/807748057 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c0a4e60 con 0x7f049c1480c0 2024-09-15T21:55:45.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a37ba640 1 -- 172.21.15.1:0/807748057 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049c14e370 con 0x7f049c1480c0 2024-09-15T21:55:45.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f0491ffb640 1 -- 172.21.15.1:0/807748057 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c004260 con 0x7f049c1480c0 2024-09-15T21:55:45.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a37ba640 1 -- 172.21.15.1:0/807748057 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049c14e610 con 0x7f049c1480c0 2024-09-15T21:55:45.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f04a37ba640 1 -- 172.21.15.1:0/807748057 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f049c1413b0 con 0x7f049c1480c0 2024-09-15T21:55:45.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f0491ffb640 1 -- 172.21.15.1:0/807748057 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f048c0bf060 con 0x7f049c1480c0 2024-09-15T21:55:45.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.489+0000 7f0491ffb640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f04800678c0 0x7f0480069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.493+0000 7f0491ffb640 1 -- 172.21.15.1:0/807748057 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f048c11f7b0 con 0x7f049c1480c0 2024-09-15T21:55:45.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.493+0000 7f04a1556640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f04800678c0 0x7f0480069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.493+0000 7f04a1556640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f04800678c0 0x7f0480069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0498000f70 tx=0x7f0498009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:45.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.497+0000 7f0491ffb640 1 -- 172.21.15.1:0/807748057 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f048c016050 con 0x7f049c1480c0 2024-09-15T21:55:45.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.657+0000 7f04a37ba640 1 -- 172.21.15.1:0/807748057 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f049c0691c0 con 0x7f049c1480c0 2024-09-15T21:55:45.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.661+0000 7f0491ffb640 1 -- 172.21.15.1:0/807748057 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16593 (secure 0 0 0) 0x7f048c0b4370 con 0x7f049c1480c0 2024-09-15T21:55:45.665 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:45.665 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:22.028149+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:18.271646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:19.444906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:45.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.661+0000 7f04a37ba640 1 -- 172.21.15.1:0/807748057 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f04800678c0 msgr2=0x7f0480069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.661+0000 7f04a37ba640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f04800678c0 0x7f0480069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0498000f70 tx=0x7f0498009040 comp rx=0 tx=0).stop 2024-09-15T21:55:45.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.661+0000 7f04a37ba640 1 -- 172.21.15.1:0/807748057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f049c1480c0 msgr2=0x7f049c151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.661+0000 7f04a37ba640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f049c1480c0 0x7f049c151550 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f048c0097c0 tx=0x7f048c01ac10 comp rx=0 tx=0).stop 2024-09-15T21:55:45.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.661+0000 7f04a37ba640 1 -- 172.21.15.1:0/807748057 shutdown_connections 2024-09-15T21:55:45.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.661+0000 7f04a37ba640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f049c148520 0x7f049c151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.661+0000 7f04a37ba640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f049c1480c0 0x7f049c151550 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.661+0000 7f04a37ba640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f04800678c0 0x7f0480069d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.661+0000 7f04a37ba640 1 --2- 172.21.15.1:0/807748057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f049c0b6120 0x7f049c14f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.661+0000 7f04a37ba640 1 -- 172.21.15.1:0/807748057 >> 172.21.15.1:0/807748057 conn(0x7f049c0bd2f0 msgr2=0x7f049c0bb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:45.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.661+0000 7f04a37ba640 1 -- 172.21.15.1:0/807748057 shutdown_connections 2024-09-15T21:55:45.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.661+0000 7f04a37ba640 1 -- 172.21.15.1:0/807748057 wait complete. 2024-09-15T21:55:45.685 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T21:55:45.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81fd56a640 1 Processor -- start 2024-09-15T21:55:45.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81fd56a640 1 -- start start 2024-09-15T21:55:45.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81fd56a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f81f80738b0 0x7f81f8148c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81fd56a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f81f80b5160 0x7f81f8149180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81fd56a640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f80b2690 con 0x7f81f80b2160 2024-09-15T21:55:45.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81fd56a640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f81f80b2970 con 0x7f81f80b5160 2024-09-15T21:55:45.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81fd56a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f81f80b5640 con 0x7f81f80738b0 2024-09-15T21:55:45.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81f77fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f81f80b5160 0x7f81f8149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81f67fc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f81f80b2160 0x7f81f813f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:44164/0 (socket says 172.21.15.1:44164) 2024-09-15T21:55:45.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81f67fc640 1 -- 172.21.15.1:0/3300638525 learned_addr learned my addr 172.21.15.1:0/3300638525 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:45.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81f6ffd640 1 --2- 172.21.15.1:0/3300638525 >> v2:172.21.15.70:3300/0 conn(0x7f81f80738b0 0x7f81f8148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81f77fe640 1 -- 172.21.15.1:0/3300638525 >> v2:172.21.15.70:3300/0 conn(0x7f81f80738b0 msgr2=0x7f81f8148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81f77fe640 1 --2- 172.21.15.1:0/3300638525 >> v2:172.21.15.70:3300/0 conn(0x7f81f80738b0 0x7f81f8148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81f77fe640 1 -- 172.21.15.1:0/3300638525 >> v1:172.21.15.1:6789/0 conn(0x7f81f80b2160 legacy=0x7f81f813f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.809+0000 7f81f77fe640 1 -- 172.21.15.1:0/3300638525 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f80b5920 con 0x7f81f80b5160 2024-09-15T21:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f77fe640 1 --2- 172.21.15.1:0/3300638525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f80b5160 0x7f81f8149180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f81f80ba2a0 tx=0x7f81f001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a1ba610123858 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f5ffb640 1 -- 172.21.15.1:0/3300638525 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f00b1070 con 0x7f81f80b5160 2024-09-15T21:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f5ffb640 1 -- 172.21.15.1:0/3300638525 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f00a8050 con 0x7f81f80b5160 2024-09-15T21:55:45.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f5ffb640 1 -- 172.21.15.1:0/3300638525 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f00ac860 con 0x7f81f80b5160 2024-09-15T21:55:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 -- 172.21.15.1:0/3300638525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f80b5160 msgr2=0x7f81f8149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 --2- 172.21.15.1:0/3300638525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f80b5160 0x7f81f8149180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f81f80ba2a0 tx=0x7f81f001c3c0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 -- 172.21.15.1:0/3300638525 shutdown_connections 2024-09-15T21:55:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 --2- 172.21.15.1:0/3300638525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f80b5160 0x7f81f8149180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 --2- 172.21.15.1:0/3300638525 >> v2:172.21.15.70:3300/0 conn(0x7f81f80738b0 0x7f81f8148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 -- 172.21.15.1:0/3300638525 >> 172.21.15.1:0/3300638525 conn(0x7f81f80ba370 msgr2=0x7f81f80ba780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 -- 172.21.15.1:0/3300638525 shutdown_connections 2024-09-15T21:55:45.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 -- 172.21.15.1:0/3300638525 wait complete. 2024-09-15T21:55:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 Processor -- start 2024-09-15T21:55:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 -- start start 2024-09-15T21:55:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81f80738b0 0x7f81f813be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f80b2160 0x7f81f81e17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81f80b5160 0x7f81f814f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8152b80 con 0x7f81f80b2160 2024-09-15T21:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8152a00 con 0x7f81f80738b0 2024-09-15T21:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f81f8152d00 con 0x7f81f80b5160 2024-09-15T21:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f80b2160 0x7f81f81e17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f80b2160 0x7f81f81e17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43390/0 (socket says 172.21.15.1:43390) 2024-09-15T21:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f67fc640 1 -- 172.21.15.1:0/2286426642 learned_addr learned my addr 172.21.15.1:0/2286426642 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f6ffd640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81f80738b0 0x7f81f813be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f67fc640 1 -- 172.21.15.1:0/2286426642 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81f80b5160 msgr2=0x7f81f814f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f67fc640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81f80b5160 0x7f81f814f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f67fc640 1 -- 172.21.15.1:0/2286426642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81f80738b0 msgr2=0x7f81f813be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f67fc640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81f80738b0 0x7f81f813be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:45.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f67fc640 1 -- 172.21.15.1:0/2286426642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f813e090 con 0x7f81f80b2160 2024-09-15T21:55:45.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f6ffd640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81f80738b0 0x7f81f813be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:45.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81f67fc640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f80b2160 0x7f81f81e17c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00c450 tx=0x7f81ec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:45.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81df7fe640 1 -- 172.21.15.1:0/2286426642 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec017070 con 0x7f81f80b2160 2024-09-15T21:55:45.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81df7fe640 1 -- 172.21.15.1:0/2286426642 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec005cf0 con 0x7f81f80b2160 2024-09-15T21:55:45.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 -- 172.21.15.1:0/2286426642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f8142c30 con 0x7f81f80b2160 2024-09-15T21:55:45.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81df7fe640 1 -- 172.21.15.1:0/2286426642 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec007290 con 0x7f81f80b2160 2024-09-15T21:55:45.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.813+0000 7f81fd56a640 1 -- 172.21.15.1:0/2286426642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f813ade0 con 0x7f81f80b2160 2024-09-15T21:55:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.817+0000 7f81fd56a640 1 -- 172.21.15.1:0/2286426642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f813f350 con 0x7f81f80b2160 2024-09-15T21:55:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.817+0000 7f81df7fe640 1 -- 172.21.15.1:0/2286426642 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f81ec01a070 con 0x7f81f80b2160 2024-09-15T21:55:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.817+0000 7f81df7fe640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f81e40678c0 0x7f81e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.817+0000 7f81df7fe640 1 -- 172.21.15.1:0/2286426642 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f81ec084f70 con 0x7f81f80b2160 2024-09-15T21:55:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.817+0000 7f81f6ffd640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f81e40678c0 0x7f81e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:45.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.817+0000 7f81f6ffd640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f81e40678c0 0x7f81e4069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f81f81df380 tx=0x7f81e800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:45.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:45.821+0000 7f81df7fe640 1 -- 172.21.15.1:0/2286426642 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f81ec055b40 con 0x7f81f80b2160 2024-09-15T21:55:46.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.013+0000 7f81fd56a640 1 -- 172.21.15.1:0/2286426642 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f81f814fdb0 con 0x7f81f80b2160 2024-09-15T21:55:46.017 INFO:tasks.ceph.mon.a.smithi001.stderr:2024-09-15T21:55:46.013+0000 7fe8b5b94640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T21:55:46.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.017+0000 7f81df7fe640 1 -- 172.21.15.1:0/2286426642 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f81ec055440 con 0x7f81f80b2160 2024-09-15T21:55:46.020 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T21:55:46.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.017+0000 7f81fd56a640 1 -- 172.21.15.1:0/2286426642 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f81e40678c0 msgr2=0x7f81e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:46.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.017+0000 7f81fd56a640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f81e40678c0 0x7f81e4069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f81f81df380 tx=0x7f81e800b040 comp rx=0 tx=0).stop 2024-09-15T21:55:46.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.017+0000 7f81fd56a640 1 -- 172.21.15.1:0/2286426642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f80b2160 msgr2=0x7f81f81e17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:46.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.017+0000 7f81fd56a640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f80b2160 0x7f81f81e17c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00c450 tx=0x7f81ec00c910 comp rx=0 tx=0).stop 2024-09-15T21:55:46.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.017+0000 7f81fd56a640 1 -- 172.21.15.1:0/2286426642 shutdown_connections 2024-09-15T21:55:46.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.017+0000 7f81fd56a640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81f80b5160 0x7f81f814f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:46.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.017+0000 7f81fd56a640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f80b2160 0x7f81f81e17c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:46.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.017+0000 7f81fd56a640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f81e40678c0 0x7f81e4069d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:46.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.017+0000 7f81fd56a640 1 --2- 172.21.15.1:0/2286426642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81f80738b0 0x7f81f813be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:46.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.017+0000 7f81fd56a640 1 -- 172.21.15.1:0/2286426642 >> 172.21.15.1:0/2286426642 conn(0x7f81f80ba370 msgr2=0x7f81f80b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:46.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.017+0000 7f81fd56a640 1 -- 172.21.15.1:0/2286426642 shutdown_connections 2024-09-15T21:55:46.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.021+0000 7f81fd56a640 1 -- 172.21.15.1:0/2286426642 wait complete. 2024-09-15T21:55:46.027 INFO:tasks.ceph.mds.a.smithi001.stderr: -940> 2024-09-15T21:55:24.989+0000 7f1a11406640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T21:55:46.039 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T21:55:46.057 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2024-09-15T21:55:46.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.165+0000 7f0559720640 1 Processor -- start 2024-09-15T21:55:46.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.165+0000 7f0559720640 1 -- start start 2024-09-15T21:55:46.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.165+0000 7f0559720640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f05540b4560 0x7f05540b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:46.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.165+0000 7f0559720640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f055406d0d0 0x7f055409ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:46.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.165+0000 7f0559720640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055406d5b0 con 0x7f055409e410 2024-09-15T21:55:46.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.165+0000 7f0559720640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f055406dc00 con 0x7f05540b4560 2024-09-15T21:55:46.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.165+0000 7f0559720640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f05540b9e50 con 0x7f055406d0d0 2024-09-15T21:55:46.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.169+0000 7f0552ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f05540b4560 0x7f05540b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:46.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.169+0000 7f05527fc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f055406d0d0 0x7f055409ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:46.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.169+0000 7f0552ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f05540b4560 0x7f05540b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:32896/0 (socket says 172.21.15.1:32896) 2024-09-15T21:55:46.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.169+0000 7f0552ffd640 1 -- 172.21.15.1:0/2220111940 learned_addr learned my addr 172.21.15.1:0/2220111940 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.169+0000 7f0552ffd640 1 -- 172.21.15.1:0/2220111940 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f055406d0d0 msgr2=0x7f055409ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.169+0000 7f0552ffd640 1 --2- 172.21.15.1:0/2220111940 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f055406d0d0 0x7f055409ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.169+0000 7f0552ffd640 1 -- 172.21.15.1:0/2220111940 >> v1:172.21.15.70:6789/0 conn(0x7f055409e410 legacy=0x7f0554148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.169+0000 7f0552ffd640 1 -- 172.21.15.1:0/2220111940 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055406d890 con 0x7f05540b4560 2024-09-15T21:55:46.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.169+0000 7f0552ffd640 1 --2- 172.21.15.1:0/2220111940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05540b4560 0x7f05540b4940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f053c009870 tx=0x7f053c01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62e5597a7316f8f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:46.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.169+0000 7f0551ffb640 1 -- 172.21.15.1:0/2220111940 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0b0070 con 0x7f05540b4560 2024-09-15T21:55:46.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.169+0000 7f0551ffb640 1 -- 172.21.15.1:0/2220111940 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053c0ab600 con 0x7f05540b4560 2024-09-15T21:55:46.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.169+0000 7f0551ffb640 1 -- 172.21.15.1:0/2220111940 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0ab9d0 con 0x7f05540b4560 2024-09-15T21:55:46.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 -- 172.21.15.1:0/2220111940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05540b4560 msgr2=0x7f05540b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:46.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 --2- 172.21.15.1:0/2220111940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05540b4560 0x7f05540b4940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f053c009870 tx=0x7f053c01c4d0 comp rx=0 tx=0).stop 2024-09-15T21:55:46.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 -- 172.21.15.1:0/2220111940 shutdown_connections 2024-09-15T21:55:46.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 --2- 172.21.15.1:0/2220111940 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f055406d0d0 0x7f055409ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:46.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 --2- 172.21.15.1:0/2220111940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05540b4560 0x7f05540b4940 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:46.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 -- 172.21.15.1:0/2220111940 >> 172.21.15.1:0/2220111940 conn(0x7f055406c730 msgr2=0x7f05540b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:46.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 -- 172.21.15.1:0/2220111940 shutdown_connections 2024-09-15T21:55:46.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 -- 172.21.15.1:0/2220111940 wait complete. 2024-09-15T21:55:46.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 Processor -- start 2024-09-15T21:55:46.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 -- start start 2024-09-15T21:55:46.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f055406d0d0 0x7f05540729c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:46.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f055409e410 0x7f05541400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:46.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05540b4560 0x7f055413f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:46.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0554152b20 con 0x7f05540b4560 2024-09-15T21:55:46.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f05541529a0 con 0x7f055406d0d0 2024-09-15T21:55:46.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0554152ca0 con 0x7f055409e410 2024-09-15T21:55:46.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f05537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05540b4560 0x7f055413f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:46.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f05537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05540b4560 0x7f055413f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43426/0 (socket says 172.21.15.1:43426) 2024-09-15T21:55:46.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f05537fe640 1 -- 172.21.15.1:0/3099899144 learned_addr learned my addr 172.21.15.1:0/3099899144 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:46.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0552ffd640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f055406d0d0 0x7f05540729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:46.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f05527fc640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f055409e410 0x7f05541400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:46.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f05537fe640 1 -- 172.21.15.1:0/3099899144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f055409e410 msgr2=0x7f05541400b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:46.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f05537fe640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f055409e410 0x7f05541400b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:46.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f05537fe640 1 -- 172.21.15.1:0/3099899144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f055406d0d0 msgr2=0x7f05540729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:46.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f05537fe640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f055406d0d0 0x7f05540729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:46.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f05537fe640 1 -- 172.21.15.1:0/3099899144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05541481c0 con 0x7f05540b4560 2024-09-15T21:55:46.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f05527fc640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f055409e410 0x7f05541400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:46.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f05537fe640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05540b4560 0x7f055413f1e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f054c00c710 tx=0x7f054c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:46.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f054b7fe640 1 -- 172.21.15.1:0/3099899144 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c016020 con 0x7f05540b4560 2024-09-15T21:55:46.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f054b7fe640 1 -- 172.21.15.1:0/3099899144 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054c006d60 con 0x7f05540b4560 2024-09-15T21:55:46.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f054b7fe640 1 -- 172.21.15.1:0/3099899144 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c003bc0 con 0x7f05540b4560 2024-09-15T21:55:46.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 -- 172.21.15.1:0/3099899144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05540b62f0 con 0x7f05540b4560 2024-09-15T21:55:46.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.173+0000 7f0559720640 1 -- 172.21.15.1:0/3099899144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0554141de0 con 0x7f05540b4560 2024-09-15T21:55:46.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.177+0000 7f0559720640 1 -- 172.21.15.1:0/3099899144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f055409ded0 con 0x7f05540b4560 2024-09-15T21:55:46.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.177+0000 7f054b7fe640 1 -- 172.21.15.1:0/3099899144 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f054c00a850 con 0x7f05540b4560 2024-09-15T21:55:46.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.177+0000 7f054b7fe640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f05340678f0 0x7f0534069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:46.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.177+0000 7f054b7fe640 1 -- 172.21.15.1:0/3099899144 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f054c085920 con 0x7f05540b4560 2024-09-15T21:55:46.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.177+0000 7f0552ffd640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f05340678f0 0x7f0534069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:46.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.177+0000 7f0552ffd640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f05340678f0 0x7f0534069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f053c0ad000 tx=0x7f053c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:46.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.181+0000 7f054b7fe640 1 -- 172.21.15.1:0/3099899144 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f054c020020 con 0x7f05540b4560 2024-09-15T21:55:46.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:46.385+0000 7f0559720640 1 -- 172.21.15.1:0/3099899144 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0554148430 con 0x7f05540b4560 2024-09-15T21:55:47.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.017+0000 7f054b7fe640 1 -- 172.21.15.1:0/3099899144 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f054c0563f0 con 0x7f05540b4560 2024-09-15T21:55:47.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.021+0000 7f0559720640 1 -- 172.21.15.1:0/3099899144 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f05340678f0 msgr2=0x7f0534069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:47.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.021+0000 7f0559720640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f05340678f0 0x7f0534069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f053c0ad000 tx=0x7f053c008040 comp rx=0 tx=0).stop 2024-09-15T21:55:47.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.021+0000 7f0559720640 1 -- 172.21.15.1:0/3099899144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05540b4560 msgr2=0x7f055413f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:47.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.021+0000 7f0559720640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05540b4560 0x7f055413f1e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f054c00c710 tx=0x7f054c00cbd0 comp rx=0 tx=0).stop 2024-09-15T21:55:47.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.021+0000 7f0559720640 1 -- 172.21.15.1:0/3099899144 shutdown_connections 2024-09-15T21:55:47.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.021+0000 7f0559720640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05540b4560 0x7f055413f1e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:47.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.021+0000 7f0559720640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f055409e410 0x7f05541400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:47.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.021+0000 7f0559720640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f05340678f0 0x7f0534069db0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:47.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.021+0000 7f0559720640 1 --2- 172.21.15.1:0/3099899144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f055406d0d0 0x7f05540729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:47.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.021+0000 7f0559720640 1 -- 172.21.15.1:0/3099899144 >> 172.21.15.1:0/3099899144 conn(0x7f055406c730 msgr2=0x7f0554146830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:47.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.021+0000 7f0559720640 1 -- 172.21.15.1:0/3099899144 shutdown_connections 2024-09-15T21:55:47.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.021+0000 7f0559720640 1 -- 172.21.15.1:0/3099899144 wait complete. 2024-09-15T21:55:47.047 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T21:55:47.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.221+0000 7f82d0f70640 1 Processor -- start 2024-09-15T21:55:47.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.221+0000 7f82d0f70640 1 -- start start 2024-09-15T21:55:47.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.221+0000 7f82d0f70640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f82cc0b9710 0x7f82cc0bb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:47.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.221+0000 7f82d0f70640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82cc147fe0 0x7f82cc1483f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:47.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.221+0000 7f82d0f70640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82cc06db80 con 0x7f82cc0bc1a0 2024-09-15T21:55:47.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.221+0000 7f82d0f70640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f82cc0bb650 con 0x7f82cc0b9710 2024-09-15T21:55:47.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.221+0000 7f82d0f70640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f82cc145300 con 0x7f82cc147fe0 2024-09-15T21:55:47.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.221+0000 7f82cad9d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82cc147fe0 0x7f82cc1483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:47.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.221+0000 7f82c9d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f82cc0b9710 0x7f82cc0bb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:47.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.221+0000 7f82cad9d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82cc147fe0 0x7f82cc1483f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:33134/0 (socket says 172.21.15.1:33134) 2024-09-15T21:55:47.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.221+0000 7f82c9d9b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f82cc0b9710 0x7f82cc0bb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:49756/0 (socket says 172.21.15.1:49756) 2024-09-15T21:55:47.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.221+0000 7f82cad9d640 1 -- 172.21.15.1:0/418826891 learned_addr learned my addr 172.21.15.1:0/418826891 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:47.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.221+0000 7f82ca59c640 1 --1- 172.21.15.1:0/418826891 >> v1:172.21.15.70:6789/0 conn(0x7f82cc0bc1a0 0x7f82cc06d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.1:47382/0 (socket says 172.21.15.1:47382) 2024-09-15T21:55:47.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82c9d9b640 1 -- 172.21.15.1:0/418826891 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82cc147fe0 msgr2=0x7f82cc1483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:47.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82c9d9b640 1 --2- 172.21.15.1:0/418826891 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82cc147fe0 0x7f82cc1483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:47.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82c9d9b640 1 -- 172.21.15.1:0/418826891 >> v1:172.21.15.70:6789/0 conn(0x7f82cc0bc1a0 legacy=0x7f82cc06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:47.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82c9d9b640 1 -- 172.21.15.1:0/418826891 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82cc0bc580 con 0x7f82cc0b9710 2024-09-15T21:55:47.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82cad9d640 1 --2- 172.21.15.1:0/418826891 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82cc147fe0 0x7f82cc1483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:55:47.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82c9d9b640 1 --2- 172.21.15.1:0/418826891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82cc0b9710 0x7f82cc0bb110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f82c00097c0 tx=0x7f82c001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10498c575813aa27 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:47.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82c959a640 1 -- 172.21.15.1:0/418826891 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c00b2070 con 0x7f82cc0b9710 2024-09-15T21:55:47.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82c959a640 1 -- 172.21.15.1:0/418826891 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c00ad640 con 0x7f82cc0b9710 2024-09-15T21:55:47.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82c959a640 1 -- 172.21.15.1:0/418826891 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c00ada10 con 0x7f82cc0b9710 2024-09-15T21:55:47.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82d0f70640 1 -- 172.21.15.1:0/418826891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82cc0b9710 msgr2=0x7f82cc0bb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:47.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82d0f70640 1 --2- 172.21.15.1:0/418826891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82cc0b9710 0x7f82cc0bb110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f82c00097c0 tx=0x7f82c001c4a0 comp rx=0 tx=0).stop 2024-09-15T21:55:47.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82d0f70640 1 -- 172.21.15.1:0/418826891 shutdown_connections 2024-09-15T21:55:47.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82d0f70640 1 --2- 172.21.15.1:0/418826891 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82cc147fe0 0x7f82cc1483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:47.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82d0f70640 1 --2- 172.21.15.1:0/418826891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82cc0b9710 0x7f82cc0bb110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:47.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.225+0000 7f82d0f70640 1 -- 172.21.15.1:0/418826891 >> 172.21.15.1:0/418826891 conn(0x7f82cc0b9df0 msgr2=0x7f82cc0ba200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:47.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82d0f70640 1 -- 172.21.15.1:0/418826891 shutdown_connections 2024-09-15T21:55:47.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82d0f70640 1 -- 172.21.15.1:0/418826891 wait complete. 2024-09-15T21:55:47.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82d0f70640 1 Processor -- start 2024-09-15T21:55:47.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82d0f70640 1 -- start start 2024-09-15T21:55:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82d0f70640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc0b9710 0x7f82cc09b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82d0f70640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82cc0bc1a0 0x7f82cc09c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82d0f70640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82cc147fe0 0x7f82cc1e35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82d0f70640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc1479d0 con 0x7f82cc0b9710 2024-09-15T21:55:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82d0f70640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc147850 con 0x7f82cc147fe0 2024-09-15T21:55:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82d0f70640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f82cc154990 con 0x7f82cc0bc1a0 2024-09-15T21:55:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82ca59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc0b9710 0x7f82cc09b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82ca59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc0b9710 0x7f82cc09b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35648/0 (socket says 172.21.15.1:35648) 2024-09-15T21:55:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82ca59c640 1 -- 172.21.15.1:0/2496221555 learned_addr learned my addr 172.21.15.1:0/2496221555 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82c9d9b640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82cc0bc1a0 0x7f82cc09c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82cad9d640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82cc147fe0 0x7f82cc1e35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82ca59c640 1 -- 172.21.15.1:0/2496221555 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82cc0bc1a0 msgr2=0x7f82cc09c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82ca59c640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82cc0bc1a0 0x7f82cc09c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:47.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82ca59c640 1 -- 172.21.15.1:0/2496221555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82cc147fe0 msgr2=0x7f82cc1e35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:47.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82ca59c640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82cc147fe0 0x7f82cc1e35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:47.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82ca59c640 1 -- 172.21.15.1:0/2496221555 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82cc09d310 con 0x7f82cc0b9710 2024-09-15T21:55:47.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82ca59c640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc0b9710 0x7f82cc09b800 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00c420 tx=0x7f82bc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:47.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82baffd640 1 -- 172.21.15.1:0/2496221555 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0074e0 con 0x7f82cc0b9710 2024-09-15T21:55:47.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82baffd640 1 -- 172.21.15.1:0/2496221555 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82bc007680 con 0x7f82cc0b9710 2024-09-15T21:55:47.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82baffd640 1 -- 172.21.15.1:0/2496221555 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc004a30 con 0x7f82cc0b9710 2024-09-15T21:55:47.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82d0f70640 1 -- 172.21.15.1:0/2496221555 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82cc09cb10 con 0x7f82cc0b9710 2024-09-15T21:55:47.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82d0f70640 1 -- 172.21.15.1:0/2496221555 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82cc09c830 con 0x7f82cc0b9710 2024-09-15T21:55:47.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.229+0000 7f82d0f70640 1 -- 172.21.15.1:0/2496221555 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82cc0bb110 con 0x7f82cc0b9710 2024-09-15T21:55:47.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.233+0000 7f82baffd640 1 -- 172.21.15.1:0/2496221555 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f82bc01a020 con 0x7f82cc0b9710 2024-09-15T21:55:47.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.233+0000 7f82baffd640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f82ac0678c0 0x7f82ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:47.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.233+0000 7f82baffd640 1 -- 172.21.15.1:0/2496221555 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f82bc0854a0 con 0x7f82cc0b9710 2024-09-15T21:55:47.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.233+0000 7f82c9d9b640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f82ac0678c0 0x7f82ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:47.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.233+0000 7f82c9d9b640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f82ac0678c0 0x7f82ac069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f82c00af000 tx=0x7f82c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:47.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.237+0000 7f82baffd640 1 -- 172.21.15.1:0/2496221555 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f82bc056010 con 0x7f82cc0b9710 2024-09-15T21:55:47.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:47.405+0000 7f82d0f70640 1 -- 172.21.15.1:0/2496221555 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f82cc1474e0 con 0x7f82cc0b9710 2024-09-15T21:55:48.156 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T21:55:48.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.153+0000 7f82baffd640 1 -- 172.21.15.1:0/2496221555 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f82bc055910 con 0x7f82cc0b9710 2024-09-15T21:55:48.158 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2024-09-15T21:55:48.160 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T21:55:48.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.157+0000 7f82d0f70640 1 -- 172.21.15.1:0/2496221555 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f82ac0678c0 msgr2=0x7f82ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:48.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.157+0000 7f82d0f70640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f82ac0678c0 0x7f82ac069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f82c00af000 tx=0x7f82c0008040 comp rx=0 tx=0).stop 2024-09-15T21:55:48.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.157+0000 7f82d0f70640 1 -- 172.21.15.1:0/2496221555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc0b9710 msgr2=0x7f82cc09b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:48.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.157+0000 7f82d0f70640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc0b9710 0x7f82cc09b800 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00c420 tx=0x7f82bc00c8e0 comp rx=0 tx=0).stop 2024-09-15T21:55:48.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.161+0000 7f82d0f70640 1 -- 172.21.15.1:0/2496221555 shutdown_connections 2024-09-15T21:55:48.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.161+0000 7f82d0f70640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f82ac0678c0 0x7f82ac069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:48.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.161+0000 7f82d0f70640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82cc147fe0 0x7f82cc1e35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:48.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.161+0000 7f82d0f70640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82cc0bc1a0 0x7f82cc09c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:48.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.161+0000 7f82d0f70640 1 --2- 172.21.15.1:0/2496221555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82cc0b9710 0x7f82cc09b800 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:48.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.161+0000 7f82d0f70640 1 -- 172.21.15.1:0/2496221555 >> 172.21.15.1:0/2496221555 conn(0x7f82cc0b9df0 msgr2=0x7f82cc146c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:48.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.161+0000 7f82d0f70640 1 -- 172.21.15.1:0/2496221555 shutdown_connections 2024-09-15T21:55:48.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.161+0000 7f82d0f70640 1 -- 172.21.15.1:0/2496221555 wait complete. 2024-09-15T21:55:48.187 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T21:55:48.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff3ab8640 1 Processor -- start 2024-09-15T21:55:48.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff3ab8640 1 -- start start 2024-09-15T21:55:48.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff3ab8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fafec0b4560 0x7fafec0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:48.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff3ab8640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec06d5b0 con 0x7fafec06d0d0 2024-09-15T21:55:48.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff3ab8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec06d890 con 0x7fafec149450 2024-09-15T21:55:48.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff3ab8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fafec06dc00 con 0x7fafec0b4560 2024-09-15T21:55:48.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff1053640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fafec06d0d0 0x7fafec148d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37876/0 (socket says 172.21.15.1:37876) 2024-09-15T21:55:48.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff1053640 1 -- 172.21.15.1:0/3657296133 learned_addr learned my addr 172.21.15.1:0/3657296133 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:48.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff1854640 1 --2- 172.21.15.1:0/3657296133 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fafec0b4560 0x7fafec0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:48.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff0852640 1 -- 172.21.15.1:0/3657296133 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840956851 0 0) 0x7fafec06d5b0 con 0x7fafec06d0d0 2024-09-15T21:55:48.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff0852640 1 -- 172.21.15.1:0/3657296133 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafd8003530 con 0x7fafec06d0d0 2024-09-15T21:55:48.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff0852640 1 -- 172.21.15.1:0/3657296133 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4092829370 0 0) 0x7fafec06d890 con 0x7fafec149450 2024-09-15T21:55:48.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff0852640 1 -- 172.21.15.1:0/3657296133 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafec06d5b0 con 0x7fafec149450 2024-09-15T21:55:48.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff0852640 1 -- 172.21.15.1:0/3657296133 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4124112160 0 0) 0x7fafd8003530 con 0x7fafec06d0d0 2024-09-15T21:55:48.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff1854640 1 -- 172.21.15.1:0/3657296133 >> v1:172.21.15.70:6789/0 conn(0x7fafec149450 legacy=0x7fafec09dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:48.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff1854640 1 -- 172.21.15.1:0/3657296133 >> v1:172.21.15.1:6789/0 conn(0x7fafec06d0d0 legacy=0x7fafec148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:48.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.365+0000 7faff1854640 1 -- 172.21.15.1:0/3657296133 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafec0b3ad0 con 0x7fafec0b4560 2024-09-15T21:55:48.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.369+0000 7faff1854640 1 --2- 172.21.15.1:0/3657296133 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fafec0b4560 0x7fafec0b4940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0097f0 tx=0x7fafdc01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96159c1cf1245ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:48.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.369+0000 7faff0852640 1 -- 172.21.15.1:0/3657296133 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0b0070 con 0x7fafec0b4560 2024-09-15T21:55:48.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.369+0000 7faff0852640 1 -- 172.21.15.1:0/3657296133 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafdc0ab400 con 0x7fafec0b4560 2024-09-15T21:55:48.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.369+0000 7faff0852640 1 -- 172.21.15.1:0/3657296133 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe8001680 con 0x7fafec0b4560 2024-09-15T21:55:48.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.369+0000 7faff3ab8640 1 -- 172.21.15.1:0/3657296133 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fafec0b4560 msgr2=0x7fafec0b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:48.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.369+0000 7faff3ab8640 1 --2- 172.21.15.1:0/3657296133 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fafec0b4560 0x7fafec0b4940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0097f0 tx=0x7fafdc01c370 comp rx=0 tx=0).stop 2024-09-15T21:55:48.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.369+0000 7faff3ab8640 1 -- 172.21.15.1:0/3657296133 shutdown_connections 2024-09-15T21:55:48.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.369+0000 7faff3ab8640 1 --2- 172.21.15.1:0/3657296133 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fafec0b4560 0x7fafec0b4940 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:48.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.369+0000 7faff3ab8640 1 -- 172.21.15.1:0/3657296133 >> 172.21.15.1:0/3657296133 conn(0x7fafec06c730 msgr2=0x7fafec0b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:48.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.369+0000 7faff3ab8640 1 -- 172.21.15.1:0/3657296133 shutdown_connections 2024-09-15T21:55:48.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.369+0000 7faff3ab8640 1 -- 172.21.15.1:0/3657296133 wait complete. 2024-09-15T21:55:48.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.369+0000 7faff3ab8640 1 Processor -- start 2024-09-15T21:55:48.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff3ab8640 1 -- start start 2024-09-15T21:55:48.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff3ab8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafec06d0d0 0x7fafec0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:48.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff3ab8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafec0b4560 0x7fafec070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:48.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff3ab8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fafec149450 0x7fafec1ddc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:48.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff3ab8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fafec153b30 con 0x7fafec06d0d0 2024-09-15T21:55:48.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff3ab8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fafec1539b0 con 0x7fafec0b4560 2024-09-15T21:55:48.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff3ab8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fafec153cb0 con 0x7fafec149450 2024-09-15T21:55:48.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff1854640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafec06d0d0 0x7fafec0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:48.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff1854640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafec06d0d0 0x7fafec0b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35650/0 (socket says 172.21.15.1:35650) 2024-09-15T21:55:48.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff1854640 1 -- 172.21.15.1:0/3444637356 learned_addr learned my addr 172.21.15.1:0/3444637356 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:48.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff1053640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafec0b4560 0x7fafec070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:48.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff2055640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fafec149450 0x7fafec1ddc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:48.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff1854640 1 -- 172.21.15.1:0/3444637356 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fafec149450 msgr2=0x7fafec1ddc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:48.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff1854640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fafec149450 0x7fafec1ddc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:48.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff1854640 1 -- 172.21.15.1:0/3444637356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafec0b4560 msgr2=0x7fafec070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:48.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff1854640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafec0b4560 0x7fafec070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:48.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff1854640 1 -- 172.21.15.1:0/3444637356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafec071260 con 0x7fafec06d0d0 2024-09-15T21:55:48.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff1053640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafec0b4560 0x7fafec070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:48.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff2055640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fafec149450 0x7fafec1ddc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:48.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff1854640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafec06d0d0 0x7fafec0b78f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0ae040 tx=0x7fafdc01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:48.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7fafe27fc640 1 -- 172.21.15.1:0/3444637356 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0bb020 con 0x7fafec06d0d0 2024-09-15T21:55:48.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7fafe27fc640 1 -- 172.21.15.1:0/3444637356 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafdc0b1040 con 0x7fafec06d0d0 2024-09-15T21:55:48.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff3ab8640 1 -- 172.21.15.1:0/3444637356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafec071540 con 0x7fafec06d0d0 2024-09-15T21:55:48.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7fafe27fc640 1 -- 172.21.15.1:0/3444637356 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0b0050 con 0x7fafec06d0d0 2024-09-15T21:55:48.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff3ab8640 1 -- 172.21.15.1:0/3444637356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafec13f800 con 0x7fafec06d0d0 2024-09-15T21:55:48.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff3ab8640 1 -- 172.21.15.1:0/3444637356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafec0b4940 con 0x7fafec06d0d0 2024-09-15T21:55:48.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7fafe27fc640 1 -- 172.21.15.1:0/3444637356 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fafdc0be070 con 0x7fafec06d0d0 2024-09-15T21:55:48.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7fafe27fc640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fafd00678c0 0x7fafd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:48.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7fafe27fc640 1 -- 172.21.15.1:0/3444637356 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7fafdc11f4c0 con 0x7fafec06d0d0 2024-09-15T21:55:48.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.373+0000 7faff1053640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fafd00678c0 0x7fafd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:48.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.377+0000 7faff1053640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fafd00678c0 0x7fafd0069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fafec09b410 tx=0x7fafe8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:48.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.381+0000 7fafe27fc640 1 -- 172.21.15.1:0/3444637356 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fafdc015ff0 con 0x7fafec06d0d0 2024-09-15T21:55:48.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:48.553+0000 7faff3ab8640 1 -- 172.21.15.1:0/3444637356 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fafec0b5510 con 0x7fafec06d0d0 2024-09-15T21:55:49.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.173+0000 7fafe27fc640 1 -- 172.21.15.1:0/3444637356 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7fafdc0f01f0 con 0x7fafec06d0d0 2024-09-15T21:55:49.179 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2024-09-15T21:55:49.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.177+0000 7faff3ab8640 1 -- 172.21.15.1:0/3444637356 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fafd00678c0 msgr2=0x7fafd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:49.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.177+0000 7faff3ab8640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fafd00678c0 0x7fafd0069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fafec09b410 tx=0x7fafe8009040 comp rx=0 tx=0).stop 2024-09-15T21:55:49.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.177+0000 7faff3ab8640 1 -- 172.21.15.1:0/3444637356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafec06d0d0 msgr2=0x7fafec0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:49.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.177+0000 7faff3ab8640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafec06d0d0 0x7fafec0b78f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0ae040 tx=0x7fafdc01abb0 comp rx=0 tx=0).stop 2024-09-15T21:55:49.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.181+0000 7faff3ab8640 1 -- 172.21.15.1:0/3444637356 shutdown_connections 2024-09-15T21:55:49.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.181+0000 7faff3ab8640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fafec149450 0x7fafec1ddc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:49.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.181+0000 7faff3ab8640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fafd00678c0 0x7fafd0069d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:49.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.181+0000 7faff3ab8640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafec0b4560 0x7fafec070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:49.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.181+0000 7faff3ab8640 1 --2- 172.21.15.1:0/3444637356 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fafec06d0d0 0x7fafec0b78f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:49.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.181+0000 7faff3ab8640 1 -- 172.21.15.1:0/3444637356 >> 172.21.15.1:0/3444637356 conn(0x7fafec06c730 msgr2=0x7fafec1446c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:49.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.181+0000 7faff3ab8640 1 -- 172.21.15.1:0/3444637356 shutdown_connections 2024-09-15T21:55:49.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.181+0000 7faff3ab8640 1 -- 172.21.15.1:0/3444637356 wait complete. 2024-09-15T21:55:49.205 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T21:55:49.205 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T21:55:49.205 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T21:55:49.205 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:55:49.206 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T21:55:49.206 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T21:55:49.206 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T21:55:49.206 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:55:49.216 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T21:55:49.217 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T21:55:49.223 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T21:55:49.223 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T21:55:49.261 INFO:tasks.ceph.mds.a:Started 2024-09-15T21:55:49.261 DEBUG:teuthology.parallel:result is None 2024-09-15T21:55:49.268 INFO:tasks.ceph.mds.b:Started 2024-09-15T21:55:49.269 DEBUG:teuthology.parallel:result is None 2024-09-15T21:55:49.269 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T21:55:49.336 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2024-09-15T21:55:49.344 INFO:tasks.ceph.mds.b.smithi070.stdout:starting mds.b at 2024-09-15T21:55:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.385+0000 7f577624a640 1 Processor -- start 2024-09-15T21:55:49.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.385+0000 7f577624a640 1 -- start start 2024-09-15T21:55:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f577624a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f57700b5760 0x7f57700b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f577624a640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57700b66d0 con 0x7f57700b62f0 2024-09-15T21:55:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f577624a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57701484d0 con 0x7f57700b9070 2024-09-15T21:55:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f577624a640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f57700b48e0 con 0x7f57700b5760 2024-09-15T21:55:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f576f7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f57700b62f0 0x7f5770147d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37896/0 (socket says 172.21.15.1:37896) 2024-09-15T21:55:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f576f7fe640 1 -- 172.21.15.1:0/2032797206 learned_addr learned my addr 172.21.15.1:0/2032797206 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:49.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f576ffff640 1 --2- 172.21.15.1:0/2032797206 >> v2:172.21.15.1:3300/0 conn(0x7f57700b5760 0x7f57700b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:49.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f576ffff640 1 -- 172.21.15.1:0/2032797206 >> v1:172.21.15.70:6789/0 conn(0x7f57700b9070 legacy=0x7f57700b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:49.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f576ffff640 1 -- 172.21.15.1:0/2032797206 >> v1:172.21.15.1:6789/0 conn(0x7f57700b62f0 legacy=0x7f5770147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:49.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f576e7fc640 1 -- 172.21.15.1:0/2032797206 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3681531818 0 0) 0x7f57700b66d0 con 0x7f57700b62f0 2024-09-15T21:55:49.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f576ffff640 1 -- 172.21.15.1:0/2032797206 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5770141d90 con 0x7f57700b5760 2024-09-15T21:55:49.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f576ffff640 1 --2- 172.21.15.1:0/2032797206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57700b5760 0x7f57700b94a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5768009d90 tx=0x7f576801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba7766b70040b40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f576e7fc640 1 -- 172.21.15.1:0/2032797206 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57680b2070 con 0x7f57700b5760 2024-09-15T21:55:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f576e7fc640 1 -- 172.21.15.1:0/2032797206 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57680a5760 con 0x7f57700b5760 2024-09-15T21:55:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f576e7fc640 1 -- 172.21.15.1:0/2032797206 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57680a5b30 con 0x7f57700b5760 2024-09-15T21:55:49.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f577624a640 1 -- 172.21.15.1:0/2032797206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57700b5760 msgr2=0x7f57700b94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:49.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.389+0000 7f577624a640 1 --2- 172.21.15.1:0/2032797206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57700b5760 0x7f57700b94a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5768009d90 tx=0x7f576801c8a0 comp rx=0 tx=0).stop 2024-09-15T21:55:49.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 -- 172.21.15.1:0/2032797206 shutdown_connections 2024-09-15T21:55:49.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 --2- 172.21.15.1:0/2032797206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57700b5760 0x7f57700b94a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:49.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 -- 172.21.15.1:0/2032797206 >> 172.21.15.1:0/2032797206 conn(0x7f57700b9ea0 msgr2=0x7f57700ba2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:49.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 -- 172.21.15.1:0/2032797206 shutdown_connections 2024-09-15T21:55:49.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 -- 172.21.15.1:0/2032797206 wait complete. 2024-09-15T21:55:49.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 Processor -- start 2024-09-15T21:55:49.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 -- start start 2024-09-15T21:55:49.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57700b5760 0x7f5770141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57700b62f0 0x7f577013f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57700b9070 0x7f577013f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5770155b40 con 0x7f57700b62f0 2024-09-15T21:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f57700b99e0 con 0x7f57700b9070 2024-09-15T21:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5770155cc0 con 0x7f57700b5760 2024-09-15T21:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f576effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57700b62f0 0x7f577013f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f576effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57700b62f0 0x7f577013f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35692/0 (socket says 172.21.15.1:35692) 2024-09-15T21:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f576effd640 1 -- 172.21.15.1:0/613284163 learned_addr learned my addr 172.21.15.1:0/613284163 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f576ffff640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57700b9070 0x7f577013f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f576f7fe640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57700b5760 0x7f5770141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f576effd640 1 -- 172.21.15.1:0/613284163 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57700b5760 msgr2=0x7f5770141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f576effd640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57700b5760 0x7f5770141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:49.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f576effd640 1 -- 172.21.15.1:0/613284163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57700b9070 msgr2=0x7f577013f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:49.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f576effd640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57700b9070 0x7f577013f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:49.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f576effd640 1 -- 172.21.15.1:0/613284163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5770140c70 con 0x7f57700b62f0 2024-09-15T21:55:49.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f576f7fe640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57700b5760 0x7f5770141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:49.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f576ffff640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57700b9070 0x7f577013f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:49.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f576effd640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57700b62f0 0x7f577013f0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f576000b440 tx=0x7f576000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:49.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f5757fff640 1 -- 172.21.15.1:0/613284163 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760015020 con 0x7f57700b62f0 2024-09-15T21:55:49.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f5757fff640 1 -- 172.21.15.1:0/613284163 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5760011830 con 0x7f57700b62f0 2024-09-15T21:55:49.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 -- 172.21.15.1:0/613284163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5770140ee0 con 0x7f57700b62f0 2024-09-15T21:55:49.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f5757fff640 1 -- 172.21.15.1:0/613284163 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760011c20 con 0x7f57700b62f0 2024-09-15T21:55:49.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 -- 172.21.15.1:0/613284163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f577013e880 con 0x7f57700b62f0 2024-09-15T21:55:49.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.393+0000 7f577624a640 1 -- 172.21.15.1:0/613284163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57700b94a0 con 0x7f57700b62f0 2024-09-15T21:55:49.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.397+0000 7f5757fff640 1 -- 172.21.15.1:0/613284163 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5760018020 con 0x7f57700b62f0 2024-09-15T21:55:49.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.397+0000 7f5757fff640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f575c0678c0 0x7f575c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:49.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.397+0000 7f5757fff640 1 -- 172.21.15.1:0/613284163 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f57600854b0 con 0x7f57700b62f0 2024-09-15T21:55:49.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.397+0000 7f576f7fe640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f575c0678c0 0x7f575c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:49.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.397+0000 7f576f7fe640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f575c0678c0 0x7f575c069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5764000f70 tx=0x7f5764009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:49.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.401+0000 7f5757fff640 1 -- 172.21.15.1:0/613284163 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f576001f030 con 0x7f57700b62f0 2024-09-15T21:55:49.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:49.581+0000 7f577624a640 1 -- 172.21.15.1:0/613284163 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f57700bd180 con 0x7f57700b62f0 2024-09-15T21:55:50.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.193+0000 7f5757fff640 1 -- 172.21.15.1:0/613284163 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f5760056380 con 0x7f57700b62f0 2024-09-15T21:55:50.198 INFO:teuthology.orchestra.run.smithi001.stderr: removed all blocklist entries 2024-09-15T21:55:50.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.197+0000 7f577624a640 1 -- 172.21.15.1:0/613284163 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f575c0678c0 msgr2=0x7f575c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:50.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.197+0000 7f577624a640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f575c0678c0 0x7f575c069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5764000f70 tx=0x7f5764009040 comp rx=0 tx=0).stop 2024-09-15T21:55:50.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.197+0000 7f577624a640 1 -- 172.21.15.1:0/613284163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57700b62f0 msgr2=0x7f577013f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:50.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.197+0000 7f577624a640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57700b62f0 0x7f577013f0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f576000b440 tx=0x7f576000b900 comp rx=0 tx=0).stop 2024-09-15T21:55:50.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.197+0000 7f577624a640 1 -- 172.21.15.1:0/613284163 shutdown_connections 2024-09-15T21:55:50.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.197+0000 7f577624a640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f575c0678c0 0x7f575c069d80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.197+0000 7f577624a640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57700b9070 0x7f577013f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.197+0000 7f577624a640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57700b62f0 0x7f577013f0a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.197+0000 7f577624a640 1 --2- 172.21.15.1:0/613284163 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57700b5760 0x7f5770141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.197+0000 7f577624a640 1 -- 172.21.15.1:0/613284163 >> 172.21.15.1:0/613284163 conn(0x7f57700b9ea0 msgr2=0x7f5770067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:50.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.197+0000 7f577624a640 1 -- 172.21.15.1:0/613284163 shutdown_connections 2024-09-15T21:55:50.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.197+0000 7f577624a640 1 -- 172.21.15.1:0/613284163 wait complete. 2024-09-15T21:55:50.226 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T21:55:50.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f7091fde640 1 Processor -- start 2024-09-15T21:55:50.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f7091fde640 1 -- start start 2024-09-15T21:55:50.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f7091fde640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f708c146360 0x7f708c06da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:50.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f7091fde640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f708c0b5f20 0x7f708c14ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:50.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f7091fde640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f708c068040 con 0x7f708c067c60 2024-09-15T21:55:50.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f7091fde640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f708c0b63b0 con 0x7f708c146360 2024-09-15T21:55:50.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f7091fde640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f708c09eca0 con 0x7f708c0b5f20 2024-09-15T21:55:50.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708b7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f708c067c60 0x7f708c145c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37898/0 (socket says 172.21.15.1:37898) 2024-09-15T21:55:50.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708b7fe640 1 -- 172.21.15.1:0/1927894628 learned_addr learned my addr 172.21.15.1:0/1927894628 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:50.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708affd640 1 --2- 172.21.15.1:0/1927894628 >> v2:172.21.15.1:3300/0 conn(0x7f708c146360 0x7f708c06da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:50.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708bfff640 1 --2- 172.21.15.1:0/1927894628 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f708c0b5f20 0x7f708c14ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:50.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708a7fc640 1 -- 172.21.15.1:0/1927894628 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4268052892 0 0) 0x7f708c068040 con 0x7f708c067c60 2024-09-15T21:55:50.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708a7fc640 1 -- 172.21.15.1:0/1927894628 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7074003530 con 0x7f708c067c60 2024-09-15T21:55:50.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708affd640 1 -- 172.21.15.1:0/1927894628 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f708c0b5f20 msgr2=0x7f708c14ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:50.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708affd640 1 --2- 172.21.15.1:0/1927894628 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f708c0b5f20 0x7f708c14ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708affd640 1 -- 172.21.15.1:0/1927894628 >> v1:172.21.15.1:6789/0 conn(0x7f708c067c60 legacy=0x7f708c145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:50.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708affd640 1 -- 172.21.15.1:0/1927894628 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c06efd0 con 0x7f708c146360 2024-09-15T21:55:50.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708bfff640 1 --2- 172.21.15.1:0/1927894628 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f708c0b5f20 0x7f708c14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:50.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708affd640 1 --2- 172.21.15.1:0/1927894628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c146360 0x7f708c06da50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f707c0097c0 tx=0x7f707c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5283881728d60f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:50.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708a7fc640 1 -- 172.21.15.1:0/1927894628 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c0ab610 con 0x7f708c146360 2024-09-15T21:55:50.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708a7fc640 1 -- 172.21.15.1:0/1927894628 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707c0b0070 con 0x7f708c146360 2024-09-15T21:55:50.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.341+0000 7f708a7fc640 1 -- 172.21.15.1:0/1927894628 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c0ab9b0 con 0x7f708c146360 2024-09-15T21:55:50.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 -- 172.21.15.1:0/1927894628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c146360 msgr2=0x7f708c06da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:50.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 --2- 172.21.15.1:0/1927894628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c146360 0x7f708c06da50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f707c0097c0 tx=0x7f707c01c410 comp rx=0 tx=0).stop 2024-09-15T21:55:50.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 -- 172.21.15.1:0/1927894628 shutdown_connections 2024-09-15T21:55:50.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 --2- 172.21.15.1:0/1927894628 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f708c0b5f20 0x7f708c14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 --2- 172.21.15.1:0/1927894628 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c146360 0x7f708c06da50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 -- 172.21.15.1:0/1927894628 >> 172.21.15.1:0/1927894628 conn(0x7f708c06bcc0 msgr2=0x7f708c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:50.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 -- 172.21.15.1:0/1927894628 shutdown_connections 2024-09-15T21:55:50.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 -- 172.21.15.1:0/1927894628 wait complete. 2024-09-15T21:55:50.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 Processor -- start 2024-09-15T21:55:50.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 -- start start 2024-09-15T21:55:50.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f708c067c60 0x7f708c0b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:50.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c0b5f20 0x7f708c140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:50.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f708c146360 0x7f708c1407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:50.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f708c0b5440 con 0x7f708c0b5f20 2024-09-15T21:55:50.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f708c09f1d0 con 0x7f708c067c60 2024-09-15T21:55:50.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f7091fde640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f708c071460 con 0x7f708c146360 2024-09-15T21:55:50.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f708affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c0b5f20 0x7f708c140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:50.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f708affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c0b5f20 0x7f708c140260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35712/0 (socket says 172.21.15.1:35712) 2024-09-15T21:55:50.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f708affd640 1 -- 172.21.15.1:0/555718255 learned_addr learned my addr 172.21.15.1:0/555718255 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:50.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.345+0000 7f708b7fe640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f708c067c60 0x7f708c0b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:50.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f708bfff640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f708c146360 0x7f708c1407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:50.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f708affd640 1 -- 172.21.15.1:0/555718255 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f708c146360 msgr2=0x7f708c1407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:50.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f708affd640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f708c146360 0x7f708c1407a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f708affd640 1 -- 172.21.15.1:0/555718255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f708c067c60 msgr2=0x7f708c0b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:50.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f708affd640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f708c067c60 0x7f708c0b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f708affd640 1 -- 172.21.15.1:0/555718255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c0b3e00 con 0x7f708c0b5f20 2024-09-15T21:55:50.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f708b7fe640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f708c067c60 0x7f708c0b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:50.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f708affd640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c0b5f20 0x7f708c140260 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f707c009710 tx=0x7f707c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:50.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f7073fff640 1 -- 172.21.15.1:0/555718255 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c0aba90 con 0x7f708c0b5f20 2024-09-15T21:55:50.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f7073fff640 1 -- 172.21.15.1:0/555718255 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707c0abc30 con 0x7f708c0b5f20 2024-09-15T21:55:50.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f7091fde640 1 -- 172.21.15.1:0/555718255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f708c142460 con 0x7f708c0b5f20 2024-09-15T21:55:50.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f7073fff640 1 -- 172.21.15.1:0/555718255 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c0be3f0 con 0x7f708c0b5f20 2024-09-15T21:55:50.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f7091fde640 1 -- 172.21.15.1:0/555718255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f708c0b9620 con 0x7f708c0b5f20 2024-09-15T21:55:50.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f7091fde640 1 -- 172.21.15.1:0/555718255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f708c06da50 con 0x7f708c0b5f20 2024-09-15T21:55:50.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f7073fff640 1 -- 172.21.15.1:0/555718255 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f707c0bd3a0 con 0x7f708c0b5f20 2024-09-15T21:55:50.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f7073fff640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f70780678c0 0x7f7078069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:50.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f7073fff640 1 -- 172.21.15.1:0/555718255 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4857+0+0 (secure 0 0 0) 0x7f707c11f790 con 0x7f708c0b5f20 2024-09-15T21:55:50.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f708b7fe640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f70780678c0 0x7f7078069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:50.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.349+0000 7f708b7fe640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f70780678c0 0x7f7078069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7080005890 tx=0x7f7080009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:50.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.353+0000 7f7073fff640 1 -- 172.21.15.1:0/555718255 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f707c0a8050 con 0x7f708c0b5f20 2024-09-15T21:55:50.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.573+0000 7f7091fde640 1 -- 172.21.15.1:0/555718255 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f708c142180 con 0x7f708c0b5f20 2024-09-15T21:55:50.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.577+0000 7f7073fff640 1 -- 172.21.15.1:0/555718255 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+5207 (secure 0 0 0) 0x7f707c016090 con 0x7f708c0b5f20 2024-09-15T21:55:50.579 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:50.579 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T21:55:50.580 INFO:teuthology.orchestra.run.smithi001.stdout: "auth_dump": [ 2024-09-15T21:55:50.580 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.580 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.a", 2024-09-15T21:55:50.580 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCMV+dmiMI6DhAA5mR3Rtjj5Rkmro25VAMtfQ==", 2024-09-15T21:55:50.580 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.580 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2024-09-15T21:55:50.580 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2024-09-15T21:55:50.580 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2024-09-15T21:55:50.580 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2024-09-15T21:55:50.580 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.580 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.580 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.580 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mds.b", 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCMV+dmYW6DFBAAV6+Y0uZwpjZEg1ZfRWdtRg==", 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.0", 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCNV+dm3J6fIBAAFcQf/pmSLuwunpBSg/1Zvg==", 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2024-09-15T21:55:50.581 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.1", 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCRV+dmLZxwARAANgGZmZ7W4l1b6dhnLojRSg==", 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.2", 2024-09-15T21:55:50.582 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCUV+dmJuckERAAgcoMES3RPO+pw/a4AvArIw==", 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.3", 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCXV+dmH08fIxAAlAQTReUC89NonjmdPAkSBA==", 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.583 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.584 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.4", 2024-09-15T21:55:50.584 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCbV+dmAhsZMRAAcBovO3NGlg7zFf8v/mDxXQ==", 2024-09-15T21:55:50.584 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.584 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2024-09-15T21:55:50.584 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2024-09-15T21:55:50.584 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2024-09-15T21:55:50.584 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.584 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.584 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.584 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.5", 2024-09-15T21:55:50.584 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCfV+dmtG2DAxAAUmbCXixBEeN/e7cGU1U1hg==", 2024-09-15T21:55:50.584 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.584 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.6", 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCiV+dmyIuqFRAAWBYhQLeROAeqMytd7M8CfA==", 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.585 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "osd.7", 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQClV+dmjvotJRAAyHoWPQDllt6Po4UurBcf5w==", 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow profile osd", 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile osd", 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.0", 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCMV+dmfpbrGRAA5tTriIldy8QYr+dZxosTvQ==", 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow", 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow r", 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow rw", 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow rwx" 2024-09-15T21:55:50.586 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.admin", 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCLV+dmI9JXMhAAx0rK1e2ubuRaJvoAdSEPNQ==", 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr": "allow *", 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow *", 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-mds", 2024-09-15T21:55:50.587 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCwV+dmj90NEhAAzIDxeD10mPw+Ej2b7nncnQ==", 2024-09-15T21:55:50.588 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.588 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-mds" 2024-09-15T21:55:50.588 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.588 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.588 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.588 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-mgr", 2024-09-15T21:55:50.588 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCwV+dmZgoOEhAAhglVAA/gedOVKx4os7rmHw==", 2024-09-15T21:55:50.588 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.588 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-15T21:55:50.588 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.588 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.588 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.588 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-osd", 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCwV+dm4DAOEhAAzckkR0Q5fRHjEKufdnSp5A==", 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-osd" 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-rbd", 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCwV+dmLVAOEhAAIGqCnytpe59khwmuxWC4eA==", 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.589 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCwV+dmCm0OEhAAaaC2oX2fTg2eOjLXgr9fTw==", 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "client.bootstrap-rgw", 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCwV+dmfoQOEhAAZe3RmznT2CNkm6nRO8bOoA==", 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.590 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.x", 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCMV+dm8fpUCxAAiOC8+IWnXu62CCGTD9LHug==", 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: "entity": "mgr.y", 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: "key": "AQCMV+dmkpNdCBAAT51hidj27L/T0tH5osOpiw==", 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: "caps": { 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: "mds": "allow *", 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: "mon": "allow profile mgr", 2024-09-15T21:55:50.591 INFO:teuthology.orchestra.run.smithi001.stdout: "osd": "allow *" 2024-09-15T21:55:50.592 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.592 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:50.592 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-15T21:55:50.592 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T21:55:50.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.577+0000 7f7091fde640 1 -- 172.21.15.1:0/555718255 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f70780678c0 msgr2=0x7f7078069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:50.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.577+0000 7f7091fde640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f70780678c0 0x7f7078069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7080005890 tx=0x7f7080009040 comp rx=0 tx=0).stop 2024-09-15T21:55:50.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.577+0000 7f7091fde640 1 -- 172.21.15.1:0/555718255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c0b5f20 msgr2=0x7f708c140260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:50.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.577+0000 7f7091fde640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c0b5f20 0x7f708c140260 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f707c009710 tx=0x7f707c0191b0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.577+0000 7f7091fde640 1 -- 172.21.15.1:0/555718255 shutdown_connections 2024-09-15T21:55:50.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.577+0000 7f7091fde640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f708c146360 0x7f708c1407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.577+0000 7f7091fde640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f708c0b5f20 0x7f708c140260 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.577+0000 7f7091fde640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f70780678c0 0x7f7078069d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.577+0000 7f7091fde640 1 --2- 172.21.15.1:0/555718255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f708c067c60 0x7f708c0b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.577+0000 7f7091fde640 1 -- 172.21.15.1:0/555718255 >> 172.21.15.1:0/555718255 conn(0x7f708c06bcc0 msgr2=0x7f708c13dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:50.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.577+0000 7f7091fde640 1 -- 172.21.15.1:0/555718255 shutdown_connections 2024-09-15T21:55:50.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.577+0000 7f7091fde640 1 -- 172.21.15.1:0/555718255 wait complete. 2024-09-15T21:55:50.598 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-15T21:55:50.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b3a01f640 1 Processor -- start 2024-09-15T21:55:50.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b3a01f640 1 -- start start 2024-09-15T21:55:50.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b3a01f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1b340b5560 0x7f1b340ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:50.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b3a01f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b340afdc0 0x7f1b3414edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:50.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b3a01f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3413ec80 con 0x7f1b3406d0d0 2024-09-15T21:55:50.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b3a01f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f1b340b5940 con 0x7f1b340afdc0 2024-09-15T21:55:50.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b3a01f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f1b3406dbd0 con 0x7f1b340b5560 2024-09-15T21:55:50.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b33fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b340afdc0 0x7f1b3414edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:50.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b33fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1b340afdc0 0x7f1b3414edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35726/0 (socket says 172.21.15.1:35726) 2024-09-15T21:55:50.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b33fff640 1 -- 172.21.15.1:0/1184566620 learned_addr learned my addr 172.21.15.1:0/1184566620 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:50.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b337fe640 1 --2- 172.21.15.1:0/1184566620 >> v2:172.21.15.70:3300/0 conn(0x7f1b340b5560 0x7f1b340ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:50.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b33fff640 1 -- 172.21.15.1:0/1184566620 >> v2:172.21.15.70:3300/0 conn(0x7f1b340b5560 msgr2=0x7f1b340ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:50.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b33fff640 1 --2- 172.21.15.1:0/1184566620 >> v2:172.21.15.70:3300/0 conn(0x7f1b340b5560 0x7f1b340ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b33fff640 1 -- 172.21.15.1:0/1184566620 >> v1:172.21.15.70:6789/0 conn(0x7f1b3406d0d0 legacy=0x7f1b3413e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:50.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b33fff640 1 -- 172.21.15.1:0/1184566620 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3406deb0 con 0x7f1b340afdc0 2024-09-15T21:55:50.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.717+0000 7f1b337fe640 1 --2- 172.21.15.1:0/1184566620 >> v2:172.21.15.70:3300/0 conn(0x7f1b340b5560 0x7f1b340ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:50.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b33fff640 1 --2- 172.21.15.1:0/1184566620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340afdc0 0x7f1b3414edc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1b3406ea60 tx=0x7f1b2c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fbf2d6fe1994eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:50.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b327fc640 1 -- 172.21.15.1:0/1184566620 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0b0070 con 0x7f1b340afdc0 2024-09-15T21:55:50.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b327fc640 1 -- 172.21.15.1:0/1184566620 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2c0ab600 con 0x7f1b340afdc0 2024-09-15T21:55:50.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b327fc640 1 -- 172.21.15.1:0/1184566620 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0ab9d0 con 0x7f1b340afdc0 2024-09-15T21:55:50.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b3a01f640 1 -- 172.21.15.1:0/1184566620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340afdc0 msgr2=0x7f1b3414edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:50.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b3a01f640 1 --2- 172.21.15.1:0/1184566620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340afdc0 0x7f1b3414edc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1b3406ea60 tx=0x7f1b2c01c450 comp rx=0 tx=0).stop 2024-09-15T21:55:50.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b3a01f640 1 -- 172.21.15.1:0/1184566620 shutdown_connections 2024-09-15T21:55:50.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b3a01f640 1 --2- 172.21.15.1:0/1184566620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340afdc0 0x7f1b3414edc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b3a01f640 1 --2- 172.21.15.1:0/1184566620 >> v2:172.21.15.70:3300/0 conn(0x7f1b340b5560 0x7f1b340ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b3a01f640 1 -- 172.21.15.1:0/1184566620 >> 172.21.15.1:0/1184566620 conn(0x7f1b3406c730 msgr2=0x7f1b340b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:50.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b3a01f640 1 -- 172.21.15.1:0/1184566620 shutdown_connections 2024-09-15T21:55:50.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b3a01f640 1 -- 172.21.15.1:0/1184566620 wait complete. 2024-09-15T21:55:50.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b3a01f640 1 Processor -- start 2024-09-15T21:55:50.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.721+0000 7f1b3a01f640 1 -- start start 2024-09-15T21:55:50.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b3a01f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b3406d0d0 0x7f1b34141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:50.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b3a01f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340afdc0 0x7f1b341e0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:50.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b3a01f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b340b5560 0x7f1b3409d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:50.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b3a01f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1b340b4e70 con 0x7f1b340afdc0 2024-09-15T21:55:50.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b3a01f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1b340b4cf0 con 0x7f1b340b5560 2024-09-15T21:55:50.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b3a01f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1b34151b20 con 0x7f1b3406d0d0 2024-09-15T21:55:50.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b32ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340afdc0 0x7f1b341e0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:50.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b32ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340afdc0 0x7f1b341e0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35736/0 (socket says 172.21.15.1:35736) 2024-09-15T21:55:50.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b32ffd640 1 -- 172.21.15.1:0/22609295 learned_addr learned my addr 172.21.15.1:0/22609295 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b337fe640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b3406d0d0 0x7f1b34141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b33fff640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b340b5560 0x7f1b3409d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b32ffd640 1 -- 172.21.15.1:0/22609295 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b3406d0d0 msgr2=0x7f1b34141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b32ffd640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b3406d0d0 0x7f1b34141940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b32ffd640 1 -- 172.21.15.1:0/22609295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b340b5560 msgr2=0x7f1b3409d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b32ffd640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b340b5560 0x7f1b3409d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b32ffd640 1 -- 172.21.15.1:0/22609295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b34071150 con 0x7f1b340afdc0 2024-09-15T21:55:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b32ffd640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340afdc0 0x7f1b341e0470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00c450 tx=0x7f1b1c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b2bfff640 1 -- 172.21.15.1:0/22609295 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c012830 con 0x7f1b340afdc0 2024-09-15T21:55:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b2bfff640 1 -- 172.21.15.1:0/22609295 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1c017070 con 0x7f1b340afdc0 2024-09-15T21:55:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b3a01f640 1 -- 172.21.15.1:0/22609295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b341e39e0 con 0x7f1b340afdc0 2024-09-15T21:55:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b2bfff640 1 -- 172.21.15.1:0/22609295 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c012c30 con 0x7f1b340afdc0 2024-09-15T21:55:50.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b3a01f640 1 -- 172.21.15.1:0/22609295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b341e3fa0 con 0x7f1b340afdc0 2024-09-15T21:55:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b3a01f640 1 -- 172.21.15.1:0/22609295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b340ae0f0 con 0x7f1b340afdc0 2024-09-15T21:55:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b2bfff640 1 -- 172.21.15.1:0/22609295 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b1c01c460 con 0x7f1b340afdc0 2024-09-15T21:55:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.725+0000 7f1b2bfff640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1b140678c0 0x7f1b14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.729+0000 7f1b2bfff640 1 -- 172.21.15.1:0/22609295 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4857+0+0 (secure 0 0 0) 0x7f1b1c086140 con 0x7f1b340afdc0 2024-09-15T21:55:50.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.729+0000 7f1b337fe640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1b140678c0 0x7f1b14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:50.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.729+0000 7f1b337fe640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1b140678c0 0x7f1b14069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1b24008ee0 tx=0x7f1b24008430 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.729+0000 7f1b2bfff640 1 -- 172.21.15.1:0/22609295 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1b1c057140 con 0x7f1b340afdc0 2024-09-15T21:55:50.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.953+0000 7f1b3a01f640 1 -- 172.21.15.1:0/22609295 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f1b34071430 con 0x7f1b340afdc0 2024-09-15T21:55:50.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.957+0000 7f1b2bfff640 1 -- 172.21.15.1:0/22609295 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f1b1c056a40 con 0x7f1b340afdc0 2024-09-15T21:55:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.957+0000 7f1b3a01f640 1 -- 172.21.15.1:0/22609295 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1b140678c0 msgr2=0x7f1b14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.957+0000 7f1b3a01f640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1b140678c0 0x7f1b14069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1b24008ee0 tx=0x7f1b24008430 comp rx=0 tx=0).stop 2024-09-15T21:55:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.957+0000 7f1b3a01f640 1 -- 172.21.15.1:0/22609295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340afdc0 msgr2=0x7f1b341e0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.957+0000 7f1b3a01f640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340afdc0 0x7f1b341e0470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00c450 tx=0x7f1b1c00c910 comp rx=0 tx=0).stop 2024-09-15T21:55:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.957+0000 7f1b3a01f640 1 -- 172.21.15.1:0/22609295 shutdown_connections 2024-09-15T21:55:50.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.957+0000 7f1b3a01f640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1b140678c0 0x7f1b14069d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.957+0000 7f1b3a01f640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b340b5560 0x7f1b3409d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.957+0000 7f1b3a01f640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1b340afdc0 0x7f1b341e0470 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.957+0000 7f1b3a01f640 1 --2- 172.21.15.1:0/22609295 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1b3406d0d0 0x7f1b34141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:50.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.957+0000 7f1b3a01f640 1 -- 172.21.15.1:0/22609295 >> 172.21.15.1:0/22609295 conn(0x7f1b3406c730 msgr2=0x7f1b3413e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:50.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.957+0000 7f1b3a01f640 1 -- 172.21.15.1:0/22609295 shutdown_connections 2024-09-15T21:55:50.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:50.957+0000 7f1b3a01f640 1 -- 172.21.15.1:0/22609295 wait complete. 2024-09-15T21:55:50.978 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-15T21:55:51.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52ed388640 1 Processor -- start 2024-09-15T21:55:51.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52ed388640 1 -- start start 2024-09-15T21:55:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52ed388640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f52e8071bb0 0x7f52e8072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52ed388640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52e813dcc0 0x7f52e813e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52ed388640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f52e8143e50 0x7f52e8144300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52ed388640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f52e80711d0 con 0x7f52e8071bb0 2024-09-15T21:55:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52ed388640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f52e813e640 con 0x7f52e8143e50 2024-09-15T21:55:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52ed388640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f52e8072dd0 con 0x7f52e813dcc0 2024-09-15T21:55:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52e6ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f52e8071bb0 0x7f52e8072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52e6ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f52e8071bb0 0x7f52e8072770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35752/0 (socket says 172.21.15.1:35752) 2024-09-15T21:55:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52e6ffd640 1 -- 172.21.15.1:0/2679051027 learned_addr learned my addr 172.21.15.1:0/2679051027 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52e77fe640 1 --2- 172.21.15.1:0/2679051027 >> v2:172.21.15.70:3300/0 conn(0x7f52e8143e50 0x7f52e8144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52e67fc640 1 --2- 172.21.15.1:0/2679051027 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52e813dcc0 0x7f52e813e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52e6ffd640 1 -- 172.21.15.1:0/2679051027 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52e813dcc0 msgr2=0x7f52e813e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52e6ffd640 1 --2- 172.21.15.1:0/2679051027 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52e813dcc0 0x7f52e813e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52e6ffd640 1 -- 172.21.15.1:0/2679051027 >> v2:172.21.15.70:3300/0 conn(0x7f52e8143e50 msgr2=0x7f52e8144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52e6ffd640 1 --2- 172.21.15.1:0/2679051027 >> v2:172.21.15.70:3300/0 conn(0x7f52e8143e50 0x7f52e8144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52e6ffd640 1 -- 172.21.15.1:0/2679051027 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e8073670 con 0x7f52e8071bb0 2024-09-15T21:55:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52e77fe640 1 --2- 172.21.15.1:0/2679051027 >> v2:172.21.15.70:3300/0 conn(0x7f52e8143e50 0x7f52e8144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:51.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.101+0000 7f52e67fc640 1 --2- 172.21.15.1:0/2679051027 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52e813dcc0 0x7f52e813e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:51.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52e6ffd640 1 --2- 172.21.15.1:0/2679051027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52e8071bb0 0x7f52e8072770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f52e80b6350 tx=0x7f52d801d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787192a3eee01332 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:51.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52e5ffb640 1 -- 172.21.15.1:0/2679051027 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d80a55e0 con 0x7f52e8071bb0 2024-09-15T21:55:51.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52e5ffb640 1 -- 172.21.15.1:0/2679051027 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d80a5780 con 0x7f52e8071bb0 2024-09-15T21:55:51.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52e5ffb640 1 -- 172.21.15.1:0/2679051027 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d80a5b50 con 0x7f52e8071bb0 2024-09-15T21:55:51.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52ed388640 1 -- 172.21.15.1:0/2679051027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52e8071bb0 msgr2=0x7f52e8072770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52ed388640 1 --2- 172.21.15.1:0/2679051027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52e8071bb0 0x7f52e8072770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f52e80b6350 tx=0x7f52d801d330 comp rx=0 tx=0).stop 2024-09-15T21:55:51.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52ed388640 1 -- 172.21.15.1:0/2679051027 shutdown_connections 2024-09-15T21:55:51.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52ed388640 1 --2- 172.21.15.1:0/2679051027 >> v2:172.21.15.70:3300/0 conn(0x7f52e8143e50 0x7f52e8144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52ed388640 1 --2- 172.21.15.1:0/2679051027 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52e813dcc0 0x7f52e813e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52ed388640 1 --2- 172.21.15.1:0/2679051027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52e8071bb0 0x7f52e8072770 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52ed388640 1 -- 172.21.15.1:0/2679051027 >> 172.21.15.1:0/2679051027 conn(0x7f52e80b63a0 msgr2=0x7f52e80b67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:51.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52ed388640 1 -- 172.21.15.1:0/2679051027 shutdown_connections 2024-09-15T21:55:51.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52ed388640 1 -- 172.21.15.1:0/2679051027 wait complete. 2024-09-15T21:55:51.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52ed388640 1 Processor -- start 2024-09-15T21:55:51.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.105+0000 7f52ed388640 1 -- start start 2024-09-15T21:55:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52ed388640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52e8071bb0 0x7f52e8140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52ed388640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52e813dcc0 0x7f52e81e0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52ed388640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52e8143e50 0x7f52e81e0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52ed388640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f52e8070d50 con 0x7f52e813dcc0 2024-09-15T21:55:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52ed388640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f52e8070bd0 con 0x7f52e8143e50 2024-09-15T21:55:51.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52ed388640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f52e81473f0 con 0x7f52e8071bb0 2024-09-15T21:55:51.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52e813dcc0 0x7f52e81e0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52e813dcc0 0x7f52e81e0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35762/0 (socket says 172.21.15.1:35762) 2024-09-15T21:55:51.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e67fc640 1 -- 172.21.15.1:0/3029773816 learned_addr learned my addr 172.21.15.1:0/3029773816 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:51.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e77fe640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52e8143e50 0x7f52e81e0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e6ffd640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52e8071bb0 0x7f52e8140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e67fc640 1 -- 172.21.15.1:0/3029773816 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52e8071bb0 msgr2=0x7f52e8140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e67fc640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52e8071bb0 0x7f52e8140f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e67fc640 1 -- 172.21.15.1:0/3029773816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52e8143e50 msgr2=0x7f52e81e0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e67fc640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52e8143e50 0x7f52e81e0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e67fc640 1 -- 172.21.15.1:0/3029773816 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e814ca30 con 0x7f52e813dcc0 2024-09-15T21:55:51.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e77fe640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52e8143e50 0x7f52e81e0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:51.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e67fc640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52e813dcc0 0x7f52e81e0580 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00c7f0 tx=0x7f52dc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:51.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52cf7fe640 1 -- 172.21.15.1:0/3029773816 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc004230 con 0x7f52e813dcc0 2024-09-15T21:55:51.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52cf7fe640 1 -- 172.21.15.1:0/3029773816 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52dc0043d0 con 0x7f52e813dcc0 2024-09-15T21:55:51.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52cf7fe640 1 -- 172.21.15.1:0/3029773816 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc007a50 con 0x7f52e813dcc0 2024-09-15T21:55:51.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52ed388640 1 -- 172.21.15.1:0/3029773816 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e814d690 con 0x7f52e813dcc0 2024-09-15T21:55:51.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52ed388640 1 -- 172.21.15.1:0/3029773816 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e814d930 con 0x7f52e813dcc0 2024-09-15T21:55:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52ed388640 1 -- 172.21.15.1:0/3029773816 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e813e100 con 0x7f52e813dcc0 2024-09-15T21:55:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52cf7fe640 1 -- 172.21.15.1:0/3029773816 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f52dc007bf0 con 0x7f52e813dcc0 2024-09-15T21:55:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52cf7fe640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f52d40678c0 0x7f52d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52cf7fe640 1 -- 172.21.15.1:0/3029773816 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4857+0+0 (secure 0 0 0) 0x7f52dc085970 con 0x7f52e813dcc0 2024-09-15T21:55:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e6ffd640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f52d40678c0 0x7f52d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.109+0000 7f52e6ffd640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f52d40678c0 0x7f52d4069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f52d80ae000 tx=0x7f52d8004ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:51.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.113+0000 7f52cf7fe640 1 -- 172.21.15.1:0/3029773816 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f52dc015020 con 0x7f52e813dcc0 2024-09-15T21:55:51.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.333+0000 7f52ed388640 1 -- 172.21.15.1:0/3029773816 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f52e80706b0 con 0x7f52e813dcc0 2024-09-15T21:55:51.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.337+0000 7f52cf7fe640 1 -- 172.21.15.1:0/3029773816 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f52dc056890 con 0x7f52e813dcc0 2024-09-15T21:55:51.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.337+0000 7f52ed388640 1 -- 172.21.15.1:0/3029773816 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f52d40678c0 msgr2=0x7f52d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.337+0000 7f52ed388640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f52d40678c0 0x7f52d4069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f52d80ae000 tx=0x7f52d8004ac0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.337+0000 7f52ed388640 1 -- 172.21.15.1:0/3029773816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52e813dcc0 msgr2=0x7f52e81e0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.337+0000 7f52ed388640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52e813dcc0 0x7f52e81e0580 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00c7f0 tx=0x7f52dc00ccb0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.337+0000 7f52ed388640 1 -- 172.21.15.1:0/3029773816 shutdown_connections 2024-09-15T21:55:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.337+0000 7f52ed388640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f52d40678c0 0x7f52d4069d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.337+0000 7f52ed388640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52e8143e50 0x7f52e81e0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.337+0000 7f52ed388640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f52e813dcc0 0x7f52e81e0580 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.337+0000 7f52ed388640 1 --2- 172.21.15.1:0/3029773816 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52e8071bb0 0x7f52e8140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.341+0000 7f52ed388640 1 -- 172.21.15.1:0/3029773816 >> 172.21.15.1:0/3029773816 conn(0x7f52e80b63a0 msgr2=0x7f52e80b7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.341+0000 7f52ed388640 1 -- 172.21.15.1:0/3029773816 shutdown_connections 2024-09-15T21:55:51.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.341+0000 7f52ed388640 1 -- 172.21.15.1:0/3029773816 wait complete. 2024-09-15T21:55:51.359 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-15T21:55:51.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec452e640 1 Processor -- start 2024-09-15T21:55:51.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec452e640 1 -- start start 2024-09-15T21:55:51.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec452e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7feebc06d0d0 0x7feebc0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec452e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feebc149450 0x7feebc09dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec452e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feebc06d5b0 con 0x7feebc0b4560 2024-09-15T21:55:51.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec452e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7feebc06dc00 con 0x7feebc149450 2024-09-15T21:55:51.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec452e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7feebc06d890 con 0x7feebc06d0d0 2024-09-15T21:55:51.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec2acb640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feebc149450 0x7feebc09dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec2acb640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7feebc149450 0x7feebc09dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35764/0 (socket says 172.21.15.1:35764) 2024-09-15T21:55:51.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec2acb640 1 -- 172.21.15.1:0/737637180 learned_addr learned my addr 172.21.15.1:0/737637180 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:51.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec1ac9640 1 --2- 172.21.15.1:0/737637180 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7feebc06d0d0 0x7feebc0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec2acb640 1 -- 172.21.15.1:0/737637180 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7feebc06d0d0 msgr2=0x7feebc0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:51.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec2acb640 1 --2- 172.21.15.1:0/737637180 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7feebc06d0d0 0x7feebc0b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec2acb640 1 -- 172.21.15.1:0/737637180 >> v1:172.21.15.70:6789/0 conn(0x7feebc0b4560 legacy=0x7feebc148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.473+0000 7feec2acb640 1 -- 172.21.15.1:0/737637180 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feebc0b3ad0 con 0x7feebc149450 2024-09-15T21:55:51.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec2acb640 1 --2- 172.21.15.1:0/737637180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feebc149450 0x7feebc09dca0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009e50 tx=0x7feeb401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73600ce5809546f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:51.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec12c8640 1 -- 172.21.15.1:0/737637180 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb40a5770 con 0x7feebc149450 2024-09-15T21:55:51.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec12c8640 1 -- 172.21.15.1:0/737637180 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb40a5910 con 0x7feebc149450 2024-09-15T21:55:51.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec12c8640 1 -- 172.21.15.1:0/737637180 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb40a5ce0 con 0x7feebc149450 2024-09-15T21:55:51.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec452e640 1 -- 172.21.15.1:0/737637180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feebc149450 msgr2=0x7feebc09dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec452e640 1 --2- 172.21.15.1:0/737637180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feebc149450 0x7feebc09dca0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009e50 tx=0x7feeb401c9a0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec452e640 1 -- 172.21.15.1:0/737637180 shutdown_connections 2024-09-15T21:55:51.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec452e640 1 --2- 172.21.15.1:0/737637180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feebc149450 0x7feebc09dca0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec452e640 1 --2- 172.21.15.1:0/737637180 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7feebc06d0d0 0x7feebc0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec452e640 1 -- 172.21.15.1:0/737637180 >> 172.21.15.1:0/737637180 conn(0x7feebc06c730 msgr2=0x7feebc0b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:51.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec452e640 1 -- 172.21.15.1:0/737637180 shutdown_connections 2024-09-15T21:55:51.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec452e640 1 -- 172.21.15.1:0/737637180 wait complete. 2024-09-15T21:55:51.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec452e640 1 Processor -- start 2024-09-15T21:55:51.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.477+0000 7feec452e640 1 -- start start 2024-09-15T21:55:51.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec452e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feebc06d0d0 0x7feebc147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec452e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feebc0b4560 0x7feebc1e1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec452e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7feebc149450 0x7feebc1e1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec452e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feebc152b20 con 0x7feebc0b4560 2024-09-15T21:55:51.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec452e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1529a0 con 0x7feebc06d0d0 2024-09-15T21:55:51.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec452e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7feebc152ca0 con 0x7feebc149450 2024-09-15T21:55:51.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec1ac9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feebc0b4560 0x7feebc1e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec1ac9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feebc0b4560 0x7feebc1e1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35776/0 (socket says 172.21.15.1:35776) 2024-09-15T21:55:51.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec1ac9640 1 -- 172.21.15.1:0/868656241 learned_addr learned my addr 172.21.15.1:0/868656241 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:51.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec22ca640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feebc06d0d0 0x7feebc147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec2acb640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7feebc149450 0x7feebc1e1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec1ac9640 1 -- 172.21.15.1:0/868656241 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7feebc149450 msgr2=0x7feebc1e1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec1ac9640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7feebc149450 0x7feebc1e1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec1ac9640 1 -- 172.21.15.1:0/868656241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feebc06d0d0 msgr2=0x7feebc147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec1ac9640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feebc06d0d0 0x7feebc147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec1ac9640 1 -- 172.21.15.1:0/868656241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feebc1410a0 con 0x7feebc0b4560 2024-09-15T21:55:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec2acb640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7feebc149450 0x7feebc1e1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec1ac9640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feebc0b4560 0x7feebc1e1310 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feeac00d800 tx=0x7feeac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feeb2ffd640 1 -- 172.21.15.1:0/868656241 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac00b6c0 con 0x7feebc0b4560 2024-09-15T21:55:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feeb2ffd640 1 -- 172.21.15.1:0/868656241 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac019070 con 0x7feebc0b4560 2024-09-15T21:55:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec452e640 1 -- 172.21.15.1:0/868656241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feebc141660 con 0x7feebc0b4560 2024-09-15T21:55:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feeb2ffd640 1 -- 172.21.15.1:0/868656241 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac00ba60 con 0x7feebc0b4560 2024-09-15T21:55:51.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec452e640 1 -- 172.21.15.1:0/868656241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feebc1de490 con 0x7feebc0b4560 2024-09-15T21:55:51.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec452e640 1 -- 172.21.15.1:0/868656241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feebc0b4940 con 0x7feebc0b4560 2024-09-15T21:55:51.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feeb2ffd640 1 -- 172.21.15.1:0/868656241 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feeac00bc00 con 0x7feebc0b4560 2024-09-15T21:55:51.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feeb2ffd640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7feea00678f0 0x7feea0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feeb2ffd640 1 -- 172.21.15.1:0/868656241 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4857+0+0 (secure 0 0 0) 0x7feeac085d10 con 0x7feebc0b4560 2024-09-15T21:55:51.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec22ca640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7feea00678f0 0x7feea0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.481+0000 7feec22ca640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7feea00678f0 0x7feea0069db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feeb8001810 tx=0x7feeb8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:51.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.485+0000 7feeb2ffd640 1 -- 172.21.15.1:0/868656241 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feeac056bb0 con 0x7feebc0b4560 2024-09-15T21:55:51.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.701+0000 7feec452e640 1 -- 172.21.15.1:0/868656241 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7feebc141380 con 0x7feebc0b4560 2024-09-15T21:55:51.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.705+0000 7feeb2ffd640 1 -- 172.21.15.1:0/868656241 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7feeac0564b0 con 0x7feebc0b4560 2024-09-15T21:55:51.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.705+0000 7feec452e640 1 -- 172.21.15.1:0/868656241 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7feea00678f0 msgr2=0x7feea0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.705+0000 7feec452e640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7feea00678f0 0x7feea0069db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feeb8001810 tx=0x7feeb8009040 comp rx=0 tx=0).stop 2024-09-15T21:55:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.705+0000 7feec452e640 1 -- 172.21.15.1:0/868656241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feebc0b4560 msgr2=0x7feebc1e1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.705+0000 7feec452e640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feebc0b4560 0x7feebc1e1310 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feeac00d800 tx=0x7feeac00dcc0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.705+0000 7feec452e640 1 -- 172.21.15.1:0/868656241 shutdown_connections 2024-09-15T21:55:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.705+0000 7feec452e640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7feebc149450 0x7feebc1e1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.705+0000 7feec452e640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feebc0b4560 0x7feebc1e1310 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.705+0000 7feec452e640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7feea00678f0 0x7feea0069db0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.705+0000 7feec452e640 1 --2- 172.21.15.1:0/868656241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feebc06d0d0 0x7feebc147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.705+0000 7feec452e640 1 -- 172.21.15.1:0/868656241 >> 172.21.15.1:0/868656241 conn(0x7feebc06c730 msgr2=0x7feebc1448d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:51.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.705+0000 7feec452e640 1 -- 172.21.15.1:0/868656241 shutdown_connections 2024-09-15T21:55:51.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.705+0000 7feec452e640 1 -- 172.21.15.1:0/868656241 wait complete. 2024-09-15T21:55:51.726 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-15T21:55:51.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62c1686640 1 Processor -- start 2024-09-15T21:55:51.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62c1686640 1 -- start start 2024-09-15T21:55:51.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62c1686640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f62bc0b4560 0x7f62bc0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62c1686640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f62bc06d0d0 0x7f62bc148d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62c1686640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62bc1496f0 con 0x7f62bc149280 2024-09-15T21:55:51.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62c1686640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f62bc06dc00 con 0x7f62bc06d0d0 2024-09-15T21:55:51.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62c1686640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f62bc06d5b0 con 0x7f62bc0b4560 2024-09-15T21:55:51.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62ba7fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f62bc06d0d0 0x7f62bc148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62bb7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f62bc149280 0x7f62bc09dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37906/0 (socket says 172.21.15.1:37906) 2024-09-15T21:55:51.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62bb7fe640 1 -- 172.21.15.1:0/2597191650 learned_addr learned my addr 172.21.15.1:0/2597191650 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:51.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62baffd640 1 --2- 172.21.15.1:0/2597191650 >> v2:172.21.15.70:3300/0 conn(0x7f62bc0b4560 0x7f62bc0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62b9ffb640 1 -- 172.21.15.1:0/2597191650 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031595500 0 0) 0x7f62bc1496f0 con 0x7f62bc149280 2024-09-15T21:55:51.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62b9ffb640 1 -- 172.21.15.1:0/2597191650 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62a4003530 con 0x7f62bc149280 2024-09-15T21:55:51.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62ba7fc640 1 -- 172.21.15.1:0/2597191650 >> v2:172.21.15.70:3300/0 conn(0x7f62bc0b4560 msgr2=0x7f62bc0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:51.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62ba7fc640 1 --2- 172.21.15.1:0/2597191650 >> v2:172.21.15.70:3300/0 conn(0x7f62bc0b4560 0x7f62bc0b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62ba7fc640 1 -- 172.21.15.1:0/2597191650 >> v1:172.21.15.1:6789/0 conn(0x7f62bc149280 legacy=0x7f62bc09dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.833+0000 7f62ba7fc640 1 -- 172.21.15.1:0/2597191650 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62bc06d890 con 0x7f62bc06d0d0 2024-09-15T21:55:51.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62ba7fc640 1 --2- 172.21.15.1:0/2597191650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc06d0d0 0x7f62bc148d40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0b03d0 tx=0x7f62b001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cedd749d1ebdb30 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:51.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62b9ffb640 1 -- 172.21.15.1:0/2597191650 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b00b0070 con 0x7f62bc06d0d0 2024-09-15T21:55:51.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62b9ffb640 1 -- 172.21.15.1:0/2597191650 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b00ab600 con 0x7f62bc06d0d0 2024-09-15T21:55:51.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62b9ffb640 1 -- 172.21.15.1:0/2597191650 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b00ab9d0 con 0x7f62bc06d0d0 2024-09-15T21:55:51.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 -- 172.21.15.1:0/2597191650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc06d0d0 msgr2=0x7f62bc148d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 --2- 172.21.15.1:0/2597191650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc06d0d0 0x7f62bc148d40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0b03d0 tx=0x7f62b001c3f0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 -- 172.21.15.1:0/2597191650 shutdown_connections 2024-09-15T21:55:51.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 --2- 172.21.15.1:0/2597191650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc06d0d0 0x7f62bc148d40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 --2- 172.21.15.1:0/2597191650 >> v2:172.21.15.70:3300/0 conn(0x7f62bc0b4560 0x7f62bc0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 -- 172.21.15.1:0/2597191650 >> 172.21.15.1:0/2597191650 conn(0x7f62bc06c730 msgr2=0x7f62bc0b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:51.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 -- 172.21.15.1:0/2597191650 shutdown_connections 2024-09-15T21:55:51.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 -- 172.21.15.1:0/2597191650 wait complete. 2024-09-15T21:55:51.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 Processor -- start 2024-09-15T21:55:51.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 -- start start 2024-09-15T21:55:51.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62bc06d0d0 0x7f62bc0af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62bc0b4560 0x7f62bc140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc149280 0x7f62bc1411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc152b20 con 0x7f62bc149280 2024-09-15T21:55:51.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f62bc1529a0 con 0x7f62bc06d0d0 2024-09-15T21:55:51.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62c1686640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f62bc152ca0 con 0x7f62bc0b4560 2024-09-15T21:55:51.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62bb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc149280 0x7f62bc1411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62bb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc149280 0x7f62bc1411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35782/0 (socket says 172.21.15.1:35782) 2024-09-15T21:55:51.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62bb7fe640 1 -- 172.21.15.1:0/3307154661 learned_addr learned my addr 172.21.15.1:0/3307154661 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:51.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.837+0000 7f62baffd640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62bc06d0d0 0x7f62bc0af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62ba7fc640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62bc0b4560 0x7f62bc140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62bb7fe640 1 -- 172.21.15.1:0/3307154661 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62bc0b4560 msgr2=0x7f62bc140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62bb7fe640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62bc0b4560 0x7f62bc140c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62bb7fe640 1 -- 172.21.15.1:0/3307154661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62bc06d0d0 msgr2=0x7f62bc0af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:51.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62bb7fe640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62bc06d0d0 0x7f62bc0af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:51.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62bb7fe640 1 -- 172.21.15.1:0/3307154661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62bc1423a0 con 0x7f62bc149280 2024-09-15T21:55:51.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62baffd640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62bc06d0d0 0x7f62bc0af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:51.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62bb7fe640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc149280 0x7f62bc1411c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f62b400ca20 tx=0x7f62b400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:51.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62a37fe640 1 -- 172.21.15.1:0/3307154661 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b4017070 con 0x7f62bc149280 2024-09-15T21:55:51.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62a37fe640 1 -- 172.21.15.1:0/3307154661 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b400abd0 con 0x7f62bc149280 2024-09-15T21:55:51.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62a37fe640 1 -- 172.21.15.1:0/3307154661 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b4012400 con 0x7f62bc149280 2024-09-15T21:55:51.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62c1686640 1 -- 172.21.15.1:0/3307154661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62bc14f030 con 0x7f62bc149280 2024-09-15T21:55:51.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62c1686640 1 -- 172.21.15.1:0/3307154661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62bc14f990 con 0x7f62bc149280 2024-09-15T21:55:51.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62c1686640 1 -- 172.21.15.1:0/3307154661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62bc148d40 con 0x7f62bc149280 2024-09-15T21:55:51.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62a37fe640 1 -- 172.21.15.1:0/3307154661 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f62b401a070 con 0x7f62bc149280 2024-09-15T21:55:51.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62a37fe640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f62a80678c0 0x7f62a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:51.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62a37fe640 1 -- 172.21.15.1:0/3307154661 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4857+0+0 (secure 0 0 0) 0x7f62b4085620 con 0x7f62bc149280 2024-09-15T21:55:51.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62baffd640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f62a80678c0 0x7f62a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:51.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.841+0000 7f62baffd640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f62a80678c0 0x7f62a8069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0af510 tx=0x7f62ac008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:51.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:51.845+0000 7f62a37fe640 1 -- 172.21.15.1:0/3307154661 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f62b4056540 con 0x7f62bc149280 2024-09-15T21:55:52.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.069+0000 7f62c1686640 1 -- 172.21.15.1:0/3307154661 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f62bc142610 con 0x7f62bc149280 2024-09-15T21:55:52.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.069+0000 7f62a37fe640 1 -- 172.21.15.1:0/3307154661 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f62b4055e40 con 0x7f62bc149280 2024-09-15T21:55:52.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.073+0000 7f62c1686640 1 -- 172.21.15.1:0/3307154661 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f62a80678c0 msgr2=0x7f62a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.073+0000 7f62c1686640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f62a80678c0 0x7f62a8069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0af510 tx=0x7f62ac008040 comp rx=0 tx=0).stop 2024-09-15T21:55:52.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.073+0000 7f62c1686640 1 -- 172.21.15.1:0/3307154661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc149280 msgr2=0x7f62bc1411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.073+0000 7f62c1686640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc149280 0x7f62bc1411c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f62b400ca20 tx=0x7f62b400cee0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.073+0000 7f62c1686640 1 -- 172.21.15.1:0/3307154661 shutdown_connections 2024-09-15T21:55:52.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.073+0000 7f62c1686640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f62bc149280 0x7f62bc1411c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.073+0000 7f62c1686640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62bc0b4560 0x7f62bc140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.073+0000 7f62c1686640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f62a80678c0 0x7f62a8069d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.073+0000 7f62c1686640 1 --2- 172.21.15.1:0/3307154661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62bc06d0d0 0x7f62bc0af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.073+0000 7f62c1686640 1 -- 172.21.15.1:0/3307154661 >> 172.21.15.1:0/3307154661 conn(0x7f62bc06c730 msgr2=0x7f62bc144070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:52.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.073+0000 7f62c1686640 1 -- 172.21.15.1:0/3307154661 shutdown_connections 2024-09-15T21:55:52.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.073+0000 7f62c1686640 1 -- 172.21.15.1:0/3307154661 wait complete. 2024-09-15T21:55:52.092 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-15T21:55:52.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.209+0000 7f3e65779640 1 Processor -- start 2024-09-15T21:55:52.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.209+0000 7f3e65779640 1 -- start start 2024-09-15T21:55:52.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.209+0000 7f3e65779640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3e6006dbc0 0x7f3e600b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.209+0000 7f3e65779640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e600af2a0 0x7f3e60144430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.209+0000 7f3e65779640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e6006dfa0 con 0x7f3e60144970 2024-09-15T21:55:52.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.209+0000 7f3e65779640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f3e600b00e0 con 0x7f3e6006dbc0 2024-09-15T21:55:52.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.209+0000 7f3e65779640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3e60144db0 con 0x7f3e600af2a0 2024-09-15T21:55:52.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.209+0000 7f3e5effd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3e6006dbc0 0x7f3e600b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.209+0000 7f3e5e7fc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e600af2a0 0x7f3e60144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.209+0000 7f3e5effd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3e6006dbc0 0x7f3e600b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:49870/0 (socket says 172.21.15.1:49870) 2024-09-15T21:55:52.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.209+0000 7f3e5effd640 1 -- 172.21.15.1:0/144445281 learned_addr learned my addr 172.21.15.1:0/144445281 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:52.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.209+0000 7f3e5e7fc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e600af2a0 0x7f3e60144430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:33246/0 (socket says 172.21.15.1:33246) 2024-09-15T21:55:52.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.209+0000 7f3e5f7fe640 1 --1- 172.21.15.1:0/144445281 >> v1:172.21.15.70:6789/0 conn(0x7f3e60144970 0x7f3e60147320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.1:47444/0 (socket says 172.21.15.1:47444) 2024-09-15T21:55:52.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e5e7fc640 1 -- 172.21.15.1:0/144445281 >> v2:172.21.15.70:3300/0 conn(0x7f3e6006dbc0 msgr2=0x7f3e600b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:52.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e5e7fc640 1 --2- 172.21.15.1:0/144445281 >> v2:172.21.15.70:3300/0 conn(0x7f3e6006dbc0 0x7f3e600b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e5e7fc640 1 -- 172.21.15.1:0/144445281 >> v1:172.21.15.70:6789/0 conn(0x7f3e60144970 legacy=0x7f3e60147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e5e7fc640 1 -- 172.21.15.1:0/144445281 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e600b55d0 con 0x7f3e600af2a0 2024-09-15T21:55:52.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e5effd640 1 --2- 172.21.15.1:0/144445281 >> v2:172.21.15.70:3300/0 conn(0x7f3e6006dbc0 0x7f3e600b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:55:52.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e5e7fc640 1 --2- 172.21.15.1:0/144445281 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e600af2a0 0x7f3e60144430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3e480097c0 tx=0x7f3e4801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6752ff3f56ca1c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:52.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e5dffb640 1 -- 172.21.15.1:0/144445281 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e480b0070 con 0x7f3e600af2a0 2024-09-15T21:55:52.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e5dffb640 1 -- 172.21.15.1:0/144445281 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e480ab600 con 0x7f3e600af2a0 2024-09-15T21:55:52.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e5dffb640 1 -- 172.21.15.1:0/144445281 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e480ab9d0 con 0x7f3e600af2a0 2024-09-15T21:55:52.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e65779640 1 -- 172.21.15.1:0/144445281 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e600af2a0 msgr2=0x7f3e60144430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e65779640 1 --2- 172.21.15.1:0/144445281 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e600af2a0 0x7f3e60144430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3e480097c0 tx=0x7f3e4801c410 comp rx=0 tx=0).stop 2024-09-15T21:55:52.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e65779640 1 -- 172.21.15.1:0/144445281 shutdown_connections 2024-09-15T21:55:52.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e65779640 1 --2- 172.21.15.1:0/144445281 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e600af2a0 0x7f3e60144430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e65779640 1 --2- 172.21.15.1:0/144445281 >> v2:172.21.15.70:3300/0 conn(0x7f3e6006dbc0 0x7f3e600b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e65779640 1 -- 172.21.15.1:0/144445281 >> 172.21.15.1:0/144445281 conn(0x7f3e6006c730 msgr2=0x7f3e600b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:52.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e65779640 1 -- 172.21.15.1:0/144445281 shutdown_connections 2024-09-15T21:55:52.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.213+0000 7f3e65779640 1 -- 172.21.15.1:0/144445281 wait complete. 2024-09-15T21:55:52.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e65779640 1 Processor -- start 2024-09-15T21:55:52.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e65779640 1 -- start start 2024-09-15T21:55:52.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e65779640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e6006dbc0 0x7f3e600b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e65779640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e600af2a0 0x7f3e60072a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e65779640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e60144970 0x7f3e60070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e65779640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6009be30 con 0x7f3e60144970 2024-09-15T21:55:52.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e65779640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6009e640 con 0x7f3e600af2a0 2024-09-15T21:55:52.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e65779640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3e600af6c0 con 0x7f3e6006dbc0 2024-09-15T21:55:52.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e5f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e60144970 0x7f3e60070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e5f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e60144970 0x7f3e60070940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35794/0 (socket says 172.21.15.1:35794) 2024-09-15T21:55:52.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e5f7fe640 1 -- 172.21.15.1:0/4269030252 learned_addr learned my addr 172.21.15.1:0/4269030252 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:52.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e5e7fc640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e600af2a0 0x7f3e60072a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e5effd640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e6006dbc0 0x7f3e600b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e5f7fe640 1 -- 172.21.15.1:0/4269030252 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e6006dbc0 msgr2=0x7f3e600b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e5f7fe640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e6006dbc0 0x7f3e600b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e5f7fe640 1 -- 172.21.15.1:0/4269030252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e600af2a0 msgr2=0x7f3e60072a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e5f7fe640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e600af2a0 0x7f3e60072a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e5f7fe640 1 -- 172.21.15.1:0/4269030252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e600b05a0 con 0x7f3e60144970 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e5effd640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e6006dbc0 0x7f3e600b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e5f7fe640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e60144970 0x7f3e60070940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800c3c0 tx=0x7f3e5800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e577fe640 1 -- 172.21.15.1:0/4269030252 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e580074e0 con 0x7f3e60144970 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e577fe640 1 -- 172.21.15.1:0/4269030252 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e58007680 con 0x7f3e60144970 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e65779640 1 -- 172.21.15.1:0/4269030252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e600b8930 con 0x7f3e60144970 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e577fe640 1 -- 172.21.15.1:0/4269030252 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e58004a10 con 0x7f3e60144970 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e65779640 1 -- 172.21.15.1:0/4269030252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e60072fa0 con 0x7f3e60144970 2024-09-15T21:55:52.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e65779640 1 -- 172.21.15.1:0/4269030252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e60144430 con 0x7f3e60144970 2024-09-15T21:55:52.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e577fe640 1 -- 172.21.15.1:0/4269030252 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3e5801a020 con 0x7f3e60144970 2024-09-15T21:55:52.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.217+0000 7f3e577fe640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3e400678c0 0x7f3e40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.221+0000 7f3e577fe640 1 -- 172.21.15.1:0/4269030252 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4857+0+0 (secure 0 0 0) 0x7f3e58084f80 con 0x7f3e60144970 2024-09-15T21:55:52.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.221+0000 7f3e5effd640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3e400678c0 0x7f3e40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.221+0000 7f3e5effd640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3e400678c0 0x7f3e40069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009240 tx=0x7f3e5000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:52.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.225+0000 7f3e577fe640 1 -- 172.21.15.1:0/4269030252 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3e58055ea0 con 0x7f3e60144970 2024-09-15T21:55:52.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.449+0000 7f3e65779640 1 -- 172.21.15.1:0/4269030252 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f3e60075860 con 0x7f3e60144970 2024-09-15T21:55:52.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.453+0000 7f3e577fe640 1 -- 172.21.15.1:0/4269030252 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f3e580557a0 con 0x7f3e60144970 2024-09-15T21:55:52.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.453+0000 7f3e65779640 1 -- 172.21.15.1:0/4269030252 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3e400678c0 msgr2=0x7f3e40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.453+0000 7f3e65779640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3e400678c0 0x7f3e40069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009240 tx=0x7f3e5000b040 comp rx=0 tx=0).stop 2024-09-15T21:55:52.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.453+0000 7f3e65779640 1 -- 172.21.15.1:0/4269030252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e60144970 msgr2=0x7f3e60070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.453+0000 7f3e65779640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e60144970 0x7f3e60070940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800c3c0 tx=0x7f3e5800c880 comp rx=0 tx=0).stop 2024-09-15T21:55:52.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.453+0000 7f3e65779640 1 -- 172.21.15.1:0/4269030252 shutdown_connections 2024-09-15T21:55:52.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.453+0000 7f3e65779640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e60144970 0x7f3e60070940 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.453+0000 7f3e65779640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3e400678c0 0x7f3e40069d80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.453+0000 7f3e65779640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e600af2a0 0x7f3e60072a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.453+0000 7f3e65779640 1 --2- 172.21.15.1:0/4269030252 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3e6006dbc0 0x7f3e600b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.453+0000 7f3e65779640 1 -- 172.21.15.1:0/4269030252 >> 172.21.15.1:0/4269030252 conn(0x7f3e6006c730 msgr2=0x7f3e6009aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:52.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.453+0000 7f3e65779640 1 -- 172.21.15.1:0/4269030252 shutdown_connections 2024-09-15T21:55:52.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.453+0000 7f3e65779640 1 -- 172.21.15.1:0/4269030252 wait complete. 2024-09-15T21:55:52.475 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-15T21:55:52.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.593+0000 7f083df90640 1 Processor -- start 2024-09-15T21:55:52.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.593+0000 7f083df90640 1 -- start start 2024-09-15T21:55:52.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f083df90640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f08380b5560 0x7f08380ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f083df90640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f083806d0d0 0x7f08380afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f083df90640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08380b5940 con 0x7f083813e570 2024-09-15T21:55:52.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f083df90640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f08380b0300 con 0x7f08380b5560 2024-09-15T21:55:52.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f083df90640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f083806dbd0 con 0x7f083806d0d0 2024-09-15T21:55:52.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f08377fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f08380b5560 0x7f08380ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f08377fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f08380b5560 0x7f08380ae0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35804/0 (socket says 172.21.15.1:35804) 2024-09-15T21:55:52.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f08377fe640 1 -- 172.21.15.1:0/4095062721 learned_addr learned my addr 172.21.15.1:0/4095062721 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:52.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f0836ffd640 1 --2- 172.21.15.1:0/4095062721 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f083806d0d0 0x7f08380afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f08377fe640 1 -- 172.21.15.1:0/4095062721 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f083806d0d0 msgr2=0x7f08380afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:52.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f08377fe640 1 --2- 172.21.15.1:0/4095062721 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f083806d0d0 0x7f08380afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f08377fe640 1 -- 172.21.15.1:0/4095062721 >> v1:172.21.15.70:6789/0 conn(0x7f083813e570 legacy=0x7f08380b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:52.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f08377fe640 1 -- 172.21.15.1:0/4095062721 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083806deb0 con 0x7f08380b5560 2024-09-15T21:55:52.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f08377fe640 1 --2- 172.21.15.1:0/4095062721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08380b5560 0x7f08380ae0f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0828009870 tx=0x7f082801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c367b3348cbb873 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:52.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f08367fc640 1 -- 172.21.15.1:0/4095062721 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08280b0070 con 0x7f08380b5560 2024-09-15T21:55:52.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f08367fc640 1 -- 172.21.15.1:0/4095062721 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08280ab600 con 0x7f08380b5560 2024-09-15T21:55:52.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.597+0000 7f08367fc640 1 -- 172.21.15.1:0/4095062721 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08280ab9d0 con 0x7f08380b5560 2024-09-15T21:55:52.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 -- 172.21.15.1:0/4095062721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08380b5560 msgr2=0x7f08380ae0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 --2- 172.21.15.1:0/4095062721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08380b5560 0x7f08380ae0f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0828009870 tx=0x7f082801c490 comp rx=0 tx=0).stop 2024-09-15T21:55:52.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 -- 172.21.15.1:0/4095062721 shutdown_connections 2024-09-15T21:55:52.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 --2- 172.21.15.1:0/4095062721 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f083806d0d0 0x7f08380afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 --2- 172.21.15.1:0/4095062721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f08380b5560 0x7f08380ae0f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 -- 172.21.15.1:0/4095062721 >> 172.21.15.1:0/4095062721 conn(0x7f083806c730 msgr2=0x7f08380b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:52.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 -- 172.21.15.1:0/4095062721 shutdown_connections 2024-09-15T21:55:52.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 -- 172.21.15.1:0/4095062721 wait complete. 2024-09-15T21:55:52.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 Processor -- start 2024-09-15T21:55:52.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 -- start start 2024-09-15T21:55:52.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f083806d0d0 0x7f08380b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08380b5560 0x7f0838141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f083813e570 0x7f083813f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0838151f60 con 0x7f083813e570 2024-09-15T21:55:52.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0838151de0 con 0x7f08380b5560 2024-09-15T21:55:52.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f08381520e0 con 0x7f083806d0d0 2024-09-15T21:55:52.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f0837fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f083813e570 0x7f083813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f0837fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f083813e570 0x7f083813f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35814/0 (socket says 172.21.15.1:35814) 2024-09-15T21:55:52.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f0837fff640 1 -- 172.21.15.1:0/3527908900 learned_addr learned my addr 172.21.15.1:0/3527908900 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:52.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f0836ffd640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08380b5560 0x7f0838141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f08377fe640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f083806d0d0 0x7f08380b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f0837fff640 1 -- 172.21.15.1:0/3527908900 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f083806d0d0 msgr2=0x7f08380b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f0837fff640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f083806d0d0 0x7f08380b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f0837fff640 1 -- 172.21.15.1:0/3527908900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08380b5560 msgr2=0x7f0838141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f0837fff640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08380b5560 0x7f0838141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f0837fff640 1 -- 172.21.15.1:0/3527908900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083813ee90 con 0x7f083813e570 2024-09-15T21:55:52.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f0837fff640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f083813e570 0x7f083813f390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f083000b970 tx=0x7f083000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:52.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f081ffff640 1 -- 172.21.15.1:0/3527908900 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830019070 con 0x7f083813e570 2024-09-15T21:55:52.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f081ffff640 1 -- 172.21.15.1:0/3527908900 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f083000cb40 con 0x7f083813e570 2024-09-15T21:55:52.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 -- 172.21.15.1:0/3527908900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0838141a10 con 0x7f083813e570 2024-09-15T21:55:52.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f081ffff640 1 -- 172.21.15.1:0/3527908900 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830014440 con 0x7f083813e570 2024-09-15T21:55:52.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 -- 172.21.15.1:0/3527908900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0838141560 con 0x7f083813e570 2024-09-15T21:55:52.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.601+0000 7f083df90640 1 -- 172.21.15.1:0/3527908900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08380afdc0 con 0x7f083813e570 2024-09-15T21:55:52.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.605+0000 7f081ffff640 1 -- 172.21.15.1:0/3527908900 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f083001c070 con 0x7f083813e570 2024-09-15T21:55:52.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.605+0000 7f081ffff640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f08240678c0 0x7f0824069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.605+0000 7f081ffff640 1 -- 172.21.15.1:0/3527908900 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4857+0+0 (secure 0 0 0) 0x7f0830085570 con 0x7f083813e570 2024-09-15T21:55:52.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.605+0000 7f08377fe640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f08240678c0 0x7f0824069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.605+0000 7f08377fe640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f08240678c0 0x7f0824069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f08280ad000 tx=0x7f08280a4f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:52.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.609+0000 7f081ffff640 1 -- 172.21.15.1:0/3527908900 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0830056400 con 0x7f083813e570 2024-09-15T21:55:52.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.829+0000 7f083df90640 1 -- 172.21.15.1:0/3527908900 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f08380af350 con 0x7f083813e570 2024-09-15T21:55:52.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.833+0000 7f081ffff640 1 -- 172.21.15.1:0/3527908900 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f0830055d00 con 0x7f083813e570 2024-09-15T21:55:52.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.833+0000 7f083df90640 1 -- 172.21.15.1:0/3527908900 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f08240678c0 msgr2=0x7f0824069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.833+0000 7f083df90640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f08240678c0 0x7f0824069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f08280ad000 tx=0x7f08280a4f90 comp rx=0 tx=0).stop 2024-09-15T21:55:52.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.833+0000 7f083df90640 1 -- 172.21.15.1:0/3527908900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f083813e570 msgr2=0x7f083813f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.833+0000 7f083df90640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f083813e570 0x7f083813f390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f083000b970 tx=0x7f083000be30 comp rx=0 tx=0).stop 2024-09-15T21:55:52.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.833+0000 7f083df90640 1 -- 172.21.15.1:0/3527908900 shutdown_connections 2024-09-15T21:55:52.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.833+0000 7f083df90640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f083813e570 0x7f083813f390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.833+0000 7f083df90640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f08240678c0 0x7f0824069d80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.833+0000 7f083df90640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08380b5560 0x7f0838141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.833+0000 7f083df90640 1 --2- 172.21.15.1:0/3527908900 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f083806d0d0 0x7f08380b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.837+0000 7f083df90640 1 -- 172.21.15.1:0/3527908900 >> 172.21.15.1:0/3527908900 conn(0x7f083806c730 msgr2=0x7f08380b7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:52.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.837+0000 7f083df90640 1 -- 172.21.15.1:0/3527908900 shutdown_connections 2024-09-15T21:55:52.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.837+0000 7f083df90640 1 -- 172.21.15.1:0/3527908900 wait complete. 2024-09-15T21:55:52.858 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T21:55:52.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.969+0000 7f4603fd6640 1 Processor -- start 2024-09-15T21:55:52.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.969+0000 7f4603fd6640 1 -- start start 2024-09-15T21:55:52.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.969+0000 7f4603fd6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f45fc0b5220 0x7f45fc09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.969+0000 7f4603fd6640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45fc09f520 con 0x7f45fc0b5600 2024-09-15T21:55:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.969+0000 7f4603fd6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45fc0b6a50 con 0x7f45fc148f20 2024-09-15T21:55:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.969+0000 7f4603fd6640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f45fc09b800 con 0x7f45fc0b5220 2024-09-15T21:55:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.969+0000 7f4601d72640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f45fc0b5220 0x7f45fc09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.969+0000 7f4601571640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f45fc0b5600 0x7f45fc09ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37918/0 (socket says 172.21.15.1:37918) 2024-09-15T21:55:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.969+0000 7f4601571640 1 -- 172.21.15.1:0/707051338 learned_addr learned my addr 172.21.15.1:0/707051338 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.969+0000 7f4601d72640 1 -- 172.21.15.1:0/707051338 >> v1:172.21.15.70:6789/0 conn(0x7f45fc148f20 legacy=0x7f45fc149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.969+0000 7f4601d72640 1 -- 172.21.15.1:0/707051338 >> v1:172.21.15.1:6789/0 conn(0x7f45fc0b5600 legacy=0x7f45fc09ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.969+0000 7f4601d72640 1 -- 172.21.15.1:0/707051338 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc09af90 con 0x7f45fc0b5220 2024-09-15T21:55:52.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4601d72640 1 --2- 172.21.15.1:0/707051338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45fc0b5220 0x7f45fc09aa50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f45f80097c0 tx=0x7f45f801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb8eb3bc1d57d93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:52.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4600d70640 1 -- 172.21.15.1:0/707051338 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f80b0070 con 0x7f45fc0b5220 2024-09-15T21:55:52.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4600d70640 1 -- 172.21.15.1:0/707051338 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f80ab600 con 0x7f45fc0b5220 2024-09-15T21:55:52.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4600d70640 1 -- 172.21.15.1:0/707051338 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f80ab9d0 con 0x7f45fc0b5220 2024-09-15T21:55:52.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 -- 172.21.15.1:0/707051338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45fc0b5220 msgr2=0x7f45fc09aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 --2- 172.21.15.1:0/707051338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45fc0b5220 0x7f45fc09aa50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f45f80097c0 tx=0x7f45f801c340 comp rx=0 tx=0).stop 2024-09-15T21:55:52.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 -- 172.21.15.1:0/707051338 shutdown_connections 2024-09-15T21:55:52.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 --2- 172.21.15.1:0/707051338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45fc0b5220 0x7f45fc09aa50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 -- 172.21.15.1:0/707051338 >> 172.21.15.1:0/707051338 conn(0x7f45fc0b5c40 msgr2=0x7f45fc0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:52.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 -- 172.21.15.1:0/707051338 shutdown_connections 2024-09-15T21:55:52.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 -- 172.21.15.1:0/707051338 wait complete. 2024-09-15T21:55:52.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 Processor -- start 2024-09-15T21:55:52.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 -- start start 2024-09-15T21:55:52.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45fc0b5220 0x7f45fc137780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45fc0b5600 0x7f45fc135e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45fc148f20 0x7f45fc1363b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc153aa0 con 0x7f45fc0b5220 2024-09-15T21:55:52.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc153920 con 0x7f45fc148f20 2024-09-15T21:55:52.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4603fd6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f45fc153c20 con 0x7f45fc0b5600 2024-09-15T21:55:52.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4601d72640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45fc0b5220 0x7f45fc137780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4601d72640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45fc0b5220 0x7f45fc137780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35824/0 (socket says 172.21.15.1:35824) 2024-09-15T21:55:52.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.973+0000 7f4601d72640 1 -- 172.21.15.1:0/3273382291 learned_addr learned my addr 172.21.15.1:0/3273382291 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:52.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f4601571640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45fc0b5600 0x7f45fc135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f4602573640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45fc148f20 0x7f45fc1363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f4601d72640 1 -- 172.21.15.1:0/3273382291 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45fc0b5600 msgr2=0x7f45fc135e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f4601d72640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45fc0b5600 0x7f45fc135e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f4601d72640 1 -- 172.21.15.1:0/3273382291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45fc148f20 msgr2=0x7f45fc1363b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:52.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f4601d72640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45fc148f20 0x7f45fc1363b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:52.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f4601d72640 1 -- 172.21.15.1:0/3273382291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc072540 con 0x7f45fc0b5220 2024-09-15T21:55:52.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f4601d72640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45fc0b5220 0x7f45fc137780 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f45f80ae040 tx=0x7f45f801ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:52.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f45f27fc640 1 -- 172.21.15.1:0/3273382291 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f80b0050 con 0x7f45fc0b5220 2024-09-15T21:55:52.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f45f27fc640 1 -- 172.21.15.1:0/3273382291 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f80bc070 con 0x7f45fc0b5220 2024-09-15T21:55:52.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f45f27fc640 1 -- 172.21.15.1:0/3273382291 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f80b5a50 con 0x7f45fc0b5220 2024-09-15T21:55:52.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f4603fd6640 1 -- 172.21.15.1:0/3273382291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45fc072820 con 0x7f45fc0b5220 2024-09-15T21:55:52.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f4603fd6640 1 -- 172.21.15.1:0/3273382291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45fc070620 con 0x7f45fc0b5220 2024-09-15T21:55:52.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f4603fd6640 1 -- 172.21.15.1:0/3273382291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45fc09aa50 con 0x7f45fc0b5220 2024-09-15T21:55:52.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f45f27fc640 1 -- 172.21.15.1:0/3273382291 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f45f80ab4c0 con 0x7f45fc0b5220 2024-09-15T21:55:52.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f45f27fc640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f45e00678c0 0x7f45e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:52.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f45f27fc640 1 -- 172.21.15.1:0/3273382291 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4857+0+0 (secure 0 0 0) 0x7f45f8120c30 con 0x7f45fc0b5220 2024-09-15T21:55:52.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f4601571640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f45e00678c0 0x7f45e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:52.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.977+0000 7f4601571640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f45e00678c0 0x7f45e0069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f45fc1380d0 tx=0x7f45ec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:52.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:52.981+0000 7f45f27fc640 1 -- 172.21.15.1:0/3273382291 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f45f8016050 con 0x7f45fc0b5220 2024-09-15T21:55:53.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.141+0000 7f4603fd6640 1 -- 172.21.15.1:0/3273382291 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f45fc136bc0 con 0x7f45fc0b5220 2024-09-15T21:55:53.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.141+0000 7f45f27fc640 1 -- 172.21.15.1:0/3273382291 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v26) ==== 84+0+65 (secure 0 0 0) 0x7f45f80f1b30 con 0x7f45fc0b5220 2024-09-15T21:55:53.146 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:53.146 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2024-09-15T21:55:53.146 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-15T21:55:53.146 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2024-09-15T21:55:53.146 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": ".mgr" 2024-09-15T21:55:53.146 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:55:53.146 INFO:teuthology.orchestra.run.smithi001.stdout:] 2024-09-15T21:55:53.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.145+0000 7f4603fd6640 1 -- 172.21.15.1:0/3273382291 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f45e00678c0 msgr2=0x7f45e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:53.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.145+0000 7f4603fd6640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f45e00678c0 0x7f45e0069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f45fc1380d0 tx=0x7f45ec009040 comp rx=0 tx=0).stop 2024-09-15T21:55:53.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.145+0000 7f4603fd6640 1 -- 172.21.15.1:0/3273382291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45fc0b5220 msgr2=0x7f45fc137780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:53.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.145+0000 7f4603fd6640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45fc0b5220 0x7f45fc137780 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f45f80ae040 tx=0x7f45f801ab80 comp rx=0 tx=0).stop 2024-09-15T21:55:53.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.145+0000 7f4603fd6640 1 -- 172.21.15.1:0/3273382291 shutdown_connections 2024-09-15T21:55:53.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.145+0000 7f4603fd6640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f45e00678c0 0x7f45e0069d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:53.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.145+0000 7f4603fd6640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45fc148f20 0x7f45fc1363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:53.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.145+0000 7f4603fd6640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45fc0b5600 0x7f45fc135e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:53.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.145+0000 7f4603fd6640 1 --2- 172.21.15.1:0/3273382291 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f45fc0b5220 0x7f45fc137780 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:53.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.145+0000 7f4603fd6640 1 -- 172.21.15.1:0/3273382291 >> 172.21.15.1:0/3273382291 conn(0x7f45fc0b5c40 msgr2=0x7f45fc09d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:53.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.145+0000 7f4603fd6640 1 -- 172.21.15.1:0/3273382291 shutdown_connections 2024-09-15T21:55:53.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.145+0000 7f4603fd6640 1 -- 172.21.15.1:0/3273382291 wait complete. 2024-09-15T21:55:53.164 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T21:55:53.164 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T21:55:53.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc560804640 1 Processor -- start 2024-09-15T21:55:53.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc560804640 1 -- start start 2024-09-15T21:55:53.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc560804640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc55c06d0d0 0x7fc55c0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:53.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc560804640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc55c149450 0x7fc55c09dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:53.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc560804640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55c06d5b0 con 0x7fc55c0b4560 2024-09-15T21:55:53.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc560804640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fc55c06dc00 con 0x7fc55c149450 2024-09-15T21:55:53.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc560804640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc55c06d890 con 0x7fc55c06d0d0 2024-09-15T21:55:53.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55a59c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc55c0b4560 0x7fc55c148d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37922/0 (socket says 172.21.15.1:37922) 2024-09-15T21:55:53.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55a59c640 1 -- 172.21.15.1:0/625433413 learned_addr learned my addr 172.21.15.1:0/625433413 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:53.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2098011306 0 0) 0x7fc55c06d5b0 con 0x7fc55c0b4560 2024-09-15T21:55:53.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc559d9b640 1 --2- 172.21.15.1:0/625433413 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc55c06d0d0 0x7fc55c0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:53.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc544003530 con 0x7fc55c0b4560 2024-09-15T21:55:53.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55ad9d640 1 --2- 172.21.15.1:0/625433413 >> v2:172.21.15.70:3300/0 conn(0x7fc55c149450 0x7fc55c09dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:53.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 226313149 0 0) 0x7fc544003530 con 0x7fc55c0b4560 2024-09-15T21:55:53.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc55c06d0d0 msgr2=0x7fc55c0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:53.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 --2- 172.21.15.1:0/625433413 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc55c06d0d0 0x7fc55c0b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:53.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 >> v2:172.21.15.70:3300/0 conn(0x7fc55c149450 msgr2=0x7fc55c09dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:53.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 --2- 172.21.15.1:0/625433413 >> v2:172.21.15.70:3300/0 conn(0x7fc55c149450 0x7fc55c09dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:53.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55c0b3ad0 con 0x7fc55c0b4560 2024-09-15T21:55:53.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7fc554001a00 con 0x7fc55c0b4560 2024-09-15T21:55:53.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55ad9d640 1 --2- 172.21.15.1:0/625433413 >> v2:172.21.15.70:3300/0 conn(0x7fc55c149450 0x7fc55c09dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:53.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 >> v1:172.21.15.1:6789/0 conn(0x7fc55c0b4560 legacy=0x7fc55c148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:53.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 --2- 172.21.15.1:0/625433413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5440039c0 0x7fc544003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:53.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 --2- 172.21.15.1:0/625433413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc544004810 0x7fc544004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:53.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 --2- 172.21.15.1:0/625433413 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc55c06d0d0 0x7fc5440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:53.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c06dc00 con 0x7fc544004810 2024-09-15T21:55:53.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c06d890 con 0x7fc5440039c0 2024-09-15T21:55:53.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc54400bab0 con 0x7fc55c06d0d0 2024-09-15T21:55:53.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc559d9b640 1 --2- 172.21.15.1:0/625433413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc544004810 0x7fc544004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:53.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55ad9d640 1 --2- 172.21.15.1:0/625433413 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc55c06d0d0 0x7fc5440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:53.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc55a59c640 1 --2- 172.21.15.1:0/625433413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5440039c0 0x7fc544003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:53.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc559d9b640 1 -- 172.21.15.1:0/625433413 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc55c06d0d0 msgr2=0x7fc5440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:53.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc559d9b640 1 --2- 172.21.15.1:0/625433413 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc55c06d0d0 0x7fc5440051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:53.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc559d9b640 1 -- 172.21.15.1:0/625433413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5440039c0 msgr2=0x7fc544003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:53.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc559d9b640 1 --2- 172.21.15.1:0/625433413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5440039c0 0x7fc544003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:53.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.281+0000 7fc559d9b640 1 -- 172.21.15.1:0/625433413 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc544003530 con 0x7fc544004810 2024-09-15T21:55:53.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.285+0000 7fc559d9b640 1 --2- 172.21.15.1:0/625433413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc544004810 0x7fc544004c90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc550009ab0 tx=0x7fc55001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f61c4bcd9f1608a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:53.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.285+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5500096b0 con 0x7fc544004810 2024-09-15T21:55:53.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.285+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5500a9450 con 0x7fc544004810 2024-09-15T21:55:53.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.285+0000 7fc55959a640 1 -- 172.21.15.1:0/625433413 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5500a9640 con 0x7fc544004810 2024-09-15T21:55:53.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.285+0000 7fc560804640 1 -- 172.21.15.1:0/625433413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc544004810 msgr2=0x7fc544004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:53.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.285+0000 7fc560804640 1 --2- 172.21.15.1:0/625433413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc544004810 0x7fc544004c90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc550009ab0 tx=0x7fc55001c970 comp rx=0 tx=0).stop 2024-09-15T21:55:53.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.285+0000 7fc55ad9d640 1 -- 172.21.15.1:0/625433413 reap_dead start 2024-09-15T21:55:53.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.285+0000 7fc560804640 1 -- 172.21.15.1:0/625433413 shutdown_connections 2024-09-15T21:55:53.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.285+0000 7fc560804640 1 -- 172.21.15.1:0/625433413 >> 172.21.15.1:0/625433413 conn(0x7fc55c06c730 msgr2=0x7fc55c0b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:53.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.285+0000 7fc560804640 1 -- 172.21.15.1:0/625433413 shutdown_connections 2024-09-15T21:55:53.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.285+0000 7fc560804640 1 -- 172.21.15.1:0/625433413 wait complete. 2024-09-15T21:55:53.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.285+0000 7fc560804640 1 Processor -- start 2024-09-15T21:55:53.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.285+0000 7fc560804640 1 -- start start 2024-09-15T21:55:53.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc560804640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc544004810 0x7fc55c13e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:53.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc560804640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc55c14b3f0 0x7fc55c139f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:53.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc560804640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc55c1e1ed0 0x7fc55c1e2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:53.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc560804640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c150b10 con 0x7fc544004810 2024-09-15T21:55:53.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc560804640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c150990 con 0x7fc55c14b3f0 2024-09-15T21:55:53.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc560804640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc55c150c90 con 0x7fc55c1e1ed0 2024-09-15T21:55:53.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc55a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc544004810 0x7fc55c13e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:53.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc55a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc544004810 0x7fc55c13e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35840/0 (socket says 172.21.15.1:35840) 2024-09-15T21:55:53.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc55a59c640 1 -- 172.21.15.1:0/2067875950 learned_addr learned my addr 172.21.15.1:0/2067875950 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:53.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc55ad9d640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc55c1e1ed0 0x7fc55c1e2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:53.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc55a59c640 1 -- 172.21.15.1:0/2067875950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc55c1e1ed0 msgr2=0x7fc55c1e2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:53.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc559d9b640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc55c14b3f0 0x7fc55c139f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:53.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc55a59c640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc55c1e1ed0 0x7fc55c1e2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:53.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc55a59c640 1 -- 172.21.15.1:0/2067875950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc55c14b3f0 msgr2=0x7fc55c139f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:53.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc55a59c640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc55c14b3f0 0x7fc55c139f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:53.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc55a59c640 1 -- 172.21.15.1:0/2067875950 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55c13bd30 con 0x7fc544004810 2024-09-15T21:55:53.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc55a59c640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc544004810 0x7fc55c13e460 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc554007b30 tx=0x7fc55400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:53.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc54affd640 1 -- 172.21.15.1:0/2067875950 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554013420 con 0x7fc544004810 2024-09-15T21:55:53.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc54affd640 1 -- 172.21.15.1:0/2067875950 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc554018070 con 0x7fc544004810 2024-09-15T21:55:53.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc560804640 1 -- 172.21.15.1:0/2067875950 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc55c1469b0 con 0x7fc544004810 2024-09-15T21:55:53.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc54affd640 1 -- 172.21.15.1:0/2067875950 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554013800 con 0x7fc544004810 2024-09-15T21:55:53.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc560804640 1 -- 172.21.15.1:0/2067875950 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc55c147120 con 0x7fc544004810 2024-09-15T21:55:53.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc560804640 1 -- 172.21.15.1:0/2067875950 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55c147830 con 0x7fc544004810 2024-09-15T21:55:53.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc54affd640 1 -- 172.21.15.1:0/2067875950 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc5540139a0 con 0x7fc544004810 2024-09-15T21:55:53.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc54affd640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc53c0678f0 0x7fc53c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:53.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc54affd640 1 -- 172.21.15.1:0/2067875950 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4857+0+0 (secure 0 0 0) 0x7fc554086ad0 con 0x7fc544004810 2024-09-15T21:55:53.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc559d9b640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc53c0678f0 0x7fc53c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:53.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.289+0000 7fc559d9b640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc53c0678f0 0x7fc53c069db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc5500ae000 tx=0x7fc5500b3040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:53.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.293+0000 7fc54affd640 1 -- 172.21.15.1:0/2067875950 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc554057a50 con 0x7fc544004810 2024-09-15T21:55:53.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:53.457+0000 7fc560804640 1 -- 172.21.15.1:0/2067875950 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc55c0b5510 con 0x7fc544004810 2024-09-15T21:55:54.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.209+0000 7fc54affd640 1 -- 172.21.15.1:0/2067875950 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v27) ==== 138+0+0 (secure 0 0 0) 0x7fc554057350 con 0x7fc544004810 2024-09-15T21:55:54.213 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2024-09-15T21:55:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.213+0000 7fc560804640 1 -- 172.21.15.1:0/2067875950 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc53c0678f0 msgr2=0x7fc53c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.213+0000 7fc560804640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc53c0678f0 0x7fc53c069db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc5500ae000 tx=0x7fc5500b3040 comp rx=0 tx=0).stop 2024-09-15T21:55:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.213+0000 7fc560804640 1 -- 172.21.15.1:0/2067875950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc544004810 msgr2=0x7fc55c13e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.213+0000 7fc560804640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc544004810 0x7fc55c13e460 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc554007b30 tx=0x7fc55400e530 comp rx=0 tx=0).stop 2024-09-15T21:55:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.213+0000 7fc560804640 1 -- 172.21.15.1:0/2067875950 shutdown_connections 2024-09-15T21:55:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.213+0000 7fc560804640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc55c1e1ed0 0x7fc55c1e2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:54.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.213+0000 7fc560804640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc53c0678f0 0x7fc53c069db0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.213+0000 7fc560804640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc55c14b3f0 0x7fc55c139f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.213+0000 7fc560804640 1 --2- 172.21.15.1:0/2067875950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc544004810 0x7fc55c13e460 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.213+0000 7fc560804640 1 -- 172.21.15.1:0/2067875950 >> 172.21.15.1:0/2067875950 conn(0x7fc55c06c730 msgr2=0x7fc55c14e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.213+0000 7fc560804640 1 -- 172.21.15.1:0/2067875950 shutdown_connections 2024-09-15T21:55:54.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.213+0000 7fc560804640 1 -- 172.21.15.1:0/2067875950 wait complete. 2024-09-15T21:55:54.243 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T21:55:54.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4f33b640 1 Processor -- start 2024-09-15T21:55:54.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4f33b640 1 -- start start 2024-09-15T21:55:54.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4f33b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2e4814faf0 0x7f2e4814ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:54.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4f33b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2e48150470 0x7f2e48156d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:54.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4f33b640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e480ae290 con 0x7f2e4806d330 2024-09-15T21:55:54.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4f33b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f2e4806d710 con 0x7f2e48150470 2024-09-15T21:55:54.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4f33b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2e480b00b0 con 0x7f2e4814faf0 2024-09-15T21:55:54.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4d0d7640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f2e4806d330 0x7f2e480aee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37934/0 (socket says 172.21.15.1:37934) 2024-09-15T21:55:54.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4d0d7640 1 -- 172.21.15.1:0/3882282442 learned_addr learned my addr 172.21.15.1:0/3882282442 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:54.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4c8d6640 1 --2- 172.21.15.1:0/3882282442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2e4814faf0 0x7f2e4814ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:54.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4d8d8640 1 --2- 172.21.15.1:0/3882282442 >> v2:172.21.15.70:3300/0 conn(0x7f2e48150470 0x7f2e48156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:54.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1234812744 0 0) 0x7f2e3c001120 con 0x7f2e4806d330 2024-09-15T21:55:54.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e34003530 con 0x7f2e4806d330 2024-09-15T21:55:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 820183764 0 0) 0x7f2e34003530 con 0x7f2e4806d330 2024-09-15T21:55:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2e4814faf0 msgr2=0x7f2e4814ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 --2- 172.21.15.1:0/3882282442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2e4814faf0 0x7f2e4814ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 >> v2:172.21.15.70:3300/0 conn(0x7f2e48150470 msgr2=0x7f2e48156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 --2- 172.21.15.1:0/3882282442 >> v2:172.21.15.70:3300/0 conn(0x7f2e48150470 0x7f2e48156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e481508e0 con 0x7f2e4806d330 2024-09-15T21:55:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f2e3c001850 con 0x7f2e4806d330 2024-09-15T21:55:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 >> v1:172.21.15.1:6789/0 conn(0x7f2e4806d330 legacy=0x7f2e480aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 --2- 172.21.15.1:0/3882282442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e340039c0 0x7f2e34003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 --2- 172.21.15.1:0/3882282442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e34004810 0x7f2e34004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 --2- 172.21.15.1:0/3882282442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2e4814faf0 0x7f2e340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4806d710 con 0x7f2e340039c0 2024-09-15T21:55:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2e480b00b0 con 0x7f2e34004810 2024-09-15T21:55:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3400ba80 con 0x7f2e4814faf0 2024-09-15T21:55:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4d0d7640 1 --2- 172.21.15.1:0/3882282442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e340039c0 0x7f2e34003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4c8d6640 1 --2- 172.21.15.1:0/3882282442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e34004810 0x7f2e34004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.377+0000 7f2e4d8d8640 1 --2- 172.21.15.1:0/3882282442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2e4814faf0 0x7f2e340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e4d0d7640 1 -- 172.21.15.1:0/3882282442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2e4814faf0 msgr2=0x7f2e340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e4d0d7640 1 --2- 172.21.15.1:0/3882282442 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2e4814faf0 0x7f2e340051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:54.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e4d0d7640 1 -- 172.21.15.1:0/3882282442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e34004810 msgr2=0x7f2e34004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:54.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e4d0d7640 1 --2- 172.21.15.1:0/3882282442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e34004810 0x7f2e34004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:54.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e4d0d7640 1 -- 172.21.15.1:0/3882282442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e34003530 con 0x7f2e340039c0 2024-09-15T21:55:54.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e4d0d7640 1 --2- 172.21.15.1:0/3882282442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e340039c0 0x7f2e34003de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00c490 tx=0x7f2e3c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec69666145deffac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:54.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00c0e0 con 0x7f2e340039c0 2024-09-15T21:55:54.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e3c0a9020 con 0x7f2e340039c0 2024-09-15T21:55:54.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e3bfff640 1 -- 172.21.15.1:0/3882282442 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0a5be0 con 0x7f2e340039c0 2024-09-15T21:55:54.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3882282442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e340039c0 msgr2=0x7f2e34003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:54.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e4f33b640 1 --2- 172.21.15.1:0/3882282442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e340039c0 0x7f2e34003de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00c490 tx=0x7f2e3c01cca0 comp rx=0 tx=0).stop 2024-09-15T21:55:54.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e4d8d8640 1 -- 172.21.15.1:0/3882282442 reap_dead start 2024-09-15T21:55:54.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3882282442 shutdown_connections 2024-09-15T21:55:54.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.381+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3882282442 >> 172.21.15.1:0/3882282442 conn(0x7f2e4806c730 msgr2=0x7f2e480b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:54.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3882282442 shutdown_connections 2024-09-15T21:55:54.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3882282442 wait complete. 2024-09-15T21:55:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4f33b640 1 Processor -- start 2024-09-15T21:55:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4f33b640 1 -- start start 2024-09-15T21:55:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4f33b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e4809d5a0 0x7f2e480b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4f33b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e480b1b70 0x7f2e481e8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4f33b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2e480b2460 0x7f2e481e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4f33b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2e480b5640 con 0x7f2e480b1b70 2024-09-15T21:55:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4f33b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2e480b57c0 con 0x7f2e4809d5a0 2024-09-15T21:55:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4f33b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2e480b3ce0 con 0x7f2e480b2460 2024-09-15T21:55:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4c8d6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e480b1b70 0x7f2e481e8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4c8d6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e480b1b70 0x7f2e481e8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35860/0 (socket says 172.21.15.1:35860) 2024-09-15T21:55:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4c8d6640 1 -- 172.21.15.1:0/3033483020 learned_addr learned my addr 172.21.15.1:0/3033483020 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4d0d7640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e4809d5a0 0x7f2e480b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4d8d8640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2e480b2460 0x7f2e481e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4c8d6640 1 -- 172.21.15.1:0/3033483020 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2e480b2460 msgr2=0x7f2e481e4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4c8d6640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2e480b2460 0x7f2e481e4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4c8d6640 1 -- 172.21.15.1:0/3033483020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e4809d5a0 msgr2=0x7f2e480b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4c8d6640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e4809d5a0 0x7f2e480b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4c8d6640 1 -- 172.21.15.1:0/3033483020 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4809d980 con 0x7f2e480b1b70 2024-09-15T21:55:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4c8d6640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e480b1b70 0x7f2e481e8e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009f50 tx=0x7f2e440115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e39ffb640 1 -- 172.21.15.1:0/3033483020 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4401a020 con 0x7f2e480b1b70 2024-09-15T21:55:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e39ffb640 1 -- 172.21.15.1:0/3033483020 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e44016470 con 0x7f2e480b1b70 2024-09-15T21:55:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e39ffb640 1 -- 172.21.15.1:0/3033483020 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e44016840 con 0x7f2e480b1b70 2024-09-15T21:55:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3033483020 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e481e8630 con 0x7f2e480b1b70 2024-09-15T21:55:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3033483020 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e481e9370 con 0x7f2e480b1b70 2024-09-15T21:55:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.385+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3033483020 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e480aee00 con 0x7f2e480b1b70 2024-09-15T21:55:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.389+0000 7f2e39ffb640 1 -- 172.21.15.1:0/3033483020 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e4401d020 con 0x7f2e480b1b70 2024-09-15T21:55:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.389+0000 7f2e39ffb640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2e2c0678f0 0x7f2e2c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.389+0000 7f2e4d0d7640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2e2c0678f0 0x7f2e2c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.389+0000 7f2e39ffb640 1 -- 172.21.15.1:0/3033483020 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5227+0+0 (secure 0 0 0) 0x7f2e44086810 con 0x7f2e480b1b70 2024-09-15T21:55:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.389+0000 7f2e4d0d7640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2e2c0678f0 0x7f2e2c069db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0aa000 tx=0x7f2e3c000ff0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:54.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.393+0000 7f2e39ffb640 1 -- 172.21.15.1:0/3033483020 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2e44024030 con 0x7f2e480b1b70 2024-09-15T21:55:54.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:54.557+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3033483020 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2e480b5120 con 0x7f2e480b1b70 2024-09-15T21:55:55.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.213+0000 7f2e39ffb640 1 -- 172.21.15.1:0/3033483020 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v28) ==== 170+0+0 (secure 0 0 0) 0x7f2e440575c0 con 0x7f2e480b1b70 2024-09-15T21:55:55.217 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2024-09-15T21:55:55.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.217+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3033483020 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2e2c0678f0 msgr2=0x7f2e2c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:55.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.217+0000 7f2e4f33b640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2e2c0678f0 0x7f2e2c069db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0aa000 tx=0x7f2e3c000ff0 comp rx=0 tx=0).stop 2024-09-15T21:55:55.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.217+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3033483020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e480b1b70 msgr2=0x7f2e481e8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:55.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.217+0000 7f2e4f33b640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e480b1b70 0x7f2e481e8e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009f50 tx=0x7f2e440115a0 comp rx=0 tx=0).stop 2024-09-15T21:55:55.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.217+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3033483020 shutdown_connections 2024-09-15T21:55:55.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.217+0000 7f2e4f33b640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2e480b2460 0x7f2e481e4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:55.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.217+0000 7f2e4f33b640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2e480b1b70 0x7f2e481e8e30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:55.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.217+0000 7f2e4f33b640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2e2c0678f0 0x7f2e2c069db0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:55.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.217+0000 7f2e4f33b640 1 --2- 172.21.15.1:0/3033483020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e4809d5a0 0x7f2e480b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:55.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.217+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3033483020 >> 172.21.15.1:0/3033483020 conn(0x7f2e4806c730 msgr2=0x7f2e480b6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:55.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.221+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3033483020 shutdown_connections 2024-09-15T21:55:55.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.221+0000 7f2e4f33b640 1 -- 172.21.15.1:0/3033483020 wait complete. 2024-09-15T21:55:55.259 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T21:55:55.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.385+0000 7fe10d929640 1 Processor -- start 2024-09-15T21:55:55.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe10d929640 1 -- start start 2024-09-15T21:55:55.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe10d929640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe1080b6010 0x7fe1080b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:55.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe10d929640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe108072c40 0x7fe108073070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:55.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe10d929640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1080707b0 con 0x7fe1080b1f80 2024-09-15T21:55:55.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe10d929640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fe1080b63f0 con 0x7fe1080b6010 2024-09-15T21:55:55.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe10d929640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fe10806fe30 con 0x7fe108072c40 2024-09-15T21:55:55.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe106ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe1080b6010 0x7fe1080b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:55.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe1067fc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe1080b1f80 0x7fe10806f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37948/0 (socket says 172.21.15.1:37948) 2024-09-15T21:55:55.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe106ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe1080b6010 0x7fe1080b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35864/0 (socket says 172.21.15.1:35864) 2024-09-15T21:55:55.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe1067fc640 1 -- 172.21.15.1:0/122761589 learned_addr learned my addr 172.21.15.1:0/122761589 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:55.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe1077fe640 1 --2- 172.21.15.1:0/122761589 >> v2:172.21.15.70:3300/0 conn(0x7fe108072c40 0x7fe108073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:55.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe106ffd640 1 -- 172.21.15.1:0/122761589 >> v2:172.21.15.70:3300/0 conn(0x7fe108072c40 msgr2=0x7fe108073070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:55.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe106ffd640 1 --2- 172.21.15.1:0/122761589 >> v2:172.21.15.70:3300/0 conn(0x7fe108072c40 0x7fe108073070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:55.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe106ffd640 1 -- 172.21.15.1:0/122761589 >> v1:172.21.15.1:6789/0 conn(0x7fe1080b1f80 legacy=0x7fe10806f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:55.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe106ffd640 1 -- 172.21.15.1:0/122761589 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe108072720 con 0x7fe1080b6010 2024-09-15T21:55:55.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.389+0000 7fe105ffb640 1 -- 172.21.15.1:0/122761589 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453617305 0 0) 0x7fe1080707b0 con 0x7fe1080b1f80 2024-09-15T21:55:55.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe106ffd640 1 --2- 172.21.15.1:0/122761589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1080b6010 0x7fe1080b1a40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe1000097c0 tx=0x7fe10001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318c48749ba1454c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:55.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe105ffb640 1 -- 172.21.15.1:0/122761589 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1000b0070 con 0x7fe1080b6010 2024-09-15T21:55:55.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe105ffb640 1 -- 172.21.15.1:0/122761589 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1000ab600 con 0x7fe1080b6010 2024-09-15T21:55:55.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe105ffb640 1 -- 172.21.15.1:0/122761589 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1000ab9d0 con 0x7fe1080b6010 2024-09-15T21:55:55.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 -- 172.21.15.1:0/122761589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1080b6010 msgr2=0x7fe1080b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:55.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 --2- 172.21.15.1:0/122761589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1080b6010 0x7fe1080b1a40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe1000097c0 tx=0x7fe10001c460 comp rx=0 tx=0).stop 2024-09-15T21:55:55.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 -- 172.21.15.1:0/122761589 shutdown_connections 2024-09-15T21:55:55.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 --2- 172.21.15.1:0/122761589 >> v2:172.21.15.70:3300/0 conn(0x7fe108072c40 0x7fe108073070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:55.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 --2- 172.21.15.1:0/122761589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1080b6010 0x7fe1080b1a40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:55.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 -- 172.21.15.1:0/122761589 >> 172.21.15.1:0/122761589 conn(0x7fe10809d160 msgr2=0x7fe10809d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:55.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 -- 172.21.15.1:0/122761589 shutdown_connections 2024-09-15T21:55:55.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 -- 172.21.15.1:0/122761589 wait complete. 2024-09-15T21:55:55.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 Processor -- start 2024-09-15T21:55:55.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 -- start start 2024-09-15T21:55:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe108072c40 0x7fe1081e7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1080b1f80 0x7fe108124af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1080b6010 0x7fe108125030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe108159360 con 0x7fe1080b1f80 2024-09-15T21:55:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe1081591e0 con 0x7fe1080b6010 2024-09-15T21:55:55.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe10d929640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe1081594e0 con 0x7fe108072c40 2024-09-15T21:55:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe1067fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1080b1f80 0x7fe108124af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe1067fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1080b1f80 0x7fe108124af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35880/0 (socket says 172.21.15.1:35880) 2024-09-15T21:55:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe1067fc640 1 -- 172.21.15.1:0/2644610300 learned_addr learned my addr 172.21.15.1:0/2644610300 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe1077fe640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1080b6010 0x7fe108125030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe106ffd640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe108072c40 0x7fe1081e7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe1067fc640 1 -- 172.21.15.1:0/2644610300 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe108072c40 msgr2=0x7fe1081e7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe1067fc640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe108072c40 0x7fe1081e7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe1067fc640 1 -- 172.21.15.1:0/2644610300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1080b6010 msgr2=0x7fe108125030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe1067fc640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1080b6010 0x7fe108125030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.393+0000 7fe1067fc640 1 -- 172.21.15.1:0/2644610300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe108126ae0 con 0x7fe1080b1f80 2024-09-15T21:55:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.397+0000 7fe1067fc640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1080b1f80 0x7fe108124af0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000c550 tx=0x7fe0f000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:55.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.397+0000 7fe0fffff640 1 -- 172.21.15.1:0/2644610300 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0017070 con 0x7fe1080b1f80 2024-09-15T21:55:55.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.397+0000 7fe0fffff640 1 -- 172.21.15.1:0/2644610300 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f0005d10 con 0x7fe1080b1f80 2024-09-15T21:55:55.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.397+0000 7fe10d929640 1 -- 172.21.15.1:0/2644610300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1080b54c0 con 0x7fe1080b1f80 2024-09-15T21:55:55.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.397+0000 7fe0fffff640 1 -- 172.21.15.1:0/2644610300 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0007330 con 0x7fe1080b1f80 2024-09-15T21:55:55.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.397+0000 7fe10d929640 1 -- 172.21.15.1:0/2644610300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe108123600 con 0x7fe1080b1f80 2024-09-15T21:55:55.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.397+0000 7fe10d929640 1 -- 172.21.15.1:0/2644610300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe108073070 con 0x7fe1080b1f80 2024-09-15T21:55:55.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.397+0000 7fe0fffff640 1 -- 172.21.15.1:0/2644610300 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe0f001a070 con 0x7fe1080b1f80 2024-09-15T21:55:55.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.397+0000 7fe0fffff640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe0e80678c0 0x7fe0e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:55.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.397+0000 7fe0fffff640 1 -- 172.21.15.1:0/2644610300 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5609+0+0 (secure 0 0 0) 0x7fe0f0085010 con 0x7fe1080b1f80 2024-09-15T21:55:55.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.397+0000 7fe106ffd640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe0e80678c0 0x7fe0e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:55.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.397+0000 7fe106ffd640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe0e80678c0 0x7fe0e8069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe1000ad000 tx=0x7fe100008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:55.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.401+0000 7fe0fffff640 1 -- 172.21.15.1:0/2644610300 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe0f0055c40 con 0x7fe1080b1f80 2024-09-15T21:55:55.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:55.601+0000 7fe10d929640 1 -- 172.21.15.1:0/2644610300 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe1080b7770 con 0x7fe1080b1f80 2024-09-15T21:55:56.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.289+0000 7fe0fffff640 1 -- 172.21.15.1:0/2644610300 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fe0f0055540 con 0x7fe1080b1f80 2024-09-15T21:55:56.292 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 4 and data pool 5 2024-09-15T21:55:56.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.293+0000 7fe10d929640 1 -- 172.21.15.1:0/2644610300 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe0e80678c0 msgr2=0x7fe0e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:56.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.293+0000 7fe10d929640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe0e80678c0 0x7fe0e8069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe1000ad000 tx=0x7fe100008040 comp rx=0 tx=0).stop 2024-09-15T21:55:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.293+0000 7fe10d929640 1 -- 172.21.15.1:0/2644610300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1080b1f80 msgr2=0x7fe108124af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.293+0000 7fe10d929640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1080b1f80 0x7fe108124af0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000c550 tx=0x7fe0f000ca10 comp rx=0 tx=0).stop 2024-09-15T21:55:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.293+0000 7fe10d929640 1 -- 172.21.15.1:0/2644610300 shutdown_connections 2024-09-15T21:55:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.293+0000 7fe10d929640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe0e80678c0 0x7fe0e8069d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.293+0000 7fe10d929640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1080b6010 0x7fe108125030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.293+0000 7fe10d929640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe1080b1f80 0x7fe108124af0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.293+0000 7fe10d929640 1 --2- 172.21.15.1:0/2644610300 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe108072c40 0x7fe1081e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.293+0000 7fe10d929640 1 -- 172.21.15.1:0/2644610300 >> 172.21.15.1:0/2644610300 conn(0x7fe10809d160 msgr2=0x7fe10806ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.293+0000 7fe10d929640 1 -- 172.21.15.1:0/2644610300 shutdown_connections 2024-09-15T21:55:56.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.293+0000 7fe10d929640 1 -- 172.21.15.1:0/2644610300 wait complete. 2024-09-15T21:55:56.323 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:56.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.433+0000 7fb9ba97a640 1 Processor -- start 2024-09-15T21:55:56.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.433+0000 7fb9ba97a640 1 -- start start 2024-09-15T21:55:56.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9ba97a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb9b40b6120 0x7fb9b414b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:56.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9ba97a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb9b4141ac0 0x7fb9b41521d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:56.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9ba97a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9b40b6500 con 0x7fb9b41480c0 2024-09-15T21:55:56.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9ba97a640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fb9b414bc60 con 0x7fb9b4141ac0 2024-09-15T21:55:56.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9ba97a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fb9b4147ba0 con 0x7fb9b40b6120 2024-09-15T21:55:56.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9b8f17640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb9b4141ac0 0x7fb9b41521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:56.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9b8f17640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb9b4141ac0 0x7fb9b41521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35894/0 (socket says 172.21.15.1:35894) 2024-09-15T21:55:56.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9b8f17640 1 -- 172.21.15.1:0/185832300 learned_addr learned my addr 172.21.15.1:0/185832300 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:56.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9b3fff640 1 --2- 172.21.15.1:0/185832300 >> v2:172.21.15.70:3300/0 conn(0x7fb9b40b6120 0x7fb9b414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:56.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9b8f17640 1 -- 172.21.15.1:0/185832300 >> v2:172.21.15.70:3300/0 conn(0x7fb9b40b6120 msgr2=0x7fb9b414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:56.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9b8f17640 1 --2- 172.21.15.1:0/185832300 >> v2:172.21.15.70:3300/0 conn(0x7fb9b40b6120 0x7fb9b414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9b8f17640 1 -- 172.21.15.1:0/185832300 >> v1:172.21.15.70:6789/0 conn(0x7fb9b41480c0 legacy=0x7fb9b41413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:56.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9b8f17640 1 -- 172.21.15.1:0/185832300 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b40b76c0 con 0x7fb9b4141ac0 2024-09-15T21:55:56.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9b3fff640 1 --2- 172.21.15.1:0/185832300 >> v2:172.21.15.70:3300/0 conn(0x7fb9b40b6120 0x7fb9b414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:56.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9b8f17640 1 --2- 172.21.15.1:0/185832300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9b4141ac0 0x7fb9b41521d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb9b406d260 tx=0x7fb9ac01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc363ea929c1a7bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:56.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9b2ffd640 1 -- 172.21.15.1:0/185832300 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0a55e0 con 0x7fb9b4141ac0 2024-09-15T21:55:56.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9b2ffd640 1 -- 172.21.15.1:0/185832300 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ac0a5780 con 0x7fb9b4141ac0 2024-09-15T21:55:56.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.437+0000 7fb9b2ffd640 1 -- 172.21.15.1:0/185832300 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0a5b50 con 0x7fb9b4141ac0 2024-09-15T21:55:56.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 -- 172.21.15.1:0/185832300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9b4141ac0 msgr2=0x7fb9b41521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:56.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 --2- 172.21.15.1:0/185832300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9b4141ac0 0x7fb9b41521d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb9b406d260 tx=0x7fb9ac01c920 comp rx=0 tx=0).stop 2024-09-15T21:55:56.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 -- 172.21.15.1:0/185832300 shutdown_connections 2024-09-15T21:55:56.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 --2- 172.21.15.1:0/185832300 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9b4141ac0 0x7fb9b41521d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 --2- 172.21.15.1:0/185832300 >> v2:172.21.15.70:3300/0 conn(0x7fb9b40b6120 0x7fb9b414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 -- 172.21.15.1:0/185832300 >> 172.21.15.1:0/185832300 conn(0x7fb9b40bd2f0 msgr2=0x7fb9b40bd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:56.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 -- 172.21.15.1:0/185832300 shutdown_connections 2024-09-15T21:55:56.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 -- 172.21.15.1:0/185832300 wait complete. 2024-09-15T21:55:56.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 Processor -- start 2024-09-15T21:55:56.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 -- start start 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9b40b6120 0x7fb9b4143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9b4141ac0 0x7fb9b414f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9b41480c0 0x7fb9b41e34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b41550b0 con 0x7fb9b40b6120 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b4154f30 con 0x7fb9b4141ac0 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b4155230 con 0x7fb9b41480c0 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9b40b6120 0x7fb9b4143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9b40b6120 0x7fb9b4143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35904/0 (socket says 172.21.15.1:35904) 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b3fff640 1 -- 172.21.15.1:0/2787528956 learned_addr learned my addr 172.21.15.1:0/2787528956 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b8f17640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9b41480c0 0x7fb9b41e34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b37fe640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9b4141ac0 0x7fb9b414f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b3fff640 1 -- 172.21.15.1:0/2787528956 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9b41480c0 msgr2=0x7fb9b41e34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b3fff640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9b41480c0 0x7fb9b41e34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b3fff640 1 -- 172.21.15.1:0/2787528956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9b4141ac0 msgr2=0x7fb9b414f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:56.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b3fff640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9b4141ac0 0x7fb9b414f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b3fff640 1 -- 172.21.15.1:0/2787528956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b414fe20 con 0x7fb9b40b6120 2024-09-15T21:55:56.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b37fe640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9b4141ac0 0x7fb9b414f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:56.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b3fff640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9b40b6120 0x7fb9b4143d30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400c7c0 tx=0x7fb9a400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:56.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b0ff9640 1 -- 172.21.15.1:0/2787528956 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4007a30 con 0x7fb9b40b6120 2024-09-15T21:55:56.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b0ff9640 1 -- 172.21.15.1:0/2787528956 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a4007bd0 con 0x7fb9b40b6120 2024-09-15T21:55:56.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 -- 172.21.15.1:0/2787528956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b4150100 con 0x7fb9b40b6120 2024-09-15T21:55:56.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9b0ff9640 1 -- 172.21.15.1:0/2787528956 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a40113f0 con 0x7fb9b40b6120 2024-09-15T21:55:56.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 -- 172.21.15.1:0/2787528956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b414e640 con 0x7fb9b40b6120 2024-09-15T21:55:56.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.441+0000 7fb9ba97a640 1 -- 172.21.15.1:0/2787528956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b414b320 con 0x7fb9b40b6120 2024-09-15T21:55:56.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.445+0000 7fb9b0ff9640 1 -- 172.21.15.1:0/2787528956 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb9a4011590 con 0x7fb9b40b6120 2024-09-15T21:55:56.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.445+0000 7fb9b0ff9640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb9a00678c0 0x7fb9a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:56.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.445+0000 7fb9b0ff9640 1 -- 172.21.15.1:0/2787528956 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7fb9a4085e10 con 0x7fb9b40b6120 2024-09-15T21:55:56.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.445+0000 7fb9b37fe640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb9a00678c0 0x7fb9a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:56.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.445+0000 7fb9b37fe640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb9a00678c0 0x7fb9a0069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4145bc0 tx=0x7fb9a8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:56.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.449+0000 7fb9b0ff9640 1 -- 172.21.15.1:0/2787528956 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb9a4015020 con 0x7fb9b40b6120 2024-09-15T21:55:56.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.609+0000 7fb9ba97a640 1 -- 172.21.15.1:0/2787528956 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9b40691c0 con 0x7fb9b40b6120 2024-09-15T21:55:56.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.613+0000 7fb9b0ff9640 1 -- 172.21.15.1:0/2787528956 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+16670 (secure 0 0 0) 0x7fb9a40569e0 con 0x7fb9b40b6120 2024-09-15T21:55:56.617 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:56.617 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":29,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:55.606866+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:53.499944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:54.604026+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:56.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.613+0000 7fb9ba97a640 1 -- 172.21.15.1:0/2787528956 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb9a00678c0 msgr2=0x7fb9a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.613+0000 7fb9ba97a640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb9a00678c0 0x7fb9a0069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4145bc0 tx=0x7fb9a8008040 comp rx=0 tx=0).stop 2024-09-15T21:55:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.613+0000 7fb9ba97a640 1 -- 172.21.15.1:0/2787528956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9b40b6120 msgr2=0x7fb9b4143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.613+0000 7fb9ba97a640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9b40b6120 0x7fb9b4143d30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400c7c0 tx=0x7fb9a400cc80 comp rx=0 tx=0).stop 2024-09-15T21:55:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.613+0000 7fb9ba97a640 1 -- 172.21.15.1:0/2787528956 shutdown_connections 2024-09-15T21:55:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.613+0000 7fb9ba97a640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9b41480c0 0x7fb9b41e34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.613+0000 7fb9ba97a640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb9a00678c0 0x7fb9a0069d80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.613+0000 7fb9ba97a640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9b4141ac0 0x7fb9b414f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.613+0000 7fb9ba97a640 1 --2- 172.21.15.1:0/2787528956 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9b40b6120 0x7fb9b4143d30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.613+0000 7fb9ba97a640 1 -- 172.21.15.1:0/2787528956 >> 172.21.15.1:0/2787528956 conn(0x7fb9b40bd2f0 msgr2=0x7fb9b40bb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.613+0000 7fb9ba97a640 1 -- 172.21.15.1:0/2787528956 shutdown_connections 2024-09-15T21:55:56.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.613+0000 7fb9ba97a640 1 -- 172.21.15.1:0/2787528956 wait complete. 2024-09-15T21:55:56.635 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:56.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810eb42640 1 Processor -- start 2024-09-15T21:55:56.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810eb42640 1 -- start start 2024-09-15T21:55:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810eb42640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f810809b540 0x7f81080af170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810eb42640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81080b3b40 0x7f81080b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810eb42640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f810809b920 con 0x7f81081443a0 2024-09-15T21:55:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810eb42640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f81080b44a0 con 0x7f810809b540 2024-09-15T21:55:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810eb42640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f81080ae380 con 0x7f81080b3b40 2024-09-15T21:55:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810c8de640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f810809b540 0x7f81080af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810c8de640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f810809b540 0x7f81080af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51396/0 (socket says 172.21.15.1:51396) 2024-09-15T21:55:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810c8de640 1 -- 172.21.15.1:0/3963280525 learned_addr learned my addr 172.21.15.1:0/3963280525 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:56.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f8107fff640 1 --2- 172.21.15.1:0/3963280525 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81080b3b40 0x7f81080b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:56.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810c8de640 1 -- 172.21.15.1:0/3963280525 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81080b3b40 msgr2=0x7f81080b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:56.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810c8de640 1 --2- 172.21.15.1:0/3963280525 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81080b3b40 0x7f81080b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810c8de640 1 -- 172.21.15.1:0/3963280525 >> v1:172.21.15.70:6789/0 conn(0x7f81081443a0 legacy=0x7f8108144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:56.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.753+0000 7f810c8de640 1 -- 172.21.15.1:0/3963280525 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81080af7d0 con 0x7f810809b540 2024-09-15T21:55:56.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.757+0000 7f810c8de640 1 --2- 172.21.15.1:0/3963280525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810809b540 0x7f81080af170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8100009870 tx=0x7f810001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c855b0a5c2bf8c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:56.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.757+0000 7f81077fe640 1 -- 172.21.15.1:0/3963280525 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81000b0070 con 0x7f810809b540 2024-09-15T21:55:56.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.757+0000 7f81077fe640 1 -- 172.21.15.1:0/3963280525 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81000ab600 con 0x7f810809b540 2024-09-15T21:55:56.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.757+0000 7f81077fe640 1 -- 172.21.15.1:0/3963280525 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81000ab9d0 con 0x7f810809b540 2024-09-15T21:55:56.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.757+0000 7f810eb42640 1 -- 172.21.15.1:0/3963280525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810809b540 msgr2=0x7f81080af170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:56.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.757+0000 7f810eb42640 1 --2- 172.21.15.1:0/3963280525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810809b540 0x7f81080af170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8100009870 tx=0x7f810001c440 comp rx=0 tx=0).stop 2024-09-15T21:55:56.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.757+0000 7f810eb42640 1 -- 172.21.15.1:0/3963280525 shutdown_connections 2024-09-15T21:55:56.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.757+0000 7f810eb42640 1 --2- 172.21.15.1:0/3963280525 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81080b3b40 0x7f81080b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.757+0000 7f810eb42640 1 --2- 172.21.15.1:0/3963280525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810809b540 0x7f81080af170 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.757+0000 7f810eb42640 1 -- 172.21.15.1:0/3963280525 >> 172.21.15.1:0/3963280525 conn(0x7f81080b5c40 msgr2=0x7f81080b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.757+0000 7f810eb42640 1 -- 172.21.15.1:0/3963280525 shutdown_connections 2024-09-15T21:55:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.757+0000 7f810eb42640 1 -- 172.21.15.1:0/3963280525 wait complete. 2024-09-15T21:55:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810eb42640 1 Processor -- start 2024-09-15T21:55:56.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810eb42640 1 -- start start 2024-09-15T21:55:56.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810eb42640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810809b540 0x7f81080706d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:56.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810eb42640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81080b3b40 0x7f8108071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:56.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810eb42640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81081443a0 0x7f8108072220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:56.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810eb42640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81081529d0 con 0x7f810809b540 2024-09-15T21:55:56.765 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810eb42640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f81080ae660 con 0x7f81081443a0 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810eb42640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8108152b50 con 0x7f81080b3b40 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810c8de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810809b540 0x7f81080706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810c8de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810809b540 0x7f81080706d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51402/0 (socket says 172.21.15.1:51402) 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810c8de640 1 -- 172.21.15.1:0/4240553456 learned_addr learned my addr 172.21.15.1:0/4240553456 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f8107fff640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81080b3b40 0x7f8108071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810d0df640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81081443a0 0x7f8108072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810c8de640 1 -- 172.21.15.1:0/4240553456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81080b3b40 msgr2=0x7f8108071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810c8de640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81080b3b40 0x7f8108071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810c8de640 1 -- 172.21.15.1:0/4240553456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81081443a0 msgr2=0x7f8108072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810c8de640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81081443a0 0x7f8108072220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810c8de640 1 -- 172.21.15.1:0/4240553456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81081e05c0 con 0x7f810809b540 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810c8de640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810809b540 0x7f81080706d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f81000ae040 tx=0x7f81000191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f81057fa640 1 -- 172.21.15.1:0/4240553456 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81000b0040 con 0x7f810809b540 2024-09-15T21:55:56.766 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f81057fa640 1 -- 172.21.15.1:0/4240553456 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81000b4420 con 0x7f810809b540 2024-09-15T21:55:56.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f81057fa640 1 -- 172.21.15.1:0/4240553456 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81000b47f0 con 0x7f810809b540 2024-09-15T21:55:56.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810eb42640 1 -- 172.21.15.1:0/4240553456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81081e0b80 con 0x7f810809b540 2024-09-15T21:55:56.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810eb42640 1 -- 172.21.15.1:0/4240553456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81081e10a0 con 0x7f810809b540 2024-09-15T21:55:56.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f810eb42640 1 -- 172.21.15.1:0/4240553456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81080af170 con 0x7f810809b540 2024-09-15T21:55:56.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f81057fa640 1 -- 172.21.15.1:0/4240553456 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f81000b4990 con 0x7f810809b540 2024-09-15T21:55:56.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f81057fa640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f80e80678c0 0x7f80e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:56.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f8107fff640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f80e80678c0 0x7f80e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:56.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.761+0000 7f81057fa640 1 -- 172.21.15.1:0/4240553456 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f810011f720 con 0x7f810809b540 2024-09-15T21:55:56.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.765+0000 7f8107fff640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f80e80678c0 0x7f80e8069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8108152050 tx=0x7f80f000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:56.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.769+0000 7f81057fa640 1 -- 172.21.15.1:0/4240553456 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8100016150 con 0x7f810809b540 2024-09-15T21:55:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.929+0000 7f810eb42640 1 -- 172.21.15.1:0/4240553456 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81080ae160 con 0x7f810809b540 2024-09-15T21:55:56.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.933+0000 7f81057fa640 1 -- 172.21.15.1:0/4240553456 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+16670 (secure 0 0 0) 0x7f81000f0410 con 0x7f810809b540 2024-09-15T21:55:56.938 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:56.938 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":29,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:55.606866+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:53.499944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:54.604026+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.933+0000 7f810eb42640 1 -- 172.21.15.1:0/4240553456 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f80e80678c0 msgr2=0x7f80e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.933+0000 7f810eb42640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f80e80678c0 0x7f80e8069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8108152050 tx=0x7f80f000b040 comp rx=0 tx=0).stop 2024-09-15T21:55:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.933+0000 7f810eb42640 1 -- 172.21.15.1:0/4240553456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810809b540 msgr2=0x7f81080706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.933+0000 7f810eb42640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810809b540 0x7f81080706d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f81000ae040 tx=0x7f81000191e0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.937+0000 7f810eb42640 1 -- 172.21.15.1:0/4240553456 shutdown_connections 2024-09-15T21:55:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.937+0000 7f810eb42640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f80e80678c0 0x7f80e8069d80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.937+0000 7f810eb42640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81081443a0 0x7f8108072220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.937+0000 7f810eb42640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f81080b3b40 0x7f8108071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.937+0000 7f810eb42640 1 --2- 172.21.15.1:0/4240553456 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f810809b540 0x7f81080706d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.937+0000 7f810eb42640 1 -- 172.21.15.1:0/4240553456 >> 172.21.15.1:0/4240553456 conn(0x7f81080b5c40 msgr2=0x7f810806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.937+0000 7f810eb42640 1 -- 172.21.15.1:0/4240553456 shutdown_connections 2024-09-15T21:55:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:56.937+0000 7f810eb42640 1 -- 172.21.15.1:0/4240553456 wait complete. 2024-09-15T21:55:56.957 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T21:55:57.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a69df3640 1 Processor -- start 2024-09-15T21:55:57.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a69df3640 1 -- start start 2024-09-15T21:55:57.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a69df3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a6406d0d0 0x7f7a640b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:57.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a69df3640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a6406d5b0 con 0x7f7a640b4560 2024-09-15T21:55:57.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a69df3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a6406d890 con 0x7f7a64149450 2024-09-15T21:55:57.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a69df3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6406dc00 con 0x7f7a6406d0d0 2024-09-15T21:55:57.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a637fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f7a640b4560 0x7f7a64148d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41350/0 (socket says 172.21.15.1:41350) 2024-09-15T21:55:57.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a637fe640 1 -- 172.21.15.1:0/3362312237 learned_addr learned my addr 172.21.15.1:0/3362312237 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:57.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a62ffd640 1 --2- 172.21.15.1:0/3362312237 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a6406d0d0 0x7f7a640b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:57.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a627fc640 1 -- 172.21.15.1:0/3362312237 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3076573755 0 0) 0x7f7a6406d5b0 con 0x7f7a640b4560 2024-09-15T21:55:57.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a627fc640 1 -- 172.21.15.1:0/3362312237 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a4c003530 con 0x7f7a640b4560 2024-09-15T21:55:57.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a62ffd640 1 -- 172.21.15.1:0/3362312237 >> v1:172.21.15.70:6789/0 conn(0x7f7a64149450 legacy=0x7f7a6409dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:57.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a62ffd640 1 -- 172.21.15.1:0/3362312237 >> v1:172.21.15.1:6789/0 conn(0x7f7a640b4560 legacy=0x7f7a64148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:57.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.085+0000 7f7a62ffd640 1 -- 172.21.15.1:0/3362312237 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a640b3ad0 con 0x7f7a6406d0d0 2024-09-15T21:55:57.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a62ffd640 1 --2- 172.21.15.1:0/3362312237 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a6406d0d0 0x7f7a640b4940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7a580097f0 tx=0x7f7a5801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f83c31748ed3656 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:57.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a627fc640 1 -- 172.21.15.1:0/3362312237 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a580b2070 con 0x7f7a6406d0d0 2024-09-15T21:55:57.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a627fc640 1 -- 172.21.15.1:0/3362312237 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a580a9070 con 0x7f7a6406d0d0 2024-09-15T21:55:57.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a627fc640 1 -- 172.21.15.1:0/3362312237 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a580ad860 con 0x7f7a6406d0d0 2024-09-15T21:55:57.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 -- 172.21.15.1:0/3362312237 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a6406d0d0 msgr2=0x7f7a640b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:57.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 --2- 172.21.15.1:0/3362312237 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a6406d0d0 0x7f7a640b4940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7a580097f0 tx=0x7f7a5801c450 comp rx=0 tx=0).stop 2024-09-15T21:55:57.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 -- 172.21.15.1:0/3362312237 shutdown_connections 2024-09-15T21:55:57.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 --2- 172.21.15.1:0/3362312237 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a6406d0d0 0x7f7a640b4940 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:57.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 -- 172.21.15.1:0/3362312237 >> 172.21.15.1:0/3362312237 conn(0x7f7a6406c730 msgr2=0x7f7a640b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:57.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 -- 172.21.15.1:0/3362312237 shutdown_connections 2024-09-15T21:55:57.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 -- 172.21.15.1:0/3362312237 wait complete. 2024-09-15T21:55:57.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 Processor -- start 2024-09-15T21:55:57.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 -- start start 2024-09-15T21:55:57.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6406d0d0 0x7f7a640b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:57.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a640b4560 0x7f7a641e1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:57.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a64149450 0x7f7a640b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7a64153b30 con 0x7f7a640b4560 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7a641539b0 con 0x7f7a6406d0d0 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a69df3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7a64153cb0 con 0x7f7a64149450 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a62ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a640b4560 0x7f7a641e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a62ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a640b4560 0x7f7a641e1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51418/0 (socket says 172.21.15.1:51418) 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a62ffd640 1 -- 172.21.15.1:0/2343815323 learned_addr learned my addr 172.21.15.1:0/2343815323 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.089+0000 7f7a637fe640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6406d0d0 0x7f7a640b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a63fff640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a64149450 0x7f7a640b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a62ffd640 1 -- 172.21.15.1:0/2343815323 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a64149450 msgr2=0x7f7a640b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a62ffd640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a64149450 0x7f7a640b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a62ffd640 1 -- 172.21.15.1:0/2343815323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6406d0d0 msgr2=0x7f7a640b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a62ffd640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6406d0d0 0x7f7a640b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a62ffd640 1 -- 172.21.15.1:0/2343815323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a641e1a70 con 0x7f7a640b4560 2024-09-15T21:55:57.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a62ffd640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a640b4560 0x7f7a641e1530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7a58019060 tx=0x7f7a5801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:57.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a4bfff640 1 -- 172.21.15.1:0/2343815323 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a580b2070 con 0x7f7a640b4560 2024-09-15T21:55:57.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a4bfff640 1 -- 172.21.15.1:0/2343815323 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a580b3040 con 0x7f7a640b4560 2024-09-15T21:55:57.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a69df3640 1 -- 172.21.15.1:0/2343815323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a640b2900 con 0x7f7a640b4560 2024-09-15T21:55:57.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a4bfff640 1 -- 172.21.15.1:0/2343815323 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a580ad460 con 0x7f7a640b4560 2024-09-15T21:55:57.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a69df3640 1 -- 172.21.15.1:0/2343815323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a64070720 con 0x7f7a640b4560 2024-09-15T21:55:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a69df3640 1 -- 172.21.15.1:0/2343815323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a640b4940 con 0x7f7a640b4560 2024-09-15T21:55:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a4bfff640 1 -- 172.21.15.1:0/2343815323 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a580be060 con 0x7f7a640b4560 2024-09-15T21:55:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a4bfff640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7a500678c0 0x7f7a50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a4bfff640 1 -- 172.21.15.1:0/2343815323 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5709+0+0 (secure 0 0 0) 0x7f7a5811f150 con 0x7f7a640b4560 2024-09-15T21:55:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a637fe640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7a500678c0 0x7f7a50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:57.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.093+0000 7f7a637fe640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7a500678c0 0x7f7a50069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a540011f0 tx=0x7f7a54007d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:57.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.097+0000 7f7a4bfff640 1 -- 172.21.15.1:0/2343815323 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a580160d0 con 0x7f7a640b4560 2024-09-15T21:55:57.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:57.297+0000 7f7a69df3640 1 -- 172.21.15.1:0/2343815323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7a640b5510 con 0x7f7a640b4560 2024-09-15T21:55:58.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.265+0000 7f7a4bfff640 1 -- 172.21.15.1:0/2343815323 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f7a580efe00 con 0x7f7a640b4560 2024-09-15T21:55:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.269+0000 7f7a69df3640 1 -- 172.21.15.1:0/2343815323 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7a500678c0 msgr2=0x7f7a50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.269+0000 7f7a69df3640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7a500678c0 0x7f7a50069d80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a540011f0 tx=0x7f7a54007d40 comp rx=0 tx=0).stop 2024-09-15T21:55:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.269+0000 7f7a69df3640 1 -- 172.21.15.1:0/2343815323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a640b4560 msgr2=0x7f7a641e1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.269+0000 7f7a69df3640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a640b4560 0x7f7a641e1530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7a58019060 tx=0x7f7a5801ac90 comp rx=0 tx=0).stop 2024-09-15T21:55:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.269+0000 7f7a69df3640 1 -- 172.21.15.1:0/2343815323 shutdown_connections 2024-09-15T21:55:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.269+0000 7f7a69df3640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7a64149450 0x7f7a640b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.269+0000 7f7a69df3640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7a640b4560 0x7f7a641e1530 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.269+0000 7f7a69df3640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f7a500678c0 0x7f7a50069d80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.269+0000 7f7a69df3640 1 --2- 172.21.15.1:0/2343815323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a6406d0d0 0x7f7a640b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.269+0000 7f7a69df3640 1 -- 172.21.15.1:0/2343815323 >> 172.21.15.1:0/2343815323 conn(0x7f7a6406c730 msgr2=0x7f7a64143640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.269+0000 7f7a69df3640 1 -- 172.21.15.1:0/2343815323 shutdown_connections 2024-09-15T21:55:58.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.269+0000 7f7a69df3640 1 -- 172.21.15.1:0/2343815323 wait complete. 2024-09-15T21:55:58.299 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T21:55:58.300 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T21:55:58.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa18068640 1 Processor -- start 2024-09-15T21:55:58.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa18068640 1 -- start start 2024-09-15T21:55:58.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa18068640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa100b4560 0x7ffa100b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:58.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa18068640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ffa1006d0d0 0x7ffa10148d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:58.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa18068640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa101496c0 con 0x7ffa10149280 2024-09-15T21:55:58.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa18068640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7ffa1006dc00 con 0x7ffa1006d0d0 2024-09-15T21:55:58.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa18068640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1006d5b0 con 0x7ffa100b4560 2024-09-15T21:55:58.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa16605640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ffa10149280 0x7ffa1009dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41360/0 (socket says 172.21.15.1:41360) 2024-09-15T21:55:58.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa16605640 1 -- 172.21.15.1:0/1887374210 learned_addr learned my addr 172.21.15.1:0/1887374210 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:58.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa15e04640 1 --2- 172.21.15.1:0/1887374210 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa100b4560 0x7ffa100b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:58.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa15603640 1 --2- 172.21.15.1:0/1887374210 >> v2:172.21.15.70:3300/0 conn(0x7ffa1006d0d0 0x7ffa10148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:58.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa14e02640 1 -- 172.21.15.1:0/1887374210 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1383318806 0 0) 0x7ffa101496c0 con 0x7ffa10149280 2024-09-15T21:55:58.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa14e02640 1 -- 172.21.15.1:0/1887374210 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9fc003530 con 0x7ffa10149280 2024-09-15T21:55:58.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa15e04640 1 -- 172.21.15.1:0/1887374210 >> v2:172.21.15.70:3300/0 conn(0x7ffa1006d0d0 msgr2=0x7ffa10148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:58.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa15e04640 1 --2- 172.21.15.1:0/1887374210 >> v2:172.21.15.70:3300/0 conn(0x7ffa1006d0d0 0x7ffa10148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:58.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa15e04640 1 -- 172.21.15.1:0/1887374210 >> v1:172.21.15.1:6789/0 conn(0x7ffa10149280 legacy=0x7ffa1009dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:58.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa14e02640 1 -- 172.21.15.1:0/1887374210 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2589302330 0 0) 0x7ff9fc003530 con 0x7ffa10149280 2024-09-15T21:55:58.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.433+0000 7ffa15e04640 1 -- 172.21.15.1:0/1887374210 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1006d890 con 0x7ffa100b4560 2024-09-15T21:55:58.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa15e04640 1 --2- 172.21.15.1:0/1887374210 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa100b4560 0x7ffa100b4940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffa1006dd80 tx=0x7ffa0c01c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96af724cd636d75e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:58.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa14e02640 1 -- 172.21.15.1:0/1887374210 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0b0070 con 0x7ffa100b4560 2024-09-15T21:55:58.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa14e02640 1 -- 172.21.15.1:0/1887374210 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0ab400 con 0x7ffa100b4560 2024-09-15T21:55:58.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa14e02640 1 -- 172.21.15.1:0/1887374210 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08001a00 con 0x7ffa100b4560 2024-09-15T21:55:58.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 -- 172.21.15.1:0/1887374210 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa100b4560 msgr2=0x7ffa100b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:58.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 --2- 172.21.15.1:0/1887374210 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa100b4560 0x7ffa100b4940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffa1006dd80 tx=0x7ffa0c01c330 comp rx=0 tx=0).stop 2024-09-15T21:55:58.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 -- 172.21.15.1:0/1887374210 shutdown_connections 2024-09-15T21:55:58.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 --2- 172.21.15.1:0/1887374210 >> v2:172.21.15.70:3300/0 conn(0x7ffa1006d0d0 0x7ffa10148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:58.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 --2- 172.21.15.1:0/1887374210 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa100b4560 0x7ffa100b4940 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:58.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 -- 172.21.15.1:0/1887374210 >> 172.21.15.1:0/1887374210 conn(0x7ffa1006c730 msgr2=0x7ffa100b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:58.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 -- 172.21.15.1:0/1887374210 shutdown_connections 2024-09-15T21:55:58.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 -- 172.21.15.1:0/1887374210 wait complete. 2024-09-15T21:55:58.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 Processor -- start 2024-09-15T21:55:58.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 -- start start 2024-09-15T21:55:58.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa1006d0d0 0x7ffa10070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:58.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa100b4560 0x7ffa10070d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:58.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10149280 0x7ffa10071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:58.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ffa10152b20 con 0x7ffa100b4560 2024-09-15T21:55:58.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa101529a0 con 0x7ffa10149280 2024-09-15T21:55:58.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa18068640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ffa10152ca0 con 0x7ffa1006d0d0 2024-09-15T21:55:58.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa15603640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa100b4560 0x7ffa10070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:58.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa15603640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa100b4560 0x7ffa10070d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51430/0 (socket says 172.21.15.1:51430) 2024-09-15T21:55:58.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa15603640 1 -- 172.21.15.1:0/1584816659 learned_addr learned my addr 172.21.15.1:0/1584816659 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:58.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.437+0000 7ffa15e04640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa1006d0d0 0x7ffa10070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:58.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa16605640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10149280 0x7ffa10071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:58.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa15603640 1 -- 172.21.15.1:0/1584816659 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa1006d0d0 msgr2=0x7ffa10070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:58.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa15603640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa1006d0d0 0x7ffa10070570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:58.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa15603640 1 -- 172.21.15.1:0/1584816659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10149280 msgr2=0x7ffa10071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:58.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa15603640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10149280 0x7ffa10071280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:58.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa15603640 1 -- 172.21.15.1:0/1584816659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa10072830 con 0x7ffa100b4560 2024-09-15T21:55:58.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa16605640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10149280 0x7ffa10071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:58.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa15603640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa100b4560 0x7ffa10070d40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000e930 tx=0x7ffa0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:58.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa067fc640 1 -- 172.21.15.1:0/1584816659 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00017070 con 0x7ffa100b4560 2024-09-15T21:55:58.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa067fc640 1 -- 172.21.15.1:0/1584816659 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0000ca00 con 0x7ffa100b4560 2024-09-15T21:55:58.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa18068640 1 -- 172.21.15.1:0/1584816659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa10072b10 con 0x7ffa100b4560 2024-09-15T21:55:58.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa067fc640 1 -- 172.21.15.1:0/1584816659 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0000cdb0 con 0x7ffa100b4560 2024-09-15T21:55:58.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa18068640 1 -- 172.21.15.1:0/1584816659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa100afb00 con 0x7ffa100b4560 2024-09-15T21:55:58.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa18068640 1 -- 172.21.15.1:0/1584816659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa100b5510 con 0x7ffa100b4560 2024-09-15T21:55:58.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa067fc640 1 -- 172.21.15.1:0/1584816659 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffa0001a070 con 0x7ffa100b4560 2024-09-15T21:55:58.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa067fc640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff9f40678f0 0x7ff9f4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:58.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa067fc640 1 -- 172.21.15.1:0/1584816659 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7ffa000860a0 con 0x7ffa100b4560 2024-09-15T21:55:58.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa15e04640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff9f40678f0 0x7ff9f4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:58.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.441+0000 7ffa15e04640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff9f40678f0 0x7ff9f4069db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0ad000 tx=0x7ffa0c0a6000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:58.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.445+0000 7ffa067fc640 1 -- 172.21.15.1:0/1584816659 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffa00056ca0 con 0x7ffa100b4560 2024-09-15T21:55:58.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:58.645+0000 7ffa18068640 1 -- 172.21.15.1:0/1584816659 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ffa10148d20 con 0x7ffa100b4560 2024-09-15T21:55:59.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.273+0000 7ffa067fc640 1 -- 172.21.15.1:0/1584816659 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7ffa000565a0 con 0x7ffa100b4560 2024-09-15T21:55:59.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.277+0000 7ffa18068640 1 -- 172.21.15.1:0/1584816659 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff9f40678f0 msgr2=0x7ff9f4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.277+0000 7ffa18068640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff9f40678f0 0x7ff9f4069db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0ad000 tx=0x7ffa0c0a6000 comp rx=0 tx=0).stop 2024-09-15T21:55:59.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.277+0000 7ffa18068640 1 -- 172.21.15.1:0/1584816659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa100b4560 msgr2=0x7ffa10070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.277+0000 7ffa18068640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa100b4560 0x7ffa10070d40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000e930 tx=0x7ffa0000edf0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.277+0000 7ffa18068640 1 -- 172.21.15.1:0/1584816659 shutdown_connections 2024-09-15T21:55:59.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.277+0000 7ffa18068640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff9f40678f0 0x7ff9f4069db0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.277+0000 7ffa18068640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa10149280 0x7ffa10071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.277+0000 7ffa18068640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ffa100b4560 0x7ffa10070d40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.277+0000 7ffa18068640 1 --2- 172.21.15.1:0/1584816659 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa1006d0d0 0x7ffa10070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.277+0000 7ffa18068640 1 -- 172.21.15.1:0/1584816659 >> 172.21.15.1:0/1584816659 conn(0x7ffa1006c730 msgr2=0x7ffa10144d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:59.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.277+0000 7ffa18068640 1 -- 172.21.15.1:0/1584816659 shutdown_connections 2024-09-15T21:55:59.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.277+0000 7ffa18068640 1 -- 172.21.15.1:0/1584816659 wait complete. 2024-09-15T21:55:59.303 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T21:55:59.304 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:55:59.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.429+0000 7f0cf2f78640 1 Processor -- start 2024-09-15T21:55:59.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.429+0000 7f0cf2f78640 1 -- start start 2024-09-15T21:55:59.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cf2f78640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0cec1480c0 0x7f0cec1413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:59.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cf2f78640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cec0b6500 con 0x7f0cec148520 2024-09-15T21:55:59.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cf2f78640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cec14bc60 con 0x7f0cec0b6120 2024-09-15T21:55:59.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cf2f78640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f0cec14ba30 con 0x7f0cec1480c0 2024-09-15T21:55:59.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cebfff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0cec1480c0 0x7f0cec1413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:59.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cf1515640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f0cec148520 0x7f0cec1521d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41376/0 (socket says 172.21.15.1:41376) 2024-09-15T21:55:59.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cf1515640 1 -- 172.21.15.1:0/3349181419 learned_addr learned my addr 172.21.15.1:0/3349181419 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:55:59.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0ceb7fe640 1 -- 172.21.15.1:0/3349181419 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1422654546 0 0) 0x7f0cec0b6500 con 0x7f0cec148520 2024-09-15T21:55:59.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0ceb7fe640 1 -- 172.21.15.1:0/3349181419 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cd8003530 con 0x7f0cec148520 2024-09-15T21:55:59.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cebfff640 1 -- 172.21.15.1:0/3349181419 >> v1:172.21.15.70:6789/0 conn(0x7f0cec0b6120 legacy=0x7f0cec14b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cebfff640 1 -- 172.21.15.1:0/3349181419 >> v1:172.21.15.1:6789/0 conn(0x7f0cec148520 legacy=0x7f0cec1521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cebfff640 1 -- 172.21.15.1:0/3349181419 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cec147ba0 con 0x7f0cec1480c0 2024-09-15T21:55:59.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cebfff640 1 --2- 172.21.15.1:0/3349181419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec1480c0 0x7f0cec1413b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40097c0 tx=0x7f0cd401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b01cc1ff9fb27ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:59.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0ceb7fe640 1 -- 172.21.15.1:0/3349181419 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40b0070 con 0x7f0cec1480c0 2024-09-15T21:55:59.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0ceb7fe640 1 -- 172.21.15.1:0/3349181419 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd40ab600 con 0x7f0cec1480c0 2024-09-15T21:55:59.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0ceb7fe640 1 -- 172.21.15.1:0/3349181419 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40ab9d0 con 0x7f0cec1480c0 2024-09-15T21:55:59.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cf2f78640 1 -- 172.21.15.1:0/3349181419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec1480c0 msgr2=0x7f0cec1413b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cf2f78640 1 --2- 172.21.15.1:0/3349181419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec1480c0 0x7f0cec1413b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40097c0 tx=0x7f0cd401c410 comp rx=0 tx=0).stop 2024-09-15T21:55:59.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cf2f78640 1 -- 172.21.15.1:0/3349181419 shutdown_connections 2024-09-15T21:55:59.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cf2f78640 1 --2- 172.21.15.1:0/3349181419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec1480c0 0x7f0cec1413b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cf2f78640 1 -- 172.21.15.1:0/3349181419 >> 172.21.15.1:0/3349181419 conn(0x7f0cec0bd2f0 msgr2=0x7f0cec0bd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:59.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cf2f78640 1 -- 172.21.15.1:0/3349181419 shutdown_connections 2024-09-15T21:55:59.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.433+0000 7f0cf2f78640 1 -- 172.21.15.1:0/3349181419 wait complete. 2024-09-15T21:55:59.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf2f78640 1 Processor -- start 2024-09-15T21:55:59.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf2f78640 1 -- start start 2024-09-15T21:55:59.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf2f78640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cec0b6120 0x7f0cec14c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf2f78640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec1480c0 0x7f0cec142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf2f78640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cec148520 0x7f0cec142680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf2f78640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec156520 con 0x7f0cec1480c0 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf2f78640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec0b7c70 con 0x7f0cec0b6120 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf2f78640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f0cec1566a0 con 0x7f0cec148520 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cebfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec1480c0 0x7f0cec142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cebfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec1480c0 0x7f0cec142140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51442/0 (socket says 172.21.15.1:51442) 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cebfff640 1 -- 172.21.15.1:0/270260206 learned_addr learned my addr 172.21.15.1:0/270260206 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf0d14640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cec0b6120 0x7f0cec14c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf1515640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cec148520 0x7f0cec142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cebfff640 1 -- 172.21.15.1:0/270260206 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cec148520 msgr2=0x7f0cec142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cebfff640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cec148520 0x7f0cec142680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cebfff640 1 -- 172.21.15.1:0/270260206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cec0b6120 msgr2=0x7f0cec14c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cebfff640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cec0b6120 0x7f0cec14c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cebfff640 1 -- 172.21.15.1:0/270260206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cec0b8e90 con 0x7f0cec1480c0 2024-09-15T21:55:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf1515640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cec148520 0x7f0cec142680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf0d14640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cec0b6120 0x7f0cec14c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:55:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cebfff640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec1480c0 0x7f0cec142140 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4019020 tx=0x7f0cd40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0ce97fa640 1 -- 172.21.15.1:0/270260206 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40b8020 con 0x7f0cec1480c0 2024-09-15T21:55:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0ce97fa640 1 -- 172.21.15.1:0/270260206 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd40b4410 con 0x7f0cec1480c0 2024-09-15T21:55:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf2f78640 1 -- 172.21.15.1:0/270260206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cec143d90 con 0x7f0cec1480c0 2024-09-15T21:55:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0ce97fa640 1 -- 172.21.15.1:0/270260206 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40b0040 con 0x7f0cec1480c0 2024-09-15T21:55:59.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf2f78640 1 -- 172.21.15.1:0/270260206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cec14ca70 con 0x7f0cec1480c0 2024-09-15T21:55:59.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0cf2f78640 1 -- 172.21.15.1:0/270260206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cec1413b0 con 0x7f0cec1480c0 2024-09-15T21:55:59.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.437+0000 7f0ce97fa640 1 -- 172.21.15.1:0/270260206 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0cd40bb020 con 0x7f0cec1480c0 2024-09-15T21:55:59.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.441+0000 7f0ce97fa640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0ccc0678c0 0x7f0ccc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:59.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.441+0000 7f0ce97fa640 1 -- 172.21.15.1:0/270260206 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f0cd411f840 con 0x7f0cec1480c0 2024-09-15T21:55:59.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.441+0000 7f0cf0d14640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0ccc0678c0 0x7f0ccc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:59.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.441+0000 7f0cf0d14640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0ccc0678c0 0x7f0ccc069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4007fd0 tx=0x7f0ce4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:59.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.445+0000 7f0ce97fa640 1 -- 172.21.15.1:0/270260206 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0cd40c2030 con 0x7f0cec1480c0 2024-09-15T21:55:59.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.641+0000 7f0cf2f78640 1 -- 172.21.15.1:0/270260206 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cec0691c0 con 0x7f0cec1480c0 2024-09-15T21:55:59.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.645+0000 7f0ce97fa640 1 -- 172.21.15.1:0/270260206 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3570 (secure 0 0 0) 0x7f0cd40f6030 con 0x7f0cec1480c0 2024-09-15T21:55:59.648 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:59.648 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"btime":"2024-09-15T21:55:59:270348+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/3285517009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3285517009},{"type":"v1","addr":"172.21.15.70:6833","nonce":3285517009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:55.607624+0000","modified":"2024-09-15T21:55:58.650952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4731":{"gid":4731,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3595905659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3595905659},{"type":"v1","addr":"172.21.15.1:6835","nonce":3595905659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4731,"qdb_cluster":[4731]},"id":2}]} 2024-09-15T21:55:59.648 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 17 2024-09-15T21:55:59.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.645+0000 7f0cf2f78640 1 -- 172.21.15.1:0/270260206 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0ccc0678c0 msgr2=0x7f0ccc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.645+0000 7f0cf2f78640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0ccc0678c0 0x7f0ccc069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4007fd0 tx=0x7f0ce4009040 comp rx=0 tx=0).stop 2024-09-15T21:55:59.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.645+0000 7f0cf2f78640 1 -- 172.21.15.1:0/270260206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec1480c0 msgr2=0x7f0cec142140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.645+0000 7f0cf2f78640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec1480c0 0x7f0cec142140 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4019020 tx=0x7f0cd40191b0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.645+0000 7f0cf2f78640 1 -- 172.21.15.1:0/270260206 shutdown_connections 2024-09-15T21:55:59.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.645+0000 7f0cf2f78640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0cec148520 0x7f0cec142680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.645+0000 7f0cf2f78640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cec1480c0 0x7f0cec142140 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.645+0000 7f0cf2f78640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f0ccc0678c0 0x7f0ccc069d80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.645+0000 7f0cf2f78640 1 --2- 172.21.15.1:0/270260206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cec0b6120 0x7f0cec14c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.645+0000 7f0cf2f78640 1 -- 172.21.15.1:0/270260206 >> 172.21.15.1:0/270260206 conn(0x7f0cec0bd2f0 msgr2=0x7f0cec0bc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:59.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.645+0000 7f0cf2f78640 1 -- 172.21.15.1:0/270260206 shutdown_connections 2024-09-15T21:55:59.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.645+0000 7f0cf2f78640 1 -- 172.21.15.1:0/270260206 wait complete. 2024-09-15T21:55:59.668 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:55:59.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bdb0b3640 1 Processor -- start 2024-09-15T21:55:59.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bdb0b3640 1 -- start start 2024-09-15T21:55:59.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bdb0b3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd40b5600 0x7f2bd409ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:59.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bdb0b3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2bd4148f20 0x7f2bd41493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:59.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bdb0b3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd41498f0 con 0x7f2bd40b5220 2024-09-15T21:55:59.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bdb0b3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd409b800 con 0x7f2bd4148f20 2024-09-15T21:55:59.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bdb0b3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd40b4dd0 con 0x7f2bd40b5600 2024-09-15T21:55:59.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bd3fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd40b5600 0x7f2bd409ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:59.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bd9650640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2bd4148f20 0x7f2bd41493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:59.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bd3fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd40b5600 0x7f2bd409ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:50948/0 (socket says 172.21.15.1:50948) 2024-09-15T21:55:59.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bd3fff640 1 -- 172.21.15.1:0/3194611878 learned_addr learned my addr 172.21.15.1:0/3194611878 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:59.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bd3fff640 1 -- 172.21.15.1:0/3194611878 >> v2:172.21.15.70:3300/0 conn(0x7f2bd4148f20 msgr2=0x7f2bd41493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:55:59.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bd3fff640 1 --2- 172.21.15.1:0/3194611878 >> v2:172.21.15.70:3300/0 conn(0x7f2bd4148f20 0x7f2bd41493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bd3fff640 1 -- 172.21.15.1:0/3194611878 >> v1:172.21.15.70:6789/0 conn(0x7f2bd40b5220 legacy=0x7f2bd409aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.789+0000 7f2bd3fff640 1 -- 172.21.15.1:0/3194611878 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd40b6a50 con 0x7f2bd40b5600 2024-09-15T21:55:59.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bd3fff640 1 --2- 172.21.15.1:0/3194611878 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd40b5600 0x7f2bd409ee10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc009e50 tx=0x7f2bbc01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83bc58b7f5da1fdc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:59.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bd37fe640 1 -- 172.21.15.1:0/3194611878 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0a57a0 con 0x7f2bd40b5600 2024-09-15T21:55:59.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bd37fe640 1 -- 172.21.15.1:0/3194611878 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bbc0a5940 con 0x7f2bd40b5600 2024-09-15T21:55:59.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bd37fe640 1 -- 172.21.15.1:0/3194611878 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0a5d10 con 0x7f2bd40b5600 2024-09-15T21:55:59.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/3194611878 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd40b5600 msgr2=0x7f2bd409ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 --2- 172.21.15.1:0/3194611878 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd40b5600 0x7f2bd409ee10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc009e50 tx=0x7f2bbc01c8e0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/3194611878 shutdown_connections 2024-09-15T21:55:59.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 --2- 172.21.15.1:0/3194611878 >> v2:172.21.15.70:3300/0 conn(0x7f2bd4148f20 0x7f2bd41493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 --2- 172.21.15.1:0/3194611878 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd40b5600 0x7f2bd409ee10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/3194611878 >> 172.21.15.1:0/3194611878 conn(0x7f2bd40b5c40 msgr2=0x7f2bd40b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:59.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/3194611878 shutdown_connections 2024-09-15T21:55:59.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/3194611878 wait complete. 2024-09-15T21:55:59.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 Processor -- start 2024-09-15T21:55:59.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 -- start start 2024-09-15T21:55:59.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd40b5220 0x7f2bd40b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:59.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2bd40b5600 0x7f2bd40719b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:59.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bd4148f20 0x7f2bd4071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:59.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4152700 con 0x7f2bd40b5600 2024-09-15T21:55:59.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4152880 con 0x7f2bd4148f20 2024-09-15T21:55:59.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.793+0000 7f2bdb0b3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd4152a00 con 0x7f2bd40b5220 2024-09-15T21:55:59.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2bd40b5600 0x7f2bd40719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:59.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2bd40b5600 0x7f2bd40719b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51444/0 (socket says 172.21.15.1:51444) 2024-09-15T21:55:59.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd3fff640 1 -- 172.21.15.1:0/2212316934 learned_addr learned my addr 172.21.15.1:0/2212316934 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:55:59.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd8e4f640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd40b5220 0x7f2bd40b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:59.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd9650640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bd4148f20 0x7f2bd4071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:59.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd3fff640 1 -- 172.21.15.1:0/2212316934 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd40b5220 msgr2=0x7f2bd40b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd3fff640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd40b5220 0x7f2bd40b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd3fff640 1 -- 172.21.15.1:0/2212316934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bd4148f20 msgr2=0x7f2bd4071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd3fff640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bd4148f20 0x7f2bd4071ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd3fff640 1 -- 172.21.15.1:0/2212316934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd41432a0 con 0x7f2bd40b5600 2024-09-15T21:55:59.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd8e4f640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd40b5220 0x7f2bd40b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:55:59.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd3fff640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2bd40b5600 0x7f2bd40719b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc01a510 tx=0x7f2bbc019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:59.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd17fa640 1 -- 172.21.15.1:0/2212316934 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0bc020 con 0x7f2bd40b5600 2024-09-15T21:55:59.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd17fa640 1 -- 172.21.15.1:0/2212316934 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bbc0b8670 con 0x7f2bd40b5600 2024-09-15T21:55:59.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/2212316934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd4139870 con 0x7f2bd40b5600 2024-09-15T21:55:59.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd17fa640 1 -- 172.21.15.1:0/2212316934 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0b8a40 con 0x7f2bd40b5600 2024-09-15T21:55:59.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/2212316934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd4071490 con 0x7f2bd40b5600 2024-09-15T21:55:59.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/2212316934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd409ee10 con 0x7f2bd40b5600 2024-09-15T21:55:59.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd17fa640 1 -- 172.21.15.1:0/2212316934 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2bbc0bf020 con 0x7f2bd40b5600 2024-09-15T21:55:59.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd17fa640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2bb40678c0 0x7f2bb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:55:59.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd17fa640 1 -- 172.21.15.1:0/2212316934 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f2bbc120de0 con 0x7f2bd40b5600 2024-09-15T21:55:59.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd8e4f640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2bb40678c0 0x7f2bb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:55:59.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.797+0000 7f2bd8e4f640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2bb40678c0 0x7f2bb4069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4001670 tx=0x7f2bc4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:55:59.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.801+0000 7f2bd17fa640 1 -- 172.21.15.1:0/2212316934 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2bbc0c6030 con 0x7f2bd40b5600 2024-09-15T21:55:59.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.969+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/2212316934 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bd4073180 con 0x7f2bd40b5600 2024-09-15T21:55:59.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.969+0000 7f2bd17fa640 1 -- 172.21.15.1:0/2212316934 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16657 (secure 0 0 0) 0x7f2bbc016620 con 0x7f2bd40b5600 2024-09-15T21:55:59.975 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:55:59.975 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":30,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:57.260341+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:53.499944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:54.604026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:55:59.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.973+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/2212316934 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2bb40678c0 msgr2=0x7f2bb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.973+0000 7f2bdb0b3640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2bb40678c0 0x7f2bb4069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4001670 tx=0x7f2bc4009040 comp rx=0 tx=0).stop 2024-09-15T21:55:59.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.973+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/2212316934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2bd40b5600 msgr2=0x7f2bd40719b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:55:59.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.973+0000 7f2bdb0b3640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2bd40b5600 0x7f2bd40719b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc01a510 tx=0x7f2bbc019680 comp rx=0 tx=0).stop 2024-09-15T21:55:59.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.973+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/2212316934 shutdown_connections 2024-09-15T21:55:59.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.973+0000 7f2bdb0b3640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f2bb40678c0 0x7f2bb4069d80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.973+0000 7f2bdb0b3640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bd4148f20 0x7f2bd4071ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.973+0000 7f2bdb0b3640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2bd40b5600 0x7f2bd40719b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.973+0000 7f2bdb0b3640 1 --2- 172.21.15.1:0/2212316934 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd40b5220 0x7f2bd40b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:55:59.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.973+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/2212316934 >> 172.21.15.1:0/2212316934 conn(0x7f2bd40b5c40 msgr2=0x7f2bd413e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:55:59.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.973+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/2212316934 shutdown_connections 2024-09-15T21:55:59.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:55:59.973+0000 7f2bdb0b3640 1 -- 172.21.15.1:0/2212316934 wait complete. 2024-09-15T21:55:59.995 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T21:55:59.995 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:56:00.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8677002640 1 Processor -- start 2024-09-15T21:56:00.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8677002640 1 -- start start 2024-09-15T21:56:00.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8677002640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8670147bd0 0x7f8670148060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8677002640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8670150110 0x7f8670152500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8677002640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86701485a0 con 0x7f867006bf20 2024-09-15T21:56:00.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8677002640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f86700b6670 con 0x7f8670147bd0 2024-09-15T21:56:00.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8677002640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f867006c300 con 0x7f8670150110 2024-09-15T21:56:00.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8674d9e640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f867006bf20 0x7f8670141700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41382/0 (socket says 172.21.15.1:41382) 2024-09-15T21:56:00.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8674d9e640 1 -- 172.21.15.1:0/2825143094 learned_addr learned my addr 172.21.15.1:0/2825143094 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8667fff640 1 --2- 172.21.15.1:0/2825143094 >> v2:172.21.15.70:3300/0 conn(0x7f8670147bd0 0x7f8670148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f867559f640 1 --2- 172.21.15.1:0/2825143094 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8670150110 0x7f8670152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1957616851 0 0) 0x7f86701485a0 con 0x7f867006bf20 2024-09-15T21:56:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8658003530 con 0x7f867006bf20 2024-09-15T21:56:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 554337958 0 0) 0x7f8658003530 con 0x7f867006bf20 2024-09-15T21:56:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8670150110 msgr2=0x7f8670152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 --2- 172.21.15.1:0/2825143094 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8670150110 0x7f8670152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 >> v2:172.21.15.70:3300/0 conn(0x7f8670147bd0 msgr2=0x7f8670148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 --2- 172.21.15.1:0/2825143094 >> v2:172.21.15.70:3300/0 conn(0x7f8670147bd0 0x7f8670148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86700afa00 con 0x7f867006bf20 2024-09-15T21:56:00.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f866c001680 con 0x7f867006bf20 2024-09-15T21:56:00.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 >> v1:172.21.15.1:6789/0 conn(0x7f867006bf20 legacy=0x7f8670141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 --2- 172.21.15.1:0/2825143094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86580039c0 0x7f8658003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 --2- 172.21.15.1:0/2825143094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8658004810 0x7f8658004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 --2- 172.21.15.1:0/2825143094 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8670150110 0x7f86580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f86700b6670 con 0x7f8658004810 2024-09-15T21:56:00.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f867006c300 con 0x7f86580039c0 2024-09-15T21:56:00.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f865800b9d0 con 0x7f8670150110 2024-09-15T21:56:00.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8667fff640 1 --2- 172.21.15.1:0/2825143094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8658004810 0x7f8658004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8674d9e640 1 --2- 172.21.15.1:0/2825143094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86580039c0 0x7f8658003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f867559f640 1 --2- 172.21.15.1:0/2825143094 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8670150110 0x7f86580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8667fff640 1 -- 172.21.15.1:0/2825143094 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8670150110 msgr2=0x7f86580051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8667fff640 1 --2- 172.21.15.1:0/2825143094 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8670150110 0x7f86580051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8667fff640 1 -- 172.21.15.1:0/2825143094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86580039c0 msgr2=0x7f8658003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8667fff640 1 --2- 172.21.15.1:0/2825143094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86580039c0 0x7f8658003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.113+0000 7f8667fff640 1 -- 172.21.15.1:0/2825143094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8658003530 con 0x7f8658004810 2024-09-15T21:56:00.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8667fff640 1 --2- 172.21.15.1:0/2825143094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8658004810 0x7f8658004c90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8660009b10 tx=0x7f866001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3745165a546981a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:00.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86600096b0 con 0x7f8658004810 2024-09-15T21:56:00.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86600a8410 con 0x7f8658004810 2024-09-15T21:56:00.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f86677fe640 1 -- 172.21.15.1:0/2825143094 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86600a8800 con 0x7f8658004810 2024-09-15T21:56:00.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 -- 172.21.15.1:0/2825143094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8658004810 msgr2=0x7f8658004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 --2- 172.21.15.1:0/2825143094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8658004810 0x7f8658004c90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8660009b10 tx=0x7f866001cab0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f867559f640 1 -- 172.21.15.1:0/2825143094 reap_dead start 2024-09-15T21:56:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 -- 172.21.15.1:0/2825143094 shutdown_connections 2024-09-15T21:56:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 -- 172.21.15.1:0/2825143094 >> 172.21.15.1:0/2825143094 conn(0x7f86700b6e30 msgr2=0x7f86700b7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 -- 172.21.15.1:0/2825143094 shutdown_connections 2024-09-15T21:56:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 -- 172.21.15.1:0/2825143094 wait complete. 2024-09-15T21:56:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 Processor -- start 2024-09-15T21:56:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 -- start start 2024-09-15T21:56:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8658004810 0x7f86701e3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86700b17a0 0x7f86701e35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86701dfe20 0x7f86701e02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f867006ca00 con 0x7f86700b17a0 2024-09-15T21:56:00.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f86700b13b0 con 0x7f8658004810 2024-09-15T21:56:00.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8677002640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f867006cb80 con 0x7f86701dfe20 2024-09-15T21:56:00.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8667fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86700b17a0 0x7f86701e35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8667fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86700b17a0 0x7f86701e35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51464/0 (socket says 172.21.15.1:51464) 2024-09-15T21:56:00.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8667fff640 1 -- 172.21.15.1:0/596425798 learned_addr learned my addr 172.21.15.1:0/596425798 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:00.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f8674d9e640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8658004810 0x7f86701e3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.117+0000 7f867559f640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86701dfe20 0x7f86701e02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f8667fff640 1 -- 172.21.15.1:0/596425798 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86701dfe20 msgr2=0x7f86701e02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f8667fff640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86701dfe20 0x7f86701e02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f8667fff640 1 -- 172.21.15.1:0/596425798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8658004810 msgr2=0x7f86701e3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f8667fff640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8658004810 0x7f86701e3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f8667fff640 1 -- 172.21.15.1:0/596425798 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867009fd00 con 0x7f86700b17a0 2024-09-15T21:56:00.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f867559f640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86701dfe20 0x7f86701e02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:00.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f8667fff640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86700b17a0 0x7f86701e35f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8660009b10 tx=0x7f8660019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:00.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f86657fa640 1 -- 172.21.15.1:0/596425798 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86600a8b40 con 0x7f86700b17a0 2024-09-15T21:56:00.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f86657fa640 1 -- 172.21.15.1:0/596425798 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86600a8ce0 con 0x7f86700b17a0 2024-09-15T21:56:00.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f8677002640 1 -- 172.21.15.1:0/596425798 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86700a0250 con 0x7f86700b17a0 2024-09-15T21:56:00.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f86657fa640 1 -- 172.21.15.1:0/596425798 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86600bc690 con 0x7f86700b17a0 2024-09-15T21:56:00.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f8677002640 1 -- 172.21.15.1:0/596425798 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867009ff70 con 0x7f86700b17a0 2024-09-15T21:56:00.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f8677002640 1 -- 172.21.15.1:0/596425798 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86701e3b30 con 0x7f86700b17a0 2024-09-15T21:56:00.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f86657fa640 1 -- 172.21.15.1:0/596425798 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f86600bc830 con 0x7f86700b17a0 2024-09-15T21:56:00.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f86657fa640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f865c0678c0 0x7f865c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f8674d9e640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f865c0678c0 0x7f865c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f86657fa640 1 -- 172.21.15.1:0/596425798 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f86601200e0 con 0x7f86700b17a0 2024-09-15T21:56:00.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.121+0000 7f8674d9e640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f865c0678c0 0x7f865c069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f866c001060 tx=0x7f866c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:00.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.125+0000 7f86657fa640 1 -- 172.21.15.1:0/596425798 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f86600ac030 con 0x7f86700b17a0 2024-09-15T21:56:00.196 INFO:tasks.ceph.mds.a.smithi001.stderr:2024-09-15T21:56:00.193+0000 7f19a1922640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T21:56:00.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.285+0000 7f8677002640 1 -- 172.21.15.1:0/596425798 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86700b3870 con 0x7f865c0678c0 2024-09-15T21:56:00.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.305+0000 7f86657fa640 1 -- 172.21.15.1:0/596425798 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248189 (secure 0 0 0) 0x7f86700b3870 con 0x7f865c0678c0 2024-09-15T21:56:00.310 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:00.312 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:56:00.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.305+0000 7f8677002640 1 -- 172.21.15.1:0/596425798 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f865c0678c0 msgr2=0x7f865c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.305+0000 7f8677002640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f865c0678c0 0x7f865c069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f866c001060 tx=0x7f866c009040 comp rx=0 tx=0).stop 2024-09-15T21:56:00.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.305+0000 7f8677002640 1 -- 172.21.15.1:0/596425798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86700b17a0 msgr2=0x7f86701e35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.309+0000 7f8677002640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86700b17a0 0x7f86701e35f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8660009b10 tx=0x7f8660019850 comp rx=0 tx=0).stop 2024-09-15T21:56:00.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.309+0000 7f8677002640 1 -- 172.21.15.1:0/596425798 shutdown_connections 2024-09-15T21:56:00.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.309+0000 7f8677002640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86701dfe20 0x7f86701e02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.309+0000 7f8677002640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86700b17a0 0x7f86701e35f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.309+0000 7f8677002640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f865c0678c0 0x7f865c069d80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.309+0000 7f8677002640 1 --2- 172.21.15.1:0/596425798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8658004810 0x7f86701e3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.309+0000 7f8677002640 1 -- 172.21.15.1:0/596425798 >> 172.21.15.1:0/596425798 conn(0x7f86700b6e30 msgr2=0x7f86700b8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:00.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.309+0000 7f8677002640 1 -- 172.21.15.1:0/596425798 shutdown_connections 2024-09-15T21:56:00.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.309+0000 7f8677002640 1 -- 172.21.15.1:0/596425798 wait complete. 2024-09-15T21:56:00.328 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-15T21:55:59.089025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257184,"kb_used_data":3512,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754717536,"statfs":{"total":773094113280,"available":772830756864,"internally_reserved":0,"allocated":3596288,"data_stored":2071444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.875523"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.226282+0000","last_change":"2024-09-15T21:55:55.226282+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.226282+0000","last_undegraded":"2024-09-15T21:55:55.226282+0000","last_fullsized":"2024-09-15T21:55:55.226282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230490+0000","last_change":"2024-09-15T21:55:55.230490+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230490+0000","last_undegraded":"2024-09-15T21:55:55.230490+0000","last_fullsized":"2024-09-15T21:55:55.230490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.234702+0000","last_change":"2024-09-15T21:55:55.234702+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.234702+0000","last_undegraded":"2024-09-15T21:55:55.234702+0000","last_fullsized":"2024-09-15T21:55:55.234702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230208+0000","last_change":"2024-09-15T21:55:55.230208+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230208+0000","last_undegraded":"2024-09-15T21:55:55.230208+0000","last_fullsized":"2024-09-15T21:55:55.230208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293463+0000","last_change":"2024-09-15T21:55:56.285178+0000","last_active":"2024-09-15T21:55:57.293463+0000","last_peered":"2024-09-15T21:55:57.293463+0000","last_clean":"2024-09-15T21:55:57.293463+0000","last_became_active":"2024-09-15T21:55:56.284915+0000","last_became_peered":"2024-09-15T21:55:56.284915+0000","last_unstale":"2024-09-15T21:55:57.293463+0000","last_undegraded":"2024-09-15T21:55:57.293463+0000","last_fullsized":"2024-09-15T21:55:57.293463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:53.134305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230652+0000","last_change":"2024-09-15T21:55:55.230652+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230652+0000","last_undegraded":"2024-09-15T21:55:55.230652+0000","last_fullsized":"2024-09-15T21:55:55.230652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294848+0000","last_change":"2024-09-15T21:55:56.289977+0000","last_active":"2024-09-15T21:55:57.294848+0000","last_peered":"2024-09-15T21:55:57.294848+0000","last_clean":"2024-09-15T21:55:57.294848+0000","last_became_active":"2024-09-15T21:55:56.288235+0000","last_became_peered":"2024-09-15T21:55:56.288235+0000","last_unstale":"2024-09-15T21:55:57.294848+0000","last_undegraded":"2024-09-15T21:55:57.294848+0000","last_fullsized":"2024-09-15T21:55:57.294848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:28.668639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294435+0000","last_change":"2024-09-15T21:55:56.274499+0000","last_active":"2024-09-15T21:55:57.294435+0000","last_peered":"2024-09-15T21:55:57.294435+0000","last_clean":"2024-09-15T21:55:57.294435+0000","last_became_active":"2024-09-15T21:55:56.273194+0000","last_became_peered":"2024-09-15T21:55:56.273194+0000","last_unstale":"2024-09-15T21:55:57.294435+0000","last_undegraded":"2024-09-15T21:55:57.294435+0000","last_fullsized":"2024-09-15T21:55:57.294435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.255317+0000","last_change":"2024-09-15T21:55:55.255317+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.255317+0000","last_undegraded":"2024-09-15T21:55:55.255317+0000","last_fullsized":"2024-09-15T21:55:55.255317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229145+0000","last_change":"2024-09-15T21:55:55.229145+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229145+0000","last_undegraded":"2024-09-15T21:55:55.229145+0000","last_fullsized":"2024-09-15T21:55:55.229145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295306+0000","last_change":"2024-09-15T21:55:56.275939+0000","last_active":"2024-09-15T21:55:57.295306+0000","last_peered":"2024-09-15T21:55:57.295306+0000","last_clean":"2024-09-15T21:55:57.295306+0000","last_became_active":"2024-09-15T21:55:56.275185+0000","last_became_peered":"2024-09-15T21:55:56.275185+0000","last_unstale":"2024-09-15T21:55:57.295306+0000","last_undegraded":"2024-09-15T21:55:57.295306+0000","last_fullsized":"2024-09-15T21:55:57.295306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:04.577354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.235561+0000","last_change":"2024-09-15T21:55:55.235561+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.235561+0000","last_undegraded":"2024-09-15T21:55:55.235561+0000","last_fullsized":"2024-09-15T21:55:55.235561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293562+0000","last_change":"2024-09-15T21:55:56.278716+0000","last_active":"2024-09-15T21:55:57.293562+0000","last_peered":"2024-09-15T21:55:57.293562+0000","last_clean":"2024-09-15T21:55:57.293562+0000","last_became_active":"2024-09-15T21:55:56.277722+0000","last_became_peered":"2024-09-15T21:55:56.277722+0000","last_unstale":"2024-09-15T21:55:57.293562+0000","last_undegraded":"2024-09-15T21:55:57.293562+0000","last_fullsized":"2024-09-15T21:55:57.293562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:18.528351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230066+0000","last_change":"2024-09-15T21:55:55.230066+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230066+0000","last_undegraded":"2024-09-15T21:55:55.230066+0000","last_fullsized":"2024-09-15T21:55:55.230066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.231822+0000","last_change":"2024-09-15T21:55:55.231822+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.231822+0000","last_undegraded":"2024-09-15T21:55:55.231822+0000","last_fullsized":"2024-09-15T21:55:55.231822+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295625+0000","last_change":"2024-09-15T21:55:56.300687+0000","last_active":"2024-09-15T21:55:57.295625+0000","last_peered":"2024-09-15T21:55:57.295625+0000","last_clean":"2024-09-15T21:55:57.295625+0000","last_became_active":"2024-09-15T21:55:56.300004+0000","last_became_peered":"2024-09-15T21:55:56.300004+0000","last_unstale":"2024-09-15T21:55:57.295625+0000","last_undegraded":"2024-09-15T21:55:57.295625+0000","last_fullsized":"2024-09-15T21:55:57.295625+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:47.385096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295452+0000","last_change":"2024-09-15T21:55:56.277883+0000","last_active":"2024-09-15T21:55:57.295452+0000","last_peered":"2024-09-15T21:55:57.295452+0000","last_clean":"2024-09-15T21:55:57.295452+0000","last_became_active":"2024-09-15T21:55:56.277149+0000","last_became_peered":"2024-09-15T21:55:56.277149+0000","last_unstale":"2024-09-15T21:55:57.295452+0000","last_undegraded":"2024-09-15T21:55:57.295452+0000","last_fullsized":"2024-09-15T21:55:57.295452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:54.377784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229862+0000","last_change":"2024-09-15T21:55:55.229862+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229862+0000","last_undegraded":"2024-09-15T21:55:55.229862+0000","last_fullsized":"2024-09-15T21:55:55.229862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228248+0000","last_change":"2024-09-15T21:55:55.228248+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228248+0000","last_undegraded":"2024-09-15T21:55:55.228248+0000","last_fullsized":"2024-09-15T21:55:55.228248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293340+0000","last_change":"2024-09-15T21:55:56.308957+0000","last_active":"2024-09-15T21:55:57.293340+0000","last_peered":"2024-09-15T21:55:57.293340+0000","last_clean":"2024-09-15T21:55:57.293340+0000","last_became_active":"2024-09-15T21:55:56.308655+0000","last_became_peered":"2024-09-15T21:55:56.308655+0000","last_unstale":"2024-09-15T21:55:57.293340+0000","last_undegraded":"2024-09-15T21:55:57.293340+0000","last_fullsized":"2024-09-15T21:55:57.293340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:42.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.255281+0000","last_change":"2024-09-15T21:55:55.255281+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.255281+0000","last_undegraded":"2024-09-15T21:55:55.255281+0000","last_fullsized":"2024-09-15T21:55:55.255281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.231596+0000","last_change":"2024-09-15T21:55:55.231596+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.231596+0000","last_undegraded":"2024-09-15T21:55:55.231596+0000","last_fullsized":"2024-09-15T21:55:55.231596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.224324+0000","last_change":"2024-09-15T21:55:55.224324+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.224324+0000","last_undegraded":"2024-09-15T21:55:55.224324+0000","last_fullsized":"2024-09-15T21:55:55.224324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230946+0000","last_change":"2024-09-15T21:55:55.230946+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230946+0000","last_undegraded":"2024-09-15T21:55:55.230946+0000","last_fullsized":"2024-09-15T21:55:55.230946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229576+0000","last_change":"2024-09-15T21:55:55.229576+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229576+0000","last_undegraded":"2024-09-15T21:55:55.229576+0000","last_fullsized":"2024-09-15T21:55:55.229576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228310+0000","last_change":"2024-09-15T21:55:55.228310+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228310+0000","last_undegraded":"2024-09-15T21:55:55.228310+0000","last_fullsized":"2024-09-15T21:55:55.228310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230086+0000","last_change":"2024-09-15T21:55:55.230086+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230086+0000","last_undegraded":"2024-09-15T21:55:55.230086+0000","last_fullsized":"2024-09-15T21:55:55.230086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.234426+0000","last_change":"2024-09-15T21:55:55.234426+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.234426+0000","last_undegraded":"2024-09-15T21:55:55.234426+0000","last_fullsized":"2024-09-15T21:55:55.234426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.233282+0000","last_change":"2024-09-15T21:55:55.233282+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.233282+0000","last_undegraded":"2024-09-15T21:55:55.233282+0000","last_fullsized":"2024-09-15T21:55:55.233282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295041+0000","last_change":"2024-09-15T21:55:56.278013+0000","last_active":"2024-09-15T21:55:57.295041+0000","last_peered":"2024-09-15T21:55:57.295041+0000","last_clean":"2024-09-15T21:55:57.295041+0000","last_became_active":"2024-09-15T21:55:56.277260+0000","last_became_peered":"2024-09-15T21:55:56.277260+0000","last_unstale":"2024-09-15T21:55:57.295041+0000","last_undegraded":"2024-09-15T21:55:57.295041+0000","last_fullsized":"2024-09-15T21:55:57.295041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:07.090183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.227090+0000","last_change":"2024-09-15T21:55:55.227090+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.227090+0000","last_undegraded":"2024-09-15T21:55:55.227090+0000","last_fullsized":"2024-09-15T21:55:55.227090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294405+0000","last_change":"2024-09-15T21:55:56.298083+0000","last_active":"2024-09-15T21:55:57.294405+0000","last_peered":"2024-09-15T21:55:57.294405+0000","last_clean":"2024-09-15T21:55:57.294405+0000","last_became_active":"2024-09-15T21:55:56.286370+0000","last_became_peered":"2024-09-15T21:55:56.286370+0000","last_unstale":"2024-09-15T21:55:57.294405+0000","last_undegraded":"2024-09-15T21:55:57.294405+0000","last_fullsized":"2024-09-15T21:55:57.294405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:40.099978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.224764+0000","last_change":"2024-09-15T21:55:55.224764+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.224764+0000","last_undegraded":"2024-09-15T21:55:55.224764+0000","last_fullsized":"2024-09-15T21:55:55.224764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.252556+0000","last_change":"2024-09-15T21:55:55.249652+0000","last_active":"2024-09-15T21:55:55.252556+0000","last_peered":"2024-09-15T21:55:55.252556+0000","last_clean":"2024-09-15T21:55:55.252556+0000","last_became_active":"2024-09-15T21:55:55.248947+0000","last_became_peered":"2024-09-15T21:55:55.248947+0000","last_unstale":"2024-09-15T21:55:55.252556+0000","last_undegraded":"2024-09-15T21:55:55.252556+0000","last_fullsized":"2024-09-15T21:55:55.252556+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:44.329135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.225091+0000","last_change":"2024-09-15T21:55:55.225091+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.225091+0000","last_undegraded":"2024-09-15T21:55:55.225091+0000","last_fullsized":"2024-09-15T21:55:55.225091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.242840+0000","last_change":"2024-09-15T21:55:55.240388+0000","last_active":"2024-09-15T21:55:55.242840+0000","last_peered":"2024-09-15T21:55:55.242840+0000","last_clean":"2024-09-15T21:55:55.242840+0000","last_became_active":"2024-09-15T21:55:55.239837+0000","last_became_peered":"2024-09-15T21:55:55.239837+0000","last_unstale":"2024-09-15T21:55:55.242840+0000","last_undegraded":"2024-09-15T21:55:55.242840+0000","last_fullsized":"2024-09-15T21:55:55.242840+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:34:47.778872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229016+0000","last_change":"2024-09-15T21:55:55.229016+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229016+0000","last_undegraded":"2024-09-15T21:55:55.229016+0000","last_fullsized":"2024-09-15T21:55:55.229016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.242212+0000","last_change":"2024-09-15T21:55:55.240018+0000","last_active":"2024-09-15T21:55:55.242212+0000","last_peered":"2024-09-15T21:55:55.242212+0000","last_clean":"2024-09-15T21:55:55.242212+0000","last_became_active":"2024-09-15T21:55:55.239512+0000","last_became_peered":"2024-09-15T21:55:55.239512+0000","last_unstale":"2024-09-15T21:55:55.242212+0000","last_undegraded":"2024-09-15T21:55:55.242212+0000","last_fullsized":"2024-09-15T21:55:55.242212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:25.819619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.227070+0000","last_change":"2024-09-15T21:55:55.227070+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.227070+0000","last_undegraded":"2024-09-15T21:55:55.227070+0000","last_fullsized":"2024-09-15T21:55:55.227070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293444+0000","last_change":"2024-09-15T21:55:55.241122+0000","last_active":"2024-09-15T21:55:57.293444+0000","last_peered":"2024-09-15T21:55:57.293444+0000","last_clean":"2024-09-15T21:55:57.293444+0000","last_became_active":"2024-09-15T21:55:55.240704+0000","last_became_peered":"2024-09-15T21:55:55.240704+0000","last_unstale":"2024-09-15T21:55:57.293444+0000","last_undegraded":"2024-09-15T21:55:57.293444+0000","last_fullsized":"2024-09-15T21:55:57.293444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:13.090176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295034+0000","last_change":"2024-09-15T21:55:56.288570+0000","last_active":"2024-09-15T21:55:57.295034+0000","last_peered":"2024-09-15T21:55:57.295034+0000","last_clean":"2024-09-15T21:55:57.295034+0000","last_became_active":"2024-09-15T21:55:56.279697+0000","last_became_peered":"2024-09-15T21:55:56.279697+0000","last_unstale":"2024-09-15T21:55:57.295034+0000","last_undegraded":"2024-09-15T21:55:57.295034+0000","last_fullsized":"2024-09-15T21:55:57.295034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:44.393748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266728+0000","last_change":"2024-09-15T21:55:55.260925+0000","last_active":"2024-09-15T21:55:55.266728+0000","last_peered":"2024-09-15T21:55:55.266728+0000","last_clean":"2024-09-15T21:55:55.266728+0000","last_became_active":"2024-09-15T21:55:55.257306+0000","last_became_peered":"2024-09-15T21:55:55.257306+0000","last_unstale":"2024-09-15T21:55:55.266728+0000","last_undegraded":"2024-09-15T21:55:55.266728+0000","last_fullsized":"2024-09-15T21:55:55.266728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:25.926217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.232427+0000","last_change":"2024-09-15T21:55:55.232427+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.232427+0000","last_undegraded":"2024-09-15T21:55:55.232427+0000","last_fullsized":"2024-09-15T21:55:55.232427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266754+0000","last_change":"2024-09-15T21:55:55.261177+0000","last_active":"2024-09-15T21:55:55.266754+0000","last_peered":"2024-09-15T21:55:55.266754+0000","last_clean":"2024-09-15T21:55:55.266754+0000","last_became_active":"2024-09-15T21:55:55.256722+0000","last_became_peered":"2024-09-15T21:55:55.256722+0000","last_unstale":"2024-09-15T21:55:55.266754+0000","last_undegraded":"2024-09-15T21:55:55.266754+0000","last_fullsized":"2024-09-15T21:55:55.266754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:16:53.722416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230410+0000","last_change":"2024-09-15T21:55:55.230410+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230410+0000","last_undegraded":"2024-09-15T21:55:55.230410+0000","last_fullsized":"2024-09-15T21:55:55.230410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.240719+0000","last_change":"2024-09-15T21:55:55.235928+0000","last_active":"2024-09-15T21:55:55.240719+0000","last_peered":"2024-09-15T21:55:55.240719+0000","last_clean":"2024-09-15T21:55:55.240719+0000","last_became_active":"2024-09-15T21:55:55.235501+0000","last_became_peered":"2024-09-15T21:55:55.235501+0000","last_unstale":"2024-09-15T21:55:55.240719+0000","last_undegraded":"2024-09-15T21:55:55.240719+0000","last_fullsized":"2024-09-15T21:55:55.240719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:58.304088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.227139+0000","last_change":"2024-09-15T21:55:55.227139+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.227139+0000","last_undegraded":"2024-09-15T21:55:55.227139+0000","last_fullsized":"2024-09-15T21:55:55.227139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266906+0000","last_change":"2024-09-15T21:55:55.262772+0000","last_active":"2024-09-15T21:55:55.266906+0000","last_peered":"2024-09-15T21:55:55.266906+0000","last_clean":"2024-09-15T21:55:55.266906+0000","last_became_active":"2024-09-15T21:55:55.262001+0000","last_became_peered":"2024-09-15T21:55:55.262001+0000","last_unstale":"2024-09-15T21:55:55.266906+0000","last_undegraded":"2024-09-15T21:55:55.266906+0000","last_fullsized":"2024-09-15T21:55:55.266906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:45:57.077886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230359+0000","last_change":"2024-09-15T21:55:55.230359+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230359+0000","last_undegraded":"2024-09-15T21:55:55.230359+0000","last_fullsized":"2024-09-15T21:55:55.230359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.252235+0000","last_change":"2024-09-15T21:55:55.251449+0000","last_active":"2024-09-15T21:55:55.252235+0000","last_peered":"2024-09-15T21:55:55.252235+0000","last_clean":"2024-09-15T21:55:55.252235+0000","last_became_active":"2024-09-15T21:55:55.251192+0000","last_became_peered":"2024-09-15T21:55:55.251192+0000","last_unstale":"2024-09-15T21:55:55.252235+0000","last_undegraded":"2024-09-15T21:55:55.252235+0000","last_fullsized":"2024-09-15T21:55:55.252235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:05.391521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.226032+0000","last_change":"2024-09-15T21:55:55.226032+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.226032+0000","last_undegraded":"2024-09-15T21:55:55.226032+0000","last_fullsized":"2024-09-15T21:55:55.226032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.238189+0000","last_change":"2024-09-15T21:55:55.234667+0000","last_active":"2024-09-15T21:55:55.238189+0000","last_peered":"2024-09-15T21:55:55.238189+0000","last_clean":"2024-09-15T21:55:55.238189+0000","last_became_active":"2024-09-15T21:55:55.234277+0000","last_became_peered":"2024-09-15T21:55:55.234277+0000","last_unstale":"2024-09-15T21:55:55.238189+0000","last_undegraded":"2024-09-15T21:55:55.238189+0000","last_fullsized":"2024-09-15T21:55:55.238189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:03.652358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228532+0000","last_change":"2024-09-15T21:55:55.228532+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228532+0000","last_undegraded":"2024-09-15T21:55:55.228532+0000","last_fullsized":"2024-09-15T21:55:55.228532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.249211+0000","last_change":"2024-09-15T21:55:55.246855+0000","last_active":"2024-09-15T21:55:55.249211+0000","last_peered":"2024-09-15T21:55:55.249211+0000","last_clean":"2024-09-15T21:55:55.249211+0000","last_became_active":"2024-09-15T21:55:55.245901+0000","last_became_peered":"2024-09-15T21:55:55.245901+0000","last_unstale":"2024-09-15T21:55:55.249211+0000","last_undegraded":"2024-09-15T21:55:55.249211+0000","last_fullsized":"2024-09-15T21:55:55.249211+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:59.580457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.236200+0000","last_change":"2024-09-15T21:55:55.236200+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.236200+0000","last_undegraded":"2024-09-15T21:55:55.236200+0000","last_fullsized":"2024-09-15T21:55:55.236200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.241483+0000","last_change":"2024-09-15T21:55:55.239321+0000","last_active":"2024-09-15T21:55:55.241483+0000","last_peered":"2024-09-15T21:55:55.241483+0000","last_clean":"2024-09-15T21:55:55.241483+0000","last_became_active":"2024-09-15T21:55:55.238833+0000","last_became_peered":"2024-09-15T21:55:55.238833+0000","last_unstale":"2024-09-15T21:55:55.241483+0000","last_undegraded":"2024-09-15T21:55:55.241483+0000","last_fullsized":"2024-09-15T21:55:55.241483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:52.957424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228171+0000","last_change":"2024-09-15T21:55:55.228171+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228171+0000","last_undegraded":"2024-09-15T21:55:55.228171+0000","last_fullsized":"2024-09-15T21:55:55.228171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.267616+0000","last_change":"2024-09-15T21:55:55.262964+0000","last_active":"2024-09-15T21:55:55.267616+0000","last_peered":"2024-09-15T21:55:55.267616+0000","last_clean":"2024-09-15T21:55:55.267616+0000","last_became_active":"2024-09-15T21:55:55.262238+0000","last_became_peered":"2024-09-15T21:55:55.262238+0000","last_unstale":"2024-09-15T21:55:55.267616+0000","last_undegraded":"2024-09-15T21:55:55.267616+0000","last_fullsized":"2024-09-15T21:55:55.267616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:38.005796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.225274+0000","last_change":"2024-09-15T21:55:55.225274+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.225274+0000","last_undegraded":"2024-09-15T21:55:55.225274+0000","last_fullsized":"2024-09-15T21:55:55.225274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.243349+0000","last_change":"2024-09-15T21:55:55.242337+0000","last_active":"2024-09-15T21:55:55.243349+0000","last_peered":"2024-09-15T21:55:55.243349+0000","last_clean":"2024-09-15T21:55:55.243349+0000","last_became_active":"2024-09-15T21:55:55.241660+0000","last_became_peered":"2024-09-15T21:55:55.241660+0000","last_unstale":"2024-09-15T21:55:55.243349+0000","last_undegraded":"2024-09-15T21:55:55.243349+0000","last_fullsized":"2024-09-15T21:55:55.243349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:12.038959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294850+0000","last_change":"2024-09-15T21:55:56.286828+0000","last_active":"2024-09-15T21:55:57.294850+0000","last_peered":"2024-09-15T21:55:57.294850+0000","last_clean":"2024-09-15T21:55:57.294850+0000","last_became_active":"2024-09-15T21:55:56.279323+0000","last_became_peered":"2024-09-15T21:55:56.279323+0000","last_unstale":"2024-09-15T21:55:57.294850+0000","last_undegraded":"2024-09-15T21:55:57.294850+0000","last_fullsized":"2024-09-15T21:55:57.294850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:49.172006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.245516+0000","last_change":"2024-09-15T21:55:55.244961+0000","last_active":"2024-09-15T21:55:55.245516+0000","last_peered":"2024-09-15T21:55:55.245516+0000","last_clean":"2024-09-15T21:55:55.245516+0000","last_became_active":"2024-09-15T21:55:55.244608+0000","last_became_peered":"2024-09-15T21:55:55.244608+0000","last_unstale":"2024-09-15T21:55:55.245516+0000","last_undegraded":"2024-09-15T21:55:55.245516+0000","last_fullsized":"2024-09-15T21:55:55.245516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:59.580457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.225955+0000","last_change":"2024-09-15T21:55:55.225955+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.225955+0000","last_undegraded":"2024-09-15T21:55:55.225955+0000","last_fullsized":"2024-09-15T21:55:55.225955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.241521+0000","last_change":"2024-09-15T21:55:55.239119+0000","last_active":"2024-09-15T21:55:55.241521+0000","last_peered":"2024-09-15T21:55:55.241521+0000","last_clean":"2024-09-15T21:55:55.241521+0000","last_became_active":"2024-09-15T21:55:55.238740+0000","last_became_peered":"2024-09-15T21:55:55.238740+0000","last_unstale":"2024-09-15T21:55:55.241521+0000","last_undegraded":"2024-09-15T21:55:55.241521+0000","last_fullsized":"2024-09-15T21:55:55.241521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:52.176799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229839+0000","last_change":"2024-09-15T21:55:55.229839+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229839+0000","last_undegraded":"2024-09-15T21:55:55.229839+0000","last_fullsized":"2024-09-15T21:55:55.229839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.242778+0000","last_change":"2024-09-15T21:55:55.237840+0000","last_active":"2024-09-15T21:55:55.242778+0000","last_peered":"2024-09-15T21:55:55.242778+0000","last_clean":"2024-09-15T21:55:55.242778+0000","last_became_active":"2024-09-15T21:55:55.237551+0000","last_became_peered":"2024-09-15T21:55:55.237551+0000","last_unstale":"2024-09-15T21:55:55.242778+0000","last_undegraded":"2024-09-15T21:55:55.242778+0000","last_fullsized":"2024-09-15T21:55:55.242778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:03.652358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.234876+0000","last_change":"2024-09-15T21:55:55.234876+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.234876+0000","last_undegraded":"2024-09-15T21:55:55.234876+0000","last_fullsized":"2024-09-15T21:55:55.234876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266917+0000","last_change":"2024-09-15T21:55:55.262914+0000","last_active":"2024-09-15T21:55:55.266917+0000","last_peered":"2024-09-15T21:55:55.266917+0000","last_clean":"2024-09-15T21:55:55.266917+0000","last_became_active":"2024-09-15T21:55:55.262306+0000","last_became_peered":"2024-09-15T21:55:55.262306+0000","last_unstale":"2024-09-15T21:55:55.266917+0000","last_undegraded":"2024-09-15T21:55:55.266917+0000","last_fullsized":"2024-09-15T21:55:55.266917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:47.384542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229614+0000","last_change":"2024-09-15T21:55:55.229614+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229614+0000","last_undegraded":"2024-09-15T21:55:55.229614+0000","last_fullsized":"2024-09-15T21:55:55.229614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266337+0000","last_change":"2024-09-15T21:55:55.255577+0000","last_active":"2024-09-15T21:55:55.266337+0000","last_peered":"2024-09-15T21:55:55.266337+0000","last_clean":"2024-09-15T21:55:55.266337+0000","last_became_active":"2024-09-15T21:55:55.254828+0000","last_became_peered":"2024-09-15T21:55:55.254828+0000","last_unstale":"2024-09-15T21:55:55.266337+0000","last_undegraded":"2024-09-15T21:55:55.266337+0000","last_fullsized":"2024-09-15T21:55:55.266337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:24:28.095912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293173+0000","last_change":"2024-09-15T21:55:56.267608+0000","last_active":"2024-09-15T21:55:57.293173+0000","last_peered":"2024-09-15T21:55:57.293173+0000","last_clean":"2024-09-15T21:55:57.293173+0000","last_became_active":"2024-09-15T21:55:56.266561+0000","last_became_peered":"2024-09-15T21:55:56.266561+0000","last_unstale":"2024-09-15T21:55:57.293173+0000","last_undegraded":"2024-09-15T21:55:57.293173+0000","last_fullsized":"2024-09-15T21:55:57.293173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:22.093251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.267771+0000","last_change":"2024-09-15T21:55:55.265495+0000","last_active":"2024-09-15T21:55:55.267771+0000","last_peered":"2024-09-15T21:55:55.267771+0000","last_clean":"2024-09-15T21:55:55.267771+0000","last_became_active":"2024-09-15T21:55:55.256531+0000","last_became_peered":"2024-09-15T21:55:55.256531+0000","last_unstale":"2024-09-15T21:55:55.267771+0000","last_undegraded":"2024-09-15T21:55:55.267771+0000","last_fullsized":"2024-09-15T21:55:55.267771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:17.977636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293350+0000","last_change":"2024-09-15T21:55:56.278289+0000","last_active":"2024-09-15T21:55:57.293350+0000","last_peered":"2024-09-15T21:55:57.293350+0000","last_clean":"2024-09-15T21:55:57.293350+0000","last_became_active":"2024-09-15T21:55:56.277211+0000","last_became_peered":"2024-09-15T21:55:56.277211+0000","last_unstale":"2024-09-15T21:55:57.293350+0000","last_undegraded":"2024-09-15T21:55:57.293350+0000","last_fullsized":"2024-09-15T21:55:57.293350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:38.020249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.232079+0000","last_change":"2024-09-15T21:55:55.229233+0000","last_active":"2024-09-15T21:55:55.232079+0000","last_peered":"2024-09-15T21:55:55.232079+0000","last_clean":"2024-09-15T21:55:55.232079+0000","last_became_active":"2024-09-15T21:55:55.228846+0000","last_became_peered":"2024-09-15T21:55:55.228846+0000","last_unstale":"2024-09-15T21:55:55.232079+0000","last_undegraded":"2024-09-15T21:55:55.232079+0000","last_fullsized":"2024-09-15T21:55:55.232079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:45.804383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293839+0000","last_change":"2024-09-15T21:55:56.280721+0000","last_active":"2024-09-15T21:55:57.293839+0000","last_peered":"2024-09-15T21:55:57.293839+0000","last_clean":"2024-09-15T21:55:57.293839+0000","last_became_active":"2024-09-15T21:55:56.280319+0000","last_became_peered":"2024-09-15T21:55:56.280319+0000","last_unstale":"2024-09-15T21:55:57.293839+0000","last_undegraded":"2024-09-15T21:55:57.293839+0000","last_fullsized":"2024-09-15T21:55:57.293839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:00.996297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.250609+0000","last_change":"2024-09-15T21:55:55.246626+0000","last_active":"2024-09-15T21:55:55.250609+0000","last_peered":"2024-09-15T21:55:55.250609+0000","last_clean":"2024-09-15T21:55:55.250609+0000","last_became_active":"2024-09-15T21:55:55.245886+0000","last_became_peered":"2024-09-15T21:55:55.245886+0000","last_unstale":"2024-09-15T21:55:55.250609+0000","last_undegraded":"2024-09-15T21:55:55.250609+0000","last_fullsized":"2024-09-15T21:55:55.250609+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:12.038959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293170+0000","last_change":"2024-09-15T21:55:56.267393+0000","last_active":"2024-09-15T21:55:57.293170+0000","last_peered":"2024-09-15T21:55:57.293170+0000","last_clean":"2024-09-15T21:55:57.293170+0000","last_became_active":"2024-09-15T21:55:56.266556+0000","last_became_peered":"2024-09-15T21:55:56.266556+0000","last_unstale":"2024-09-15T21:55:57.293170+0000","last_undegraded":"2024-09-15T21:55:57.293170+0000","last_fullsized":"2024-09-15T21:55:57.293170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:10.617836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266837+0000","last_change":"2024-09-15T21:55:55.261924+0000","last_active":"2024-09-15T21:55:55.266837+0000","last_peered":"2024-09-15T21:55:55.266837+0000","last_clean":"2024-09-15T21:55:55.266837+0000","last_became_active":"2024-09-15T21:55:55.261207+0000","last_became_peered":"2024-09-15T21:55:55.261207+0000","last_unstale":"2024-09-15T21:55:55.266837+0000","last_undegraded":"2024-09-15T21:55:55.266837+0000","last_fullsized":"2024-09-15T21:55:55.266837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:05.016266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294629+0000","last_change":"2024-09-15T21:55:56.290591+0000","last_active":"2024-09-15T21:55:57.294629+0000","last_peered":"2024-09-15T21:55:57.294629+0000","last_clean":"2024-09-15T21:55:57.294629+0000","last_became_active":"2024-09-15T21:55:56.289211+0000","last_became_peered":"2024-09-15T21:55:56.289211+0000","last_unstale":"2024-09-15T21:55:57.294629+0000","last_undegraded":"2024-09-15T21:55:57.294629+0000","last_fullsized":"2024-09-15T21:55:57.294629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:53.958162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.257986+0000","last_change":"2024-09-15T21:55:55.255670+0000","last_active":"2024-09-15T21:55:55.257986+0000","last_peered":"2024-09-15T21:55:55.257986+0000","last_clean":"2024-09-15T21:55:55.257986+0000","last_became_active":"2024-09-15T21:55:55.254936+0000","last_became_peered":"2024-09-15T21:55:55.254936+0000","last_unstale":"2024-09-15T21:55:55.257986+0000","last_undegraded":"2024-09-15T21:55:55.257986+0000","last_fullsized":"2024-09-15T21:55:55.257986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:05.391521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293617+0000","last_change":"2024-09-15T21:55:56.310032+0000","last_active":"2024-09-15T21:55:57.293617+0000","last_peered":"2024-09-15T21:55:57.293617+0000","last_clean":"2024-09-15T21:55:57.293617+0000","last_became_active":"2024-09-15T21:55:56.309746+0000","last_became_peered":"2024-09-15T21:55:56.309746+0000","last_unstale":"2024-09-15T21:55:57.293617+0000","last_undegraded":"2024-09-15T21:55:57.293617+0000","last_fullsized":"2024-09-15T21:55:57.293617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:13.626595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.248462+0000","last_change":"2024-09-15T21:55:55.247682+0000","last_active":"2024-09-15T21:55:55.248462+0000","last_peered":"2024-09-15T21:55:55.248462+0000","last_clean":"2024-09-15T21:55:55.248462+0000","last_became_active":"2024-09-15T21:55:55.247324+0000","last_became_peered":"2024-09-15T21:55:55.247324+0000","last_unstale":"2024-09-15T21:55:55.248462+0000","last_undegraded":"2024-09-15T21:55:55.248462+0000","last_fullsized":"2024-09-15T21:55:55.248462+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:34:47.778872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230372+0000","last_change":"2024-09-15T21:55:55.230372+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230372+0000","last_undegraded":"2024-09-15T21:55:55.230372+0000","last_fullsized":"2024-09-15T21:55:55.230372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.240644+0000","last_change":"2024-09-15T21:55:55.238010+0000","last_active":"2024-09-15T21:55:55.240644+0000","last_peered":"2024-09-15T21:55:55.240644+0000","last_clean":"2024-09-15T21:55:55.240644+0000","last_became_active":"2024-09-15T21:55:55.237459+0000","last_became_peered":"2024-09-15T21:55:55.237459+0000","last_unstale":"2024-09-15T21:55:55.240644+0000","last_undegraded":"2024-09-15T21:55:55.240644+0000","last_fullsized":"2024-09-15T21:55:55.240644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:44.329135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.224236+0000","last_change":"2024-09-15T21:55:55.224236+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.224236+0000","last_undegraded":"2024-09-15T21:55:55.224236+0000","last_fullsized":"2024-09-15T21:55:55.224236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.241499+0000","last_change":"2024-09-15T21:55:55.236793+0000","last_active":"2024-09-15T21:55:55.241499+0000","last_peered":"2024-09-15T21:55:55.241499+0000","last_clean":"2024-09-15T21:55:55.241499+0000","last_became_active":"2024-09-15T21:55:55.236398+0000","last_became_peered":"2024-09-15T21:55:55.236398+0000","last_unstale":"2024-09-15T21:55:55.241499+0000","last_undegraded":"2024-09-15T21:55:55.241499+0000","last_fullsized":"2024-09-15T21:55:55.241499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:45.804383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.224549+0000","last_change":"2024-09-15T21:55:55.224549+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.224549+0000","last_undegraded":"2024-09-15T21:55:55.224549+0000","last_fullsized":"2024-09-15T21:55:55.224549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.237478+0000","last_change":"2024-09-15T21:55:55.236177+0000","last_active":"2024-09-15T21:55:55.237478+0000","last_peered":"2024-09-15T21:55:55.237478+0000","last_clean":"2024-09-15T21:55:55.237478+0000","last_became_active":"2024-09-15T21:55:55.235890+0000","last_became_peered":"2024-09-15T21:55:55.235890+0000","last_unstale":"2024-09-15T21:55:55.237478+0000","last_undegraded":"2024-09-15T21:55:55.237478+0000","last_fullsized":"2024-09-15T21:55:55.237478+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:12.038959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228377+0000","last_change":"2024-09-15T21:55:55.228377+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228377+0000","last_undegraded":"2024-09-15T21:55:55.228377+0000","last_fullsized":"2024-09-15T21:55:55.228377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.248451+0000","last_change":"2024-09-15T21:55:55.247687+0000","last_active":"2024-09-15T21:55:55.248451+0000","last_peered":"2024-09-15T21:55:55.248451+0000","last_clean":"2024-09-15T21:55:55.248451+0000","last_became_active":"2024-09-15T21:55:55.247348+0000","last_became_peered":"2024-09-15T21:55:55.247348+0000","last_unstale":"2024-09-15T21:55:55.248451+0000","last_undegraded":"2024-09-15T21:55:55.248451+0000","last_fullsized":"2024-09-15T21:55:55.248451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:44.329135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.226648+0000","last_change":"2024-09-15T21:55:55.226648+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.226648+0000","last_undegraded":"2024-09-15T21:55:55.226648+0000","last_fullsized":"2024-09-15T21:55:55.226648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.263341+0000","last_change":"2024-09-15T21:55:55.254121+0000","last_active":"2024-09-15T21:55:55.263341+0000","last_peered":"2024-09-15T21:55:55.263341+0000","last_clean":"2024-09-15T21:55:55.263341+0000","last_became_active":"2024-09-15T21:55:55.237665+0000","last_became_peered":"2024-09-15T21:55:55.237665+0000","last_unstale":"2024-09-15T21:55:55.263341+0000","last_undegraded":"2024-09-15T21:55:55.263341+0000","last_fullsized":"2024-09-15T21:55:55.263341+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:18.893644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.227678+0000","last_change":"2024-09-15T21:55:55.227678+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.227678+0000","last_undegraded":"2024-09-15T21:55:55.227678+0000","last_fullsized":"2024-09-15T21:55:55.227678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.254541+0000","last_change":"2024-09-15T21:55:55.253393+0000","last_active":"2024-09-15T21:55:55.254541+0000","last_peered":"2024-09-15T21:55:55.254541+0000","last_clean":"2024-09-15T21:55:55.254541+0000","last_became_active":"2024-09-15T21:55:55.253070+0000","last_became_peered":"2024-09-15T21:55:55.253070+0000","last_unstale":"2024-09-15T21:55:55.254541+0000","last_undegraded":"2024-09-15T21:55:55.254541+0000","last_fullsized":"2024-09-15T21:55:55.254541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:23.173121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295447+0000","last_change":"2024-09-15T21:55:56.269103+0000","last_active":"2024-09-15T21:55:57.295447+0000","last_peered":"2024-09-15T21:55:57.295447+0000","last_clean":"2024-09-15T21:55:57.295447+0000","last_became_active":"2024-09-15T21:55:56.268360+0000","last_became_peered":"2024-09-15T21:55:56.268360+0000","last_unstale":"2024-09-15T21:55:57.295447+0000","last_undegraded":"2024-09-15T21:55:57.295447+0000","last_fullsized":"2024-09-15T21:55:57.295447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:11.274512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.270910+0000","last_change":"2024-09-15T21:55:55.269693+0000","last_active":"2024-09-15T21:55:55.270910+0000","last_peered":"2024-09-15T21:55:55.270910+0000","last_clean":"2024-09-15T21:55:55.270910+0000","last_became_active":"2024-09-15T21:55:55.268821+0000","last_became_peered":"2024-09-15T21:55:55.268821+0000","last_unstale":"2024-09-15T21:55:55.270910+0000","last_undegraded":"2024-09-15T21:55:55.270910+0000","last_fullsized":"2024-09-15T21:55:55.270910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:34:47.778872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295729+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:57.295729+0000","last_peered":"2024-09-15T21:55:57.295729+0000","last_clean":"2024-09-15T21:55:57.295729+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:57.295729+0000","last_undegraded":"2024-09-15T21:55:57.295729+0000","last_fullsized":"2024-09-15T21:55:57.295729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":884736,"data_stored":696851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":925696,"data_stored":716283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35676,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336164,"statfs":{"total":96636764160,"available":96600231936,"internally_reserved":0,"allocated":331776,"data_stored":125895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:56:00.333 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:56:00.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedba796640 1 Processor -- start 2024-09-15T21:56:00.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedba796640 1 -- start start 2024-09-15T21:56:00.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedba796640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fedb40b5220 0x7fedb409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedba796640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fedb4148f20 0x7fedb41493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedba796640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb409f520 con 0x7fedb40b5600 2024-09-15T21:56:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedba796640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fedb409b800 con 0x7fedb40b5220 2024-09-15T21:56:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedba796640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fedb40b4dd0 con 0x7fedb4148f20 2024-09-15T21:56:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedb3fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fedb40b5220 0x7fedb409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedb3fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fedb40b5220 0x7fedb409aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51474/0 (socket says 172.21.15.1:51474) 2024-09-15T21:56:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedb3fff640 1 -- 172.21.15.1:0/2228158592 learned_addr learned my addr 172.21.15.1:0/2228158592 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedb37fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fedb40b5600 0x7fedb409ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41386/0 (socket says 172.21.15.1:41386) 2024-09-15T21:56:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedb8d33640 1 --2- 172.21.15.1:0/2228158592 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fedb4148f20 0x7fedb41493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedb3fff640 1 -- 172.21.15.1:0/2228158592 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fedb4148f20 msgr2=0x7fedb41493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedb3fff640 1 --2- 172.21.15.1:0/2228158592 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fedb4148f20 0x7fedb41493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedb2ffd640 1 -- 172.21.15.1:0/2228158592 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404317394 0 0) 0x7fedb409f520 con 0x7fedb40b5600 2024-09-15T21:56:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedb3fff640 1 -- 172.21.15.1:0/2228158592 >> v1:172.21.15.1:6789/0 conn(0x7fedb40b5600 legacy=0x7fedb409ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedb3fff640 1 -- 172.21.15.1:0/2228158592 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb41498f0 con 0x7fedb40b5220 2024-09-15T21:56:00.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.489+0000 7fedb3fff640 1 --2- 172.21.15.1:0/2228158592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedb40b5220 0x7fedb409aa50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feda4009870 tx=0x7feda401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e91d21274a89f0b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:00.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb2ffd640 1 -- 172.21.15.1:0/2228158592 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda40b0070 con 0x7fedb40b5220 2024-09-15T21:56:00.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb2ffd640 1 -- 172.21.15.1:0/2228158592 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda40ab600 con 0x7fedb40b5220 2024-09-15T21:56:00.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb2ffd640 1 -- 172.21.15.1:0/2228158592 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda40ab9d0 con 0x7fedb40b5220 2024-09-15T21:56:00.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 -- 172.21.15.1:0/2228158592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedb40b5220 msgr2=0x7fedb409aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 --2- 172.21.15.1:0/2228158592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedb40b5220 0x7fedb409aa50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feda4009870 tx=0x7feda401c440 comp rx=0 tx=0).stop 2024-09-15T21:56:00.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 -- 172.21.15.1:0/2228158592 shutdown_connections 2024-09-15T21:56:00.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 --2- 172.21.15.1:0/2228158592 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fedb4148f20 0x7fedb41493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 --2- 172.21.15.1:0/2228158592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedb40b5220 0x7fedb409aa50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 -- 172.21.15.1:0/2228158592 >> 172.21.15.1:0/2228158592 conn(0x7fedb40b5c40 msgr2=0x7fedb40b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:00.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 -- 172.21.15.1:0/2228158592 shutdown_connections 2024-09-15T21:56:00.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 -- 172.21.15.1:0/2228158592 wait complete. 2024-09-15T21:56:00.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 Processor -- start 2024-09-15T21:56:00.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 -- start start 2024-09-15T21:56:00.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fedb40b5220 0x7fedb40b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedb40b5600 0x7fedb40b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb4148f20 0x7fedb41e0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fedb4152880 con 0x7fedb40b5600 2024-09-15T21:56:00.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fedb4152700 con 0x7fedb4148f20 2024-09-15T21:56:00.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fedb4152a00 con 0x7fedb40b5220 2024-09-15T21:56:00.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedb40b5600 0x7fedb40b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedb40b5600 0x7fedb40b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51480/0 (socket says 172.21.15.1:51480) 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb37fe640 1 -- 172.21.15.1:0/2692382635 learned_addr learned my addr 172.21.15.1:0/2692382635 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb3fff640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fedb40b5220 0x7fedb40b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb8d33640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb4148f20 0x7fedb41e0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb37fe640 1 -- 172.21.15.1:0/2692382635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fedb40b5220 msgr2=0x7fedb40b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb37fe640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fedb40b5220 0x7fedb40b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb37fe640 1 -- 172.21.15.1:0/2692382635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb4148f20 msgr2=0x7fedb41e0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb37fe640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb4148f20 0x7fedb41e0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb37fe640 1 -- 172.21.15.1:0/2692382635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb4138c80 con 0x7fedb40b5600 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb3fff640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fedb40b5220 0x7fedb40b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb37fe640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedb40b5600 0x7fedb40b0c10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feda80011f0 tx=0x7feda800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb0ff9640 1 -- 172.21.15.1:0/2692382635 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda8018070 con 0x7fedb40b5600 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb0ff9640 1 -- 172.21.15.1:0/2692382635 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda80074e0 con 0x7fedb40b5600 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 -- 172.21.15.1:0/2692382635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb4071cf0 con 0x7fedb40b5600 2024-09-15T21:56:00.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedb0ff9640 1 -- 172.21.15.1:0/2692382635 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda8004a10 con 0x7fedb40b5600 2024-09-15T21:56:00.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.493+0000 7fedba796640 1 -- 172.21.15.1:0/2692382635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb40b2450 con 0x7fedb40b5600 2024-09-15T21:56:00.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.497+0000 7fedba796640 1 -- 172.21.15.1:0/2692382635 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb409aa50 con 0x7fedb40b5600 2024-09-15T21:56:00.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.497+0000 7fedb0ff9640 1 -- 172.21.15.1:0/2692382635 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feda801b070 con 0x7fedb40b5600 2024-09-15T21:56:00.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.497+0000 7fedb0ff9640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7feda00678c0 0x7feda0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.497+0000 7fedb0ff9640 1 -- 172.21.15.1:0/2692382635 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7feda8084f20 con 0x7fedb40b5600 2024-09-15T21:56:00.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.497+0000 7fedb3fff640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7feda00678c0 0x7feda0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.497+0000 7fedb3fff640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7feda00678c0 0x7feda0069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feda40ad000 tx=0x7feda4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:00.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.501+0000 7fedb0ff9640 1 -- 172.21.15.1:0/2692382635 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fedb4138c80 con 0x7fedb40b5600 2024-09-15T21:56:00.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.657+0000 7fedba796640 1 -- 172.21.15.1:0/2692382635 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fedb4068850 con 0x7feda00678c0 2024-09-15T21:56:00.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.677+0000 7fedb0ff9640 1 -- 172.21.15.1:0/2692382635 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248189 (secure 0 0 0) 0x7fedb4068850 con 0x7feda00678c0 2024-09-15T21:56:00.682 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:00.684 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:56:00.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.681+0000 7fedba796640 1 -- 172.21.15.1:0/2692382635 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7feda00678c0 msgr2=0x7feda0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.681+0000 7fedba796640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7feda00678c0 0x7feda0069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feda40ad000 tx=0x7feda4008040 comp rx=0 tx=0).stop 2024-09-15T21:56:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.681+0000 7fedba796640 1 -- 172.21.15.1:0/2692382635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedb40b5600 msgr2=0x7fedb40b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.681+0000 7fedba796640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedb40b5600 0x7fedb40b0c10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feda80011f0 tx=0x7feda800c9b0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.681+0000 7fedba796640 1 -- 172.21.15.1:0/2692382635 shutdown_connections 2024-09-15T21:56:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.681+0000 7fedba796640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7feda00678c0 0x7feda0069d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.681+0000 7fedba796640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fedb4148f20 0x7fedb41e0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.681+0000 7fedba796640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fedb40b5600 0x7fedb40b0c10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.681+0000 7fedba796640 1 --2- 172.21.15.1:0/2692382635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fedb40b5220 0x7fedb40b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.681+0000 7fedba796640 1 -- 172.21.15.1:0/2692382635 >> 172.21.15.1:0/2692382635 conn(0x7fedb40b5c40 msgr2=0x7fedb40b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.681+0000 7fedba796640 1 -- 172.21.15.1:0/2692382635 shutdown_connections 2024-09-15T21:56:00.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.681+0000 7fedba796640 1 -- 172.21.15.1:0/2692382635 wait complete. 2024-09-15T21:56:00.704 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-15T21:55:59.089025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257184,"kb_used_data":3512,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754717536,"statfs":{"total":773094113280,"available":772830756864,"internally_reserved":0,"allocated":3596288,"data_stored":2071444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.875523"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.226282+0000","last_change":"2024-09-15T21:55:55.226282+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.226282+0000","last_undegraded":"2024-09-15T21:55:55.226282+0000","last_fullsized":"2024-09-15T21:55:55.226282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230490+0000","last_change":"2024-09-15T21:55:55.230490+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230490+0000","last_undegraded":"2024-09-15T21:55:55.230490+0000","last_fullsized":"2024-09-15T21:55:55.230490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.234702+0000","last_change":"2024-09-15T21:55:55.234702+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.234702+0000","last_undegraded":"2024-09-15T21:55:55.234702+0000","last_fullsized":"2024-09-15T21:55:55.234702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230208+0000","last_change":"2024-09-15T21:55:55.230208+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230208+0000","last_undegraded":"2024-09-15T21:55:55.230208+0000","last_fullsized":"2024-09-15T21:55:55.230208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293463+0000","last_change":"2024-09-15T21:55:56.285178+0000","last_active":"2024-09-15T21:55:57.293463+0000","last_peered":"2024-09-15T21:55:57.293463+0000","last_clean":"2024-09-15T21:55:57.293463+0000","last_became_active":"2024-09-15T21:55:56.284915+0000","last_became_peered":"2024-09-15T21:55:56.284915+0000","last_unstale":"2024-09-15T21:55:57.293463+0000","last_undegraded":"2024-09-15T21:55:57.293463+0000","last_fullsized":"2024-09-15T21:55:57.293463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:53.134305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230652+0000","last_change":"2024-09-15T21:55:55.230652+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230652+0000","last_undegraded":"2024-09-15T21:55:55.230652+0000","last_fullsized":"2024-09-15T21:55:55.230652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294848+0000","last_change":"2024-09-15T21:55:56.289977+0000","last_active":"2024-09-15T21:55:57.294848+0000","last_peered":"2024-09-15T21:55:57.294848+0000","last_clean":"2024-09-15T21:55:57.294848+0000","last_became_active":"2024-09-15T21:55:56.288235+0000","last_became_peered":"2024-09-15T21:55:56.288235+0000","last_unstale":"2024-09-15T21:55:57.294848+0000","last_undegraded":"2024-09-15T21:55:57.294848+0000","last_fullsized":"2024-09-15T21:55:57.294848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:28.668639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294435+0000","last_change":"2024-09-15T21:55:56.274499+0000","last_active":"2024-09-15T21:55:57.294435+0000","last_peered":"2024-09-15T21:55:57.294435+0000","last_clean":"2024-09-15T21:55:57.294435+0000","last_became_active":"2024-09-15T21:55:56.273194+0000","last_became_peered":"2024-09-15T21:55:56.273194+0000","last_unstale":"2024-09-15T21:55:57.294435+0000","last_undegraded":"2024-09-15T21:55:57.294435+0000","last_fullsized":"2024-09-15T21:55:57.294435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.255317+0000","last_change":"2024-09-15T21:55:55.255317+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.255317+0000","last_undegraded":"2024-09-15T21:55:55.255317+0000","last_fullsized":"2024-09-15T21:55:55.255317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229145+0000","last_change":"2024-09-15T21:55:55.229145+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229145+0000","last_undegraded":"2024-09-15T21:55:55.229145+0000","last_fullsized":"2024-09-15T21:55:55.229145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295306+0000","last_change":"2024-09-15T21:55:56.275939+0000","last_active":"2024-09-15T21:55:57.295306+0000","last_peered":"2024-09-15T21:55:57.295306+0000","last_clean":"2024-09-15T21:55:57.295306+0000","last_became_active":"2024-09-15T21:55:56.275185+0000","last_became_peered":"2024-09-15T21:55:56.275185+0000","last_unstale":"2024-09-15T21:55:57.295306+0000","last_undegraded":"2024-09-15T21:55:57.295306+0000","last_fullsized":"2024-09-15T21:55:57.295306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:04.577354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.235561+0000","last_change":"2024-09-15T21:55:55.235561+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.235561+0000","last_undegraded":"2024-09-15T21:55:55.235561+0000","last_fullsized":"2024-09-15T21:55:55.235561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293562+0000","last_change":"2024-09-15T21:55:56.278716+0000","last_active":"2024-09-15T21:55:57.293562+0000","last_peered":"2024-09-15T21:55:57.293562+0000","last_clean":"2024-09-15T21:55:57.293562+0000","last_became_active":"2024-09-15T21:55:56.277722+0000","last_became_peered":"2024-09-15T21:55:56.277722+0000","last_unstale":"2024-09-15T21:55:57.293562+0000","last_undegraded":"2024-09-15T21:55:57.293562+0000","last_fullsized":"2024-09-15T21:55:57.293562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:18.528351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230066+0000","last_change":"2024-09-15T21:55:55.230066+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230066+0000","last_undegraded":"2024-09-15T21:55:55.230066+0000","last_fullsized":"2024-09-15T21:55:55.230066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.231822+0000","last_change":"2024-09-15T21:55:55.231822+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.231822+0000","last_undegraded":"2024-09-15T21:55:55.231822+0000","last_fullsized":"2024-09-15T21:55:55.231822+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295625+0000","last_change":"2024-09-15T21:55:56.300687+0000","last_active":"2024-09-15T21:55:57.295625+0000","last_peered":"2024-09-15T21:55:57.295625+0000","last_clean":"2024-09-15T21:55:57.295625+0000","last_became_active":"2024-09-15T21:55:56.300004+0000","last_became_peered":"2024-09-15T21:55:56.300004+0000","last_unstale":"2024-09-15T21:55:57.295625+0000","last_undegraded":"2024-09-15T21:55:57.295625+0000","last_fullsized":"2024-09-15T21:55:57.295625+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:47.385096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295452+0000","last_change":"2024-09-15T21:55:56.277883+0000","last_active":"2024-09-15T21:55:57.295452+0000","last_peered":"2024-09-15T21:55:57.295452+0000","last_clean":"2024-09-15T21:55:57.295452+0000","last_became_active":"2024-09-15T21:55:56.277149+0000","last_became_peered":"2024-09-15T21:55:56.277149+0000","last_unstale":"2024-09-15T21:55:57.295452+0000","last_undegraded":"2024-09-15T21:55:57.295452+0000","last_fullsized":"2024-09-15T21:55:57.295452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:54.377784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229862+0000","last_change":"2024-09-15T21:55:55.229862+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229862+0000","last_undegraded":"2024-09-15T21:55:55.229862+0000","last_fullsized":"2024-09-15T21:55:55.229862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228248+0000","last_change":"2024-09-15T21:55:55.228248+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228248+0000","last_undegraded":"2024-09-15T21:55:55.228248+0000","last_fullsized":"2024-09-15T21:55:55.228248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293340+0000","last_change":"2024-09-15T21:55:56.308957+0000","last_active":"2024-09-15T21:55:57.293340+0000","last_peered":"2024-09-15T21:55:57.293340+0000","last_clean":"2024-09-15T21:55:57.293340+0000","last_became_active":"2024-09-15T21:55:56.308655+0000","last_became_peered":"2024-09-15T21:55:56.308655+0000","last_unstale":"2024-09-15T21:55:57.293340+0000","last_undegraded":"2024-09-15T21:55:57.293340+0000","last_fullsized":"2024-09-15T21:55:57.293340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:42.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.255281+0000","last_change":"2024-09-15T21:55:55.255281+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.255281+0000","last_undegraded":"2024-09-15T21:55:55.255281+0000","last_fullsized":"2024-09-15T21:55:55.255281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.231596+0000","last_change":"2024-09-15T21:55:55.231596+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.231596+0000","last_undegraded":"2024-09-15T21:55:55.231596+0000","last_fullsized":"2024-09-15T21:55:55.231596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.224324+0000","last_change":"2024-09-15T21:55:55.224324+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.224324+0000","last_undegraded":"2024-09-15T21:55:55.224324+0000","last_fullsized":"2024-09-15T21:55:55.224324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230946+0000","last_change":"2024-09-15T21:55:55.230946+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230946+0000","last_undegraded":"2024-09-15T21:55:55.230946+0000","last_fullsized":"2024-09-15T21:55:55.230946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229576+0000","last_change":"2024-09-15T21:55:55.229576+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229576+0000","last_undegraded":"2024-09-15T21:55:55.229576+0000","last_fullsized":"2024-09-15T21:55:55.229576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228310+0000","last_change":"2024-09-15T21:55:55.228310+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228310+0000","last_undegraded":"2024-09-15T21:55:55.228310+0000","last_fullsized":"2024-09-15T21:55:55.228310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230086+0000","last_change":"2024-09-15T21:55:55.230086+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230086+0000","last_undegraded":"2024-09-15T21:55:55.230086+0000","last_fullsized":"2024-09-15T21:55:55.230086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.234426+0000","last_change":"2024-09-15T21:55:55.234426+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.234426+0000","last_undegraded":"2024-09-15T21:55:55.234426+0000","last_fullsized":"2024-09-15T21:55:55.234426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.233282+0000","last_change":"2024-09-15T21:55:55.233282+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.233282+0000","last_undegraded":"2024-09-15T21:55:55.233282+0000","last_fullsized":"2024-09-15T21:55:55.233282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295041+0000","last_change":"2024-09-15T21:55:56.278013+0000","last_active":"2024-09-15T21:55:57.295041+0000","last_peered":"2024-09-15T21:55:57.295041+0000","last_clean":"2024-09-15T21:55:57.295041+0000","last_became_active":"2024-09-15T21:55:56.277260+0000","last_became_peered":"2024-09-15T21:55:56.277260+0000","last_unstale":"2024-09-15T21:55:57.295041+0000","last_undegraded":"2024-09-15T21:55:57.295041+0000","last_fullsized":"2024-09-15T21:55:57.295041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:07.090183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.227090+0000","last_change":"2024-09-15T21:55:55.227090+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.227090+0000","last_undegraded":"2024-09-15T21:55:55.227090+0000","last_fullsized":"2024-09-15T21:55:55.227090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294405+0000","last_change":"2024-09-15T21:55:56.298083+0000","last_active":"2024-09-15T21:55:57.294405+0000","last_peered":"2024-09-15T21:55:57.294405+0000","last_clean":"2024-09-15T21:55:57.294405+0000","last_became_active":"2024-09-15T21:55:56.286370+0000","last_became_peered":"2024-09-15T21:55:56.286370+0000","last_unstale":"2024-09-15T21:55:57.294405+0000","last_undegraded":"2024-09-15T21:55:57.294405+0000","last_fullsized":"2024-09-15T21:55:57.294405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:40.099978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.224764+0000","last_change":"2024-09-15T21:55:55.224764+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.224764+0000","last_undegraded":"2024-09-15T21:55:55.224764+0000","last_fullsized":"2024-09-15T21:55:55.224764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.252556+0000","last_change":"2024-09-15T21:55:55.249652+0000","last_active":"2024-09-15T21:55:55.252556+0000","last_peered":"2024-09-15T21:55:55.252556+0000","last_clean":"2024-09-15T21:55:55.252556+0000","last_became_active":"2024-09-15T21:55:55.248947+0000","last_became_peered":"2024-09-15T21:55:55.248947+0000","last_unstale":"2024-09-15T21:55:55.252556+0000","last_undegraded":"2024-09-15T21:55:55.252556+0000","last_fullsized":"2024-09-15T21:55:55.252556+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:44.329135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.225091+0000","last_change":"2024-09-15T21:55:55.225091+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.225091+0000","last_undegraded":"2024-09-15T21:55:55.225091+0000","last_fullsized":"2024-09-15T21:55:55.225091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.242840+0000","last_change":"2024-09-15T21:55:55.240388+0000","last_active":"2024-09-15T21:55:55.242840+0000","last_peered":"2024-09-15T21:55:55.242840+0000","last_clean":"2024-09-15T21:55:55.242840+0000","last_became_active":"2024-09-15T21:55:55.239837+0000","last_became_peered":"2024-09-15T21:55:55.239837+0000","last_unstale":"2024-09-15T21:55:55.242840+0000","last_undegraded":"2024-09-15T21:55:55.242840+0000","last_fullsized":"2024-09-15T21:55:55.242840+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:34:47.778872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229016+0000","last_change":"2024-09-15T21:55:55.229016+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229016+0000","last_undegraded":"2024-09-15T21:55:55.229016+0000","last_fullsized":"2024-09-15T21:55:55.229016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.242212+0000","last_change":"2024-09-15T21:55:55.240018+0000","last_active":"2024-09-15T21:55:55.242212+0000","last_peered":"2024-09-15T21:55:55.242212+0000","last_clean":"2024-09-15T21:55:55.242212+0000","last_became_active":"2024-09-15T21:55:55.239512+0000","last_became_peered":"2024-09-15T21:55:55.239512+0000","last_unstale":"2024-09-15T21:55:55.242212+0000","last_undegraded":"2024-09-15T21:55:55.242212+0000","last_fullsized":"2024-09-15T21:55:55.242212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:25.819619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.227070+0000","last_change":"2024-09-15T21:55:55.227070+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.227070+0000","last_undegraded":"2024-09-15T21:55:55.227070+0000","last_fullsized":"2024-09-15T21:55:55.227070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293444+0000","last_change":"2024-09-15T21:55:55.241122+0000","last_active":"2024-09-15T21:55:57.293444+0000","last_peered":"2024-09-15T21:55:57.293444+0000","last_clean":"2024-09-15T21:55:57.293444+0000","last_became_active":"2024-09-15T21:55:55.240704+0000","last_became_peered":"2024-09-15T21:55:55.240704+0000","last_unstale":"2024-09-15T21:55:57.293444+0000","last_undegraded":"2024-09-15T21:55:57.293444+0000","last_fullsized":"2024-09-15T21:55:57.293444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:13.090176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295034+0000","last_change":"2024-09-15T21:55:56.288570+0000","last_active":"2024-09-15T21:55:57.295034+0000","last_peered":"2024-09-15T21:55:57.295034+0000","last_clean":"2024-09-15T21:55:57.295034+0000","last_became_active":"2024-09-15T21:55:56.279697+0000","last_became_peered":"2024-09-15T21:55:56.279697+0000","last_unstale":"2024-09-15T21:55:57.295034+0000","last_undegraded":"2024-09-15T21:55:57.295034+0000","last_fullsized":"2024-09-15T21:55:57.295034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:44.393748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266728+0000","last_change":"2024-09-15T21:55:55.260925+0000","last_active":"2024-09-15T21:55:55.266728+0000","last_peered":"2024-09-15T21:55:55.266728+0000","last_clean":"2024-09-15T21:55:55.266728+0000","last_became_active":"2024-09-15T21:55:55.257306+0000","last_became_peered":"2024-09-15T21:55:55.257306+0000","last_unstale":"2024-09-15T21:55:55.266728+0000","last_undegraded":"2024-09-15T21:55:55.266728+0000","last_fullsized":"2024-09-15T21:55:55.266728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:25.926217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.232427+0000","last_change":"2024-09-15T21:55:55.232427+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.232427+0000","last_undegraded":"2024-09-15T21:55:55.232427+0000","last_fullsized":"2024-09-15T21:55:55.232427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266754+0000","last_change":"2024-09-15T21:55:55.261177+0000","last_active":"2024-09-15T21:55:55.266754+0000","last_peered":"2024-09-15T21:55:55.266754+0000","last_clean":"2024-09-15T21:55:55.266754+0000","last_became_active":"2024-09-15T21:55:55.256722+0000","last_became_peered":"2024-09-15T21:55:55.256722+0000","last_unstale":"2024-09-15T21:55:55.266754+0000","last_undegraded":"2024-09-15T21:55:55.266754+0000","last_fullsized":"2024-09-15T21:55:55.266754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:16:53.722416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230410+0000","last_change":"2024-09-15T21:55:55.230410+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230410+0000","last_undegraded":"2024-09-15T21:55:55.230410+0000","last_fullsized":"2024-09-15T21:55:55.230410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.240719+0000","last_change":"2024-09-15T21:55:55.235928+0000","last_active":"2024-09-15T21:55:55.240719+0000","last_peered":"2024-09-15T21:55:55.240719+0000","last_clean":"2024-09-15T21:55:55.240719+0000","last_became_active":"2024-09-15T21:55:55.235501+0000","last_became_peered":"2024-09-15T21:55:55.235501+0000","last_unstale":"2024-09-15T21:55:55.240719+0000","last_undegraded":"2024-09-15T21:55:55.240719+0000","last_fullsized":"2024-09-15T21:55:55.240719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:58.304088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.227139+0000","last_change":"2024-09-15T21:55:55.227139+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.227139+0000","last_undegraded":"2024-09-15T21:55:55.227139+0000","last_fullsized":"2024-09-15T21:55:55.227139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266906+0000","last_change":"2024-09-15T21:55:55.262772+0000","last_active":"2024-09-15T21:55:55.266906+0000","last_peered":"2024-09-15T21:55:55.266906+0000","last_clean":"2024-09-15T21:55:55.266906+0000","last_became_active":"2024-09-15T21:55:55.262001+0000","last_became_peered":"2024-09-15T21:55:55.262001+0000","last_unstale":"2024-09-15T21:55:55.266906+0000","last_undegraded":"2024-09-15T21:55:55.266906+0000","last_fullsized":"2024-09-15T21:55:55.266906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:45:57.077886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230359+0000","last_change":"2024-09-15T21:55:55.230359+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230359+0000","last_undegraded":"2024-09-15T21:55:55.230359+0000","last_fullsized":"2024-09-15T21:55:55.230359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.252235+0000","last_change":"2024-09-15T21:55:55.251449+0000","last_active":"2024-09-15T21:55:55.252235+0000","last_peered":"2024-09-15T21:55:55.252235+0000","last_clean":"2024-09-15T21:55:55.252235+0000","last_became_active":"2024-09-15T21:55:55.251192+0000","last_became_peered":"2024-09-15T21:55:55.251192+0000","last_unstale":"2024-09-15T21:55:55.252235+0000","last_undegraded":"2024-09-15T21:55:55.252235+0000","last_fullsized":"2024-09-15T21:55:55.252235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:05.391521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.226032+0000","last_change":"2024-09-15T21:55:55.226032+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.226032+0000","last_undegraded":"2024-09-15T21:55:55.226032+0000","last_fullsized":"2024-09-15T21:55:55.226032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.238189+0000","last_change":"2024-09-15T21:55:55.234667+0000","last_active":"2024-09-15T21:55:55.238189+0000","last_peered":"2024-09-15T21:55:55.238189+0000","last_clean":"2024-09-15T21:55:55.238189+0000","last_became_active":"2024-09-15T21:55:55.234277+0000","last_became_peered":"2024-09-15T21:55:55.234277+0000","last_unstale":"2024-09-15T21:55:55.238189+0000","last_undegraded":"2024-09-15T21:55:55.238189+0000","last_fullsized":"2024-09-15T21:55:55.238189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:03.652358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228532+0000","last_change":"2024-09-15T21:55:55.228532+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228532+0000","last_undegraded":"2024-09-15T21:55:55.228532+0000","last_fullsized":"2024-09-15T21:55:55.228532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.249211+0000","last_change":"2024-09-15T21:55:55.246855+0000","last_active":"2024-09-15T21:55:55.249211+0000","last_peered":"2024-09-15T21:55:55.249211+0000","last_clean":"2024-09-15T21:55:55.249211+0000","last_became_active":"2024-09-15T21:55:55.245901+0000","last_became_peered":"2024-09-15T21:55:55.245901+0000","last_unstale":"2024-09-15T21:55:55.249211+0000","last_undegraded":"2024-09-15T21:55:55.249211+0000","last_fullsized":"2024-09-15T21:55:55.249211+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:59.580457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.236200+0000","last_change":"2024-09-15T21:55:55.236200+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.236200+0000","last_undegraded":"2024-09-15T21:55:55.236200+0000","last_fullsized":"2024-09-15T21:55:55.236200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.241483+0000","last_change":"2024-09-15T21:55:55.239321+0000","last_active":"2024-09-15T21:55:55.241483+0000","last_peered":"2024-09-15T21:55:55.241483+0000","last_clean":"2024-09-15T21:55:55.241483+0000","last_became_active":"2024-09-15T21:55:55.238833+0000","last_became_peered":"2024-09-15T21:55:55.238833+0000","last_unstale":"2024-09-15T21:55:55.241483+0000","last_undegraded":"2024-09-15T21:55:55.241483+0000","last_fullsized":"2024-09-15T21:55:55.241483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:52.957424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228171+0000","last_change":"2024-09-15T21:55:55.228171+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228171+0000","last_undegraded":"2024-09-15T21:55:55.228171+0000","last_fullsized":"2024-09-15T21:55:55.228171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.267616+0000","last_change":"2024-09-15T21:55:55.262964+0000","last_active":"2024-09-15T21:55:55.267616+0000","last_peered":"2024-09-15T21:55:55.267616+0000","last_clean":"2024-09-15T21:55:55.267616+0000","last_became_active":"2024-09-15T21:55:55.262238+0000","last_became_peered":"2024-09-15T21:55:55.262238+0000","last_unstale":"2024-09-15T21:55:55.267616+0000","last_undegraded":"2024-09-15T21:55:55.267616+0000","last_fullsized":"2024-09-15T21:55:55.267616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:38.005796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.225274+0000","last_change":"2024-09-15T21:55:55.225274+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.225274+0000","last_undegraded":"2024-09-15T21:55:55.225274+0000","last_fullsized":"2024-09-15T21:55:55.225274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.243349+0000","last_change":"2024-09-15T21:55:55.242337+0000","last_active":"2024-09-15T21:55:55.243349+0000","last_peered":"2024-09-15T21:55:55.243349+0000","last_clean":"2024-09-15T21:55:55.243349+0000","last_became_active":"2024-09-15T21:55:55.241660+0000","last_became_peered":"2024-09-15T21:55:55.241660+0000","last_unstale":"2024-09-15T21:55:55.243349+0000","last_undegraded":"2024-09-15T21:55:55.243349+0000","last_fullsized":"2024-09-15T21:55:55.243349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:12.038959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294850+0000","last_change":"2024-09-15T21:55:56.286828+0000","last_active":"2024-09-15T21:55:57.294850+0000","last_peered":"2024-09-15T21:55:57.294850+0000","last_clean":"2024-09-15T21:55:57.294850+0000","last_became_active":"2024-09-15T21:55:56.279323+0000","last_became_peered":"2024-09-15T21:55:56.279323+0000","last_unstale":"2024-09-15T21:55:57.294850+0000","last_undegraded":"2024-09-15T21:55:57.294850+0000","last_fullsized":"2024-09-15T21:55:57.294850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:49.172006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.245516+0000","last_change":"2024-09-15T21:55:55.244961+0000","last_active":"2024-09-15T21:55:55.245516+0000","last_peered":"2024-09-15T21:55:55.245516+0000","last_clean":"2024-09-15T21:55:55.245516+0000","last_became_active":"2024-09-15T21:55:55.244608+0000","last_became_peered":"2024-09-15T21:55:55.244608+0000","last_unstale":"2024-09-15T21:55:55.245516+0000","last_undegraded":"2024-09-15T21:55:55.245516+0000","last_fullsized":"2024-09-15T21:55:55.245516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:59.580457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.225955+0000","last_change":"2024-09-15T21:55:55.225955+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.225955+0000","last_undegraded":"2024-09-15T21:55:55.225955+0000","last_fullsized":"2024-09-15T21:55:55.225955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.241521+0000","last_change":"2024-09-15T21:55:55.239119+0000","last_active":"2024-09-15T21:55:55.241521+0000","last_peered":"2024-09-15T21:55:55.241521+0000","last_clean":"2024-09-15T21:55:55.241521+0000","last_became_active":"2024-09-15T21:55:55.238740+0000","last_became_peered":"2024-09-15T21:55:55.238740+0000","last_unstale":"2024-09-15T21:55:55.241521+0000","last_undegraded":"2024-09-15T21:55:55.241521+0000","last_fullsized":"2024-09-15T21:55:55.241521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:52.176799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229839+0000","last_change":"2024-09-15T21:55:55.229839+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229839+0000","last_undegraded":"2024-09-15T21:55:55.229839+0000","last_fullsized":"2024-09-15T21:55:55.229839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.242778+0000","last_change":"2024-09-15T21:55:55.237840+0000","last_active":"2024-09-15T21:55:55.242778+0000","last_peered":"2024-09-15T21:55:55.242778+0000","last_clean":"2024-09-15T21:55:55.242778+0000","last_became_active":"2024-09-15T21:55:55.237551+0000","last_became_peered":"2024-09-15T21:55:55.237551+0000","last_unstale":"2024-09-15T21:55:55.242778+0000","last_undegraded":"2024-09-15T21:55:55.242778+0000","last_fullsized":"2024-09-15T21:55:55.242778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:03.652358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.234876+0000","last_change":"2024-09-15T21:55:55.234876+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.234876+0000","last_undegraded":"2024-09-15T21:55:55.234876+0000","last_fullsized":"2024-09-15T21:55:55.234876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266917+0000","last_change":"2024-09-15T21:55:55.262914+0000","last_active":"2024-09-15T21:55:55.266917+0000","last_peered":"2024-09-15T21:55:55.266917+0000","last_clean":"2024-09-15T21:55:55.266917+0000","last_became_active":"2024-09-15T21:55:55.262306+0000","last_became_peered":"2024-09-15T21:55:55.262306+0000","last_unstale":"2024-09-15T21:55:55.266917+0000","last_undegraded":"2024-09-15T21:55:55.266917+0000","last_fullsized":"2024-09-15T21:55:55.266917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:47.384542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229614+0000","last_change":"2024-09-15T21:55:55.229614+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229614+0000","last_undegraded":"2024-09-15T21:55:55.229614+0000","last_fullsized":"2024-09-15T21:55:55.229614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266337+0000","last_change":"2024-09-15T21:55:55.255577+0000","last_active":"2024-09-15T21:55:55.266337+0000","last_peered":"2024-09-15T21:55:55.266337+0000","last_clean":"2024-09-15T21:55:55.266337+0000","last_became_active":"2024-09-15T21:55:55.254828+0000","last_became_peered":"2024-09-15T21:55:55.254828+0000","last_unstale":"2024-09-15T21:55:55.266337+0000","last_undegraded":"2024-09-15T21:55:55.266337+0000","last_fullsized":"2024-09-15T21:55:55.266337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:24:28.095912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293173+0000","last_change":"2024-09-15T21:55:56.267608+0000","last_active":"2024-09-15T21:55:57.293173+0000","last_peered":"2024-09-15T21:55:57.293173+0000","last_clean":"2024-09-15T21:55:57.293173+0000","last_became_active":"2024-09-15T21:55:56.266561+0000","last_became_peered":"2024-09-15T21:55:56.266561+0000","last_unstale":"2024-09-15T21:55:57.293173+0000","last_undegraded":"2024-09-15T21:55:57.293173+0000","last_fullsized":"2024-09-15T21:55:57.293173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:22.093251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.267771+0000","last_change":"2024-09-15T21:55:55.265495+0000","last_active":"2024-09-15T21:55:55.267771+0000","last_peered":"2024-09-15T21:55:55.267771+0000","last_clean":"2024-09-15T21:55:55.267771+0000","last_became_active":"2024-09-15T21:55:55.256531+0000","last_became_peered":"2024-09-15T21:55:55.256531+0000","last_unstale":"2024-09-15T21:55:55.267771+0000","last_undegraded":"2024-09-15T21:55:55.267771+0000","last_fullsized":"2024-09-15T21:55:55.267771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:17.977636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293350+0000","last_change":"2024-09-15T21:55:56.278289+0000","last_active":"2024-09-15T21:55:57.293350+0000","last_peered":"2024-09-15T21:55:57.293350+0000","last_clean":"2024-09-15T21:55:57.293350+0000","last_became_active":"2024-09-15T21:55:56.277211+0000","last_became_peered":"2024-09-15T21:55:56.277211+0000","last_unstale":"2024-09-15T21:55:57.293350+0000","last_undegraded":"2024-09-15T21:55:57.293350+0000","last_fullsized":"2024-09-15T21:55:57.293350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:38.020249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.232079+0000","last_change":"2024-09-15T21:55:55.229233+0000","last_active":"2024-09-15T21:55:55.232079+0000","last_peered":"2024-09-15T21:55:55.232079+0000","last_clean":"2024-09-15T21:55:55.232079+0000","last_became_active":"2024-09-15T21:55:55.228846+0000","last_became_peered":"2024-09-15T21:55:55.228846+0000","last_unstale":"2024-09-15T21:55:55.232079+0000","last_undegraded":"2024-09-15T21:55:55.232079+0000","last_fullsized":"2024-09-15T21:55:55.232079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:45.804383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293839+0000","last_change":"2024-09-15T21:55:56.280721+0000","last_active":"2024-09-15T21:55:57.293839+0000","last_peered":"2024-09-15T21:55:57.293839+0000","last_clean":"2024-09-15T21:55:57.293839+0000","last_became_active":"2024-09-15T21:55:56.280319+0000","last_became_peered":"2024-09-15T21:55:56.280319+0000","last_unstale":"2024-09-15T21:55:57.293839+0000","last_undegraded":"2024-09-15T21:55:57.293839+0000","last_fullsized":"2024-09-15T21:55:57.293839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:00.996297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.250609+0000","last_change":"2024-09-15T21:55:55.246626+0000","last_active":"2024-09-15T21:55:55.250609+0000","last_peered":"2024-09-15T21:55:55.250609+0000","last_clean":"2024-09-15T21:55:55.250609+0000","last_became_active":"2024-09-15T21:55:55.245886+0000","last_became_peered":"2024-09-15T21:55:55.245886+0000","last_unstale":"2024-09-15T21:55:55.250609+0000","last_undegraded":"2024-09-15T21:55:55.250609+0000","last_fullsized":"2024-09-15T21:55:55.250609+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:12.038959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293170+0000","last_change":"2024-09-15T21:55:56.267393+0000","last_active":"2024-09-15T21:55:57.293170+0000","last_peered":"2024-09-15T21:55:57.293170+0000","last_clean":"2024-09-15T21:55:57.293170+0000","last_became_active":"2024-09-15T21:55:56.266556+0000","last_became_peered":"2024-09-15T21:55:56.266556+0000","last_unstale":"2024-09-15T21:55:57.293170+0000","last_undegraded":"2024-09-15T21:55:57.293170+0000","last_fullsized":"2024-09-15T21:55:57.293170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:10.617836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266837+0000","last_change":"2024-09-15T21:55:55.261924+0000","last_active":"2024-09-15T21:55:55.266837+0000","last_peered":"2024-09-15T21:55:55.266837+0000","last_clean":"2024-09-15T21:55:55.266837+0000","last_became_active":"2024-09-15T21:55:55.261207+0000","last_became_peered":"2024-09-15T21:55:55.261207+0000","last_unstale":"2024-09-15T21:55:55.266837+0000","last_undegraded":"2024-09-15T21:55:55.266837+0000","last_fullsized":"2024-09-15T21:55:55.266837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:05.016266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294629+0000","last_change":"2024-09-15T21:55:56.290591+0000","last_active":"2024-09-15T21:55:57.294629+0000","last_peered":"2024-09-15T21:55:57.294629+0000","last_clean":"2024-09-15T21:55:57.294629+0000","last_became_active":"2024-09-15T21:55:56.289211+0000","last_became_peered":"2024-09-15T21:55:56.289211+0000","last_unstale":"2024-09-15T21:55:57.294629+0000","last_undegraded":"2024-09-15T21:55:57.294629+0000","last_fullsized":"2024-09-15T21:55:57.294629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:53.958162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.257986+0000","last_change":"2024-09-15T21:55:55.255670+0000","last_active":"2024-09-15T21:55:55.257986+0000","last_peered":"2024-09-15T21:55:55.257986+0000","last_clean":"2024-09-15T21:55:55.257986+0000","last_became_active":"2024-09-15T21:55:55.254936+0000","last_became_peered":"2024-09-15T21:55:55.254936+0000","last_unstale":"2024-09-15T21:55:55.257986+0000","last_undegraded":"2024-09-15T21:55:55.257986+0000","last_fullsized":"2024-09-15T21:55:55.257986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:05.391521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293617+0000","last_change":"2024-09-15T21:55:56.310032+0000","last_active":"2024-09-15T21:55:57.293617+0000","last_peered":"2024-09-15T21:55:57.293617+0000","last_clean":"2024-09-15T21:55:57.293617+0000","last_became_active":"2024-09-15T21:55:56.309746+0000","last_became_peered":"2024-09-15T21:55:56.309746+0000","last_unstale":"2024-09-15T21:55:57.293617+0000","last_undegraded":"2024-09-15T21:55:57.293617+0000","last_fullsized":"2024-09-15T21:55:57.293617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:13.626595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.248462+0000","last_change":"2024-09-15T21:55:55.247682+0000","last_active":"2024-09-15T21:55:55.248462+0000","last_peered":"2024-09-15T21:55:55.248462+0000","last_clean":"2024-09-15T21:55:55.248462+0000","last_became_active":"2024-09-15T21:55:55.247324+0000","last_became_peered":"2024-09-15T21:55:55.247324+0000","last_unstale":"2024-09-15T21:55:55.248462+0000","last_undegraded":"2024-09-15T21:55:55.248462+0000","last_fullsized":"2024-09-15T21:55:55.248462+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:34:47.778872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230372+0000","last_change":"2024-09-15T21:55:55.230372+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230372+0000","last_undegraded":"2024-09-15T21:55:55.230372+0000","last_fullsized":"2024-09-15T21:55:55.230372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.240644+0000","last_change":"2024-09-15T21:55:55.238010+0000","last_active":"2024-09-15T21:55:55.240644+0000","last_peered":"2024-09-15T21:55:55.240644+0000","last_clean":"2024-09-15T21:55:55.240644+0000","last_became_active":"2024-09-15T21:55:55.237459+0000","last_became_peered":"2024-09-15T21:55:55.237459+0000","last_unstale":"2024-09-15T21:55:55.240644+0000","last_undegraded":"2024-09-15T21:55:55.240644+0000","last_fullsized":"2024-09-15T21:55:55.240644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:44.329135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.224236+0000","last_change":"2024-09-15T21:55:55.224236+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.224236+0000","last_undegraded":"2024-09-15T21:55:55.224236+0000","last_fullsized":"2024-09-15T21:55:55.224236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.241499+0000","last_change":"2024-09-15T21:55:55.236793+0000","last_active":"2024-09-15T21:55:55.241499+0000","last_peered":"2024-09-15T21:55:55.241499+0000","last_clean":"2024-09-15T21:55:55.241499+0000","last_became_active":"2024-09-15T21:55:55.236398+0000","last_became_peered":"2024-09-15T21:55:55.236398+0000","last_unstale":"2024-09-15T21:55:55.241499+0000","last_undegraded":"2024-09-15T21:55:55.241499+0000","last_fullsized":"2024-09-15T21:55:55.241499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:45.804383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.224549+0000","last_change":"2024-09-15T21:55:55.224549+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.224549+0000","last_undegraded":"2024-09-15T21:55:55.224549+0000","last_fullsized":"2024-09-15T21:55:55.224549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.237478+0000","last_change":"2024-09-15T21:55:55.236177+0000","last_active":"2024-09-15T21:55:55.237478+0000","last_peered":"2024-09-15T21:55:55.237478+0000","last_clean":"2024-09-15T21:55:55.237478+0000","last_became_active":"2024-09-15T21:55:55.235890+0000","last_became_peered":"2024-09-15T21:55:55.235890+0000","last_unstale":"2024-09-15T21:55:55.237478+0000","last_undegraded":"2024-09-15T21:55:55.237478+0000","last_fullsized":"2024-09-15T21:55:55.237478+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:12.038959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228377+0000","last_change":"2024-09-15T21:55:55.228377+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228377+0000","last_undegraded":"2024-09-15T21:55:55.228377+0000","last_fullsized":"2024-09-15T21:55:55.228377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.248451+0000","last_change":"2024-09-15T21:55:55.247687+0000","last_active":"2024-09-15T21:55:55.248451+0000","last_peered":"2024-09-15T21:55:55.248451+0000","last_clean":"2024-09-15T21:55:55.248451+0000","last_became_active":"2024-09-15T21:55:55.247348+0000","last_became_peered":"2024-09-15T21:55:55.247348+0000","last_unstale":"2024-09-15T21:55:55.248451+0000","last_undegraded":"2024-09-15T21:55:55.248451+0000","last_fullsized":"2024-09-15T21:55:55.248451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:44.329135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.226648+0000","last_change":"2024-09-15T21:55:55.226648+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.226648+0000","last_undegraded":"2024-09-15T21:55:55.226648+0000","last_fullsized":"2024-09-15T21:55:55.226648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.263341+0000","last_change":"2024-09-15T21:55:55.254121+0000","last_active":"2024-09-15T21:55:55.263341+0000","last_peered":"2024-09-15T21:55:55.263341+0000","last_clean":"2024-09-15T21:55:55.263341+0000","last_became_active":"2024-09-15T21:55:55.237665+0000","last_became_peered":"2024-09-15T21:55:55.237665+0000","last_unstale":"2024-09-15T21:55:55.263341+0000","last_undegraded":"2024-09-15T21:55:55.263341+0000","last_fullsized":"2024-09-15T21:55:55.263341+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:18.893644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.227678+0000","last_change":"2024-09-15T21:55:55.227678+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.227678+0000","last_undegraded":"2024-09-15T21:55:55.227678+0000","last_fullsized":"2024-09-15T21:55:55.227678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.254541+0000","last_change":"2024-09-15T21:55:55.253393+0000","last_active":"2024-09-15T21:55:55.254541+0000","last_peered":"2024-09-15T21:55:55.254541+0000","last_clean":"2024-09-15T21:55:55.254541+0000","last_became_active":"2024-09-15T21:55:55.253070+0000","last_became_peered":"2024-09-15T21:55:55.253070+0000","last_unstale":"2024-09-15T21:55:55.254541+0000","last_undegraded":"2024-09-15T21:55:55.254541+0000","last_fullsized":"2024-09-15T21:55:55.254541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:23.173121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295447+0000","last_change":"2024-09-15T21:55:56.269103+0000","last_active":"2024-09-15T21:55:57.295447+0000","last_peered":"2024-09-15T21:55:57.295447+0000","last_clean":"2024-09-15T21:55:57.295447+0000","last_became_active":"2024-09-15T21:55:56.268360+0000","last_became_peered":"2024-09-15T21:55:56.268360+0000","last_unstale":"2024-09-15T21:55:57.295447+0000","last_undegraded":"2024-09-15T21:55:57.295447+0000","last_fullsized":"2024-09-15T21:55:57.295447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:11.274512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.270910+0000","last_change":"2024-09-15T21:55:55.269693+0000","last_active":"2024-09-15T21:55:55.270910+0000","last_peered":"2024-09-15T21:55:55.270910+0000","last_clean":"2024-09-15T21:55:55.270910+0000","last_became_active":"2024-09-15T21:55:55.268821+0000","last_became_peered":"2024-09-15T21:55:55.268821+0000","last_unstale":"2024-09-15T21:55:55.270910+0000","last_undegraded":"2024-09-15T21:55:55.270910+0000","last_fullsized":"2024-09-15T21:55:55.270910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:34:47.778872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295729+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:57.295729+0000","last_peered":"2024-09-15T21:55:57.295729+0000","last_clean":"2024-09-15T21:55:57.295729+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:57.295729+0000","last_undegraded":"2024-09-15T21:55:57.295729+0000","last_fullsized":"2024-09-15T21:55:57.295729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":884736,"data_stored":696851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":925696,"data_stored":716283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35676,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336164,"statfs":{"total":96636764160,"available":96600231936,"internally_reserved":0,"allocated":331776,"data_stored":125895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:56:00.708 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:56:00.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.869+0000 7f144f4f9640 1 Processor -- start 2024-09-15T21:56:00.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.869+0000 7f144f4f9640 1 -- start start 2024-09-15T21:56:00.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144f4f9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14481480c0 0x7f14481413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144f4f9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1448148520 0x7f14481418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144f4f9640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14480b6500 con 0x7f14480b6120 2024-09-15T21:56:00.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144f4f9640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f144814ba30 con 0x7f1448148520 2024-09-15T21:56:00.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144f4f9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f144814bc60 con 0x7f14481480c0 2024-09-15T21:56:00.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144ca94640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14481480c0 0x7f14481413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144ca94640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14481480c0 0x7f14481413b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:50996/0 (socket says 172.21.15.1:50996) 2024-09-15T21:56:00.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144ca94640 1 -- 172.21.15.1:0/2655511549 learned_addr learned my addr 172.21.15.1:0/2655511549 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144da96640 1 --2- 172.21.15.1:0/2655511549 >> v2:172.21.15.70:3300/0 conn(0x7f1448148520 0x7f14481418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144da96640 1 -- 172.21.15.1:0/2655511549 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14481480c0 msgr2=0x7f14481413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144da96640 1 --2- 172.21.15.1:0/2655511549 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14481480c0 0x7f14481413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144da96640 1 -- 172.21.15.1:0/2655511549 >> v1:172.21.15.70:6789/0 conn(0x7f14480b6120 legacy=0x7f144814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144da96640 1 -- 172.21.15.1:0/2655511549 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1448147ba0 con 0x7f1448148520 2024-09-15T21:56:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f143ffff640 1 -- 172.21.15.1:0/2655511549 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 632953382 0 0) 0x7f14480b6500 con 0x7f14480b6120 2024-09-15T21:56:00.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.873+0000 7f144ca94640 1 --2- 172.21.15.1:0/2655511549 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14481480c0 0x7f14481413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:56:00.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f144da96640 1 --2- 172.21.15.1:0/2655511549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1448148520 0x7f14481418f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f14400097c0 tx=0x7f144001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c4abd98eca17e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:00.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f143ffff640 1 -- 172.21.15.1:0/2655511549 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14400b0070 con 0x7f1448148520 2024-09-15T21:56:00.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f143ffff640 1 -- 172.21.15.1:0/2655511549 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14400ab600 con 0x7f1448148520 2024-09-15T21:56:00.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f143ffff640 1 -- 172.21.15.1:0/2655511549 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14400ab9d0 con 0x7f1448148520 2024-09-15T21:56:00.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f144f4f9640 1 -- 172.21.15.1:0/2655511549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1448148520 msgr2=0x7f14481418f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f144f4f9640 1 --2- 172.21.15.1:0/2655511549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1448148520 0x7f14481418f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f14400097c0 tx=0x7f144001c410 comp rx=0 tx=0).stop 2024-09-15T21:56:00.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f144f4f9640 1 -- 172.21.15.1:0/2655511549 shutdown_connections 2024-09-15T21:56:00.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f144f4f9640 1 --2- 172.21.15.1:0/2655511549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1448148520 0x7f14481418f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f144f4f9640 1 --2- 172.21.15.1:0/2655511549 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14481480c0 0x7f14481413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f144f4f9640 1 -- 172.21.15.1:0/2655511549 >> 172.21.15.1:0/2655511549 conn(0x7f14480bd2f0 msgr2=0x7f14480bd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:00.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f144f4f9640 1 -- 172.21.15.1:0/2655511549 shutdown_connections 2024-09-15T21:56:00.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f144f4f9640 1 -- 172.21.15.1:0/2655511549 wait complete. 2024-09-15T21:56:00.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f144f4f9640 1 Processor -- start 2024-09-15T21:56:00.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.877+0000 7f144f4f9640 1 -- start start 2024-09-15T21:56:00.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144f4f9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14480b6120 0x7f144814e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144f4f9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481480c0 0x7f144814d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144f4f9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1448148520 0x7f14481e01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144f4f9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1448154b70 con 0x7f14481480c0 2024-09-15T21:56:00.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144f4f9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f14481549f0 con 0x7f1448148520 2024-09-15T21:56:00.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144f4f9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1448154cf0 con 0x7f14480b6120 2024-09-15T21:56:00.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144ca94640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481480c0 0x7f144814d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144ca94640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481480c0 0x7f144814d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51486/0 (socket says 172.21.15.1:51486) 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144ca94640 1 -- 172.21.15.1:0/2760675086 learned_addr learned my addr 172.21.15.1:0/2760675086 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144d295640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14480b6120 0x7f144814e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144da96640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1448148520 0x7f14481e01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144ca94640 1 -- 172.21.15.1:0/2760675086 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14480b6120 msgr2=0x7f144814e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144ca94640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14480b6120 0x7f144814e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144ca94640 1 -- 172.21.15.1:0/2760675086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1448148520 msgr2=0x7f14481e01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144ca94640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1448148520 0x7f14481e01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144ca94640 1 -- 172.21.15.1:0/2760675086 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144814f000 con 0x7f14481480c0 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144da96640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1448148520 0x7f14481e01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144ca94640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481480c0 0x7f144814d610 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f143800e9d0 tx=0x7f143800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f143dffb640 1 -- 172.21.15.1:0/2760675086 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438017070 con 0x7f14481480c0 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f143dffb640 1 -- 172.21.15.1:0/2760675086 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f143800ca60 con 0x7f14481480c0 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144f4f9640 1 -- 172.21.15.1:0/2760675086 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f144814dcb0 con 0x7f14481480c0 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f143dffb640 1 -- 172.21.15.1:0/2760675086 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143800ce10 con 0x7f14481480c0 2024-09-15T21:56:00.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144f4f9640 1 -- 172.21.15.1:0/2760675086 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f144814c450 con 0x7f14481480c0 2024-09-15T21:56:00.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144f4f9640 1 -- 172.21.15.1:0/2760675086 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f144814b320 con 0x7f14481480c0 2024-09-15T21:56:00.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f143dffb640 1 -- 172.21.15.1:0/2760675086 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f143801a070 con 0x7f14481480c0 2024-09-15T21:56:00.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f143dffb640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f142c0678c0 0x7f142c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:00.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f143dffb640 1 -- 172.21.15.1:0/2760675086 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f1438085f10 con 0x7f14481480c0 2024-09-15T21:56:00.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.881+0000 7f144d295640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f142c0678c0 0x7f142c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:00.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.885+0000 7f144d295640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f142c0678c0 0x7f142c069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f14440012f0 tx=0x7f1444009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:00.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:00.885+0000 7f143dffb640 1 -- 172.21.15.1:0/2760675086 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1438056ae0 con 0x7f14481480c0 2024-09-15T21:56:01.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.041+0000 7f144f4f9640 1 -- 172.21.15.1:0/2760675086 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14480bc250 con 0x7f142c0678c0 2024-09-15T21:56:01.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.057+0000 7f143dffb640 1 -- 172.21.15.1:0/2760675086 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248189 (secure 0 0 0) 0x7f14480bc250 con 0x7f142c0678c0 2024-09-15T21:56:01.065 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:01.066 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:56:01.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.061+0000 7f144f4f9640 1 -- 172.21.15.1:0/2760675086 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f142c0678c0 msgr2=0x7f142c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.061+0000 7f144f4f9640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f142c0678c0 0x7f142c069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f14440012f0 tx=0x7f1444009040 comp rx=0 tx=0).stop 2024-09-15T21:56:01.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.061+0000 7f144f4f9640 1 -- 172.21.15.1:0/2760675086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481480c0 msgr2=0x7f144814d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.061+0000 7f144f4f9640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481480c0 0x7f144814d610 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f143800e9d0 tx=0x7f143800ee90 comp rx=0 tx=0).stop 2024-09-15T21:56:01.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.061+0000 7f144f4f9640 1 -- 172.21.15.1:0/2760675086 shutdown_connections 2024-09-15T21:56:01.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.061+0000 7f144f4f9640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f142c0678c0 0x7f142c069d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.061+0000 7f144f4f9640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1448148520 0x7f14481e01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.061+0000 7f144f4f9640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481480c0 0x7f144814d610 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.061+0000 7f144f4f9640 1 --2- 172.21.15.1:0/2760675086 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f14480b6120 0x7f144814e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.061+0000 7f144f4f9640 1 -- 172.21.15.1:0/2760675086 >> 172.21.15.1:0/2760675086 conn(0x7f14480bd2f0 msgr2=0x7f1448074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:01.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.061+0000 7f144f4f9640 1 -- 172.21.15.1:0/2760675086 shutdown_connections 2024-09-15T21:56:01.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.061+0000 7f144f4f9640 1 -- 172.21.15.1:0/2760675086 wait complete. 2024-09-15T21:56:01.082 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-15T21:55:59.089025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257184,"kb_used_data":3512,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754717536,"statfs":{"total":773094113280,"available":772830756864,"internally_reserved":0,"allocated":3596288,"data_stored":2071444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.875523"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.226282+0000","last_change":"2024-09-15T21:55:55.226282+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.226282+0000","last_undegraded":"2024-09-15T21:55:55.226282+0000","last_fullsized":"2024-09-15T21:55:55.226282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230490+0000","last_change":"2024-09-15T21:55:55.230490+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230490+0000","last_undegraded":"2024-09-15T21:55:55.230490+0000","last_fullsized":"2024-09-15T21:55:55.230490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.234702+0000","last_change":"2024-09-15T21:55:55.234702+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.234702+0000","last_undegraded":"2024-09-15T21:55:55.234702+0000","last_fullsized":"2024-09-15T21:55:55.234702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230208+0000","last_change":"2024-09-15T21:55:55.230208+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230208+0000","last_undegraded":"2024-09-15T21:55:55.230208+0000","last_fullsized":"2024-09-15T21:55:55.230208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293463+0000","last_change":"2024-09-15T21:55:56.285178+0000","last_active":"2024-09-15T21:55:57.293463+0000","last_peered":"2024-09-15T21:55:57.293463+0000","last_clean":"2024-09-15T21:55:57.293463+0000","last_became_active":"2024-09-15T21:55:56.284915+0000","last_became_peered":"2024-09-15T21:55:56.284915+0000","last_unstale":"2024-09-15T21:55:57.293463+0000","last_undegraded":"2024-09-15T21:55:57.293463+0000","last_fullsized":"2024-09-15T21:55:57.293463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:53.134305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230652+0000","last_change":"2024-09-15T21:55:55.230652+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230652+0000","last_undegraded":"2024-09-15T21:55:55.230652+0000","last_fullsized":"2024-09-15T21:55:55.230652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294848+0000","last_change":"2024-09-15T21:55:56.289977+0000","last_active":"2024-09-15T21:55:57.294848+0000","last_peered":"2024-09-15T21:55:57.294848+0000","last_clean":"2024-09-15T21:55:57.294848+0000","last_became_active":"2024-09-15T21:55:56.288235+0000","last_became_peered":"2024-09-15T21:55:56.288235+0000","last_unstale":"2024-09-15T21:55:57.294848+0000","last_undegraded":"2024-09-15T21:55:57.294848+0000","last_fullsized":"2024-09-15T21:55:57.294848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:28.668639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294435+0000","last_change":"2024-09-15T21:55:56.274499+0000","last_active":"2024-09-15T21:55:57.294435+0000","last_peered":"2024-09-15T21:55:57.294435+0000","last_clean":"2024-09-15T21:55:57.294435+0000","last_became_active":"2024-09-15T21:55:56.273194+0000","last_became_peered":"2024-09-15T21:55:56.273194+0000","last_unstale":"2024-09-15T21:55:57.294435+0000","last_undegraded":"2024-09-15T21:55:57.294435+0000","last_fullsized":"2024-09-15T21:55:57.294435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.255317+0000","last_change":"2024-09-15T21:55:55.255317+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.255317+0000","last_undegraded":"2024-09-15T21:55:55.255317+0000","last_fullsized":"2024-09-15T21:55:55.255317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229145+0000","last_change":"2024-09-15T21:55:55.229145+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229145+0000","last_undegraded":"2024-09-15T21:55:55.229145+0000","last_fullsized":"2024-09-15T21:55:55.229145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295306+0000","last_change":"2024-09-15T21:55:56.275939+0000","last_active":"2024-09-15T21:55:57.295306+0000","last_peered":"2024-09-15T21:55:57.295306+0000","last_clean":"2024-09-15T21:55:57.295306+0000","last_became_active":"2024-09-15T21:55:56.275185+0000","last_became_peered":"2024-09-15T21:55:56.275185+0000","last_unstale":"2024-09-15T21:55:57.295306+0000","last_undegraded":"2024-09-15T21:55:57.295306+0000","last_fullsized":"2024-09-15T21:55:57.295306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:04.577354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.235561+0000","last_change":"2024-09-15T21:55:55.235561+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.235561+0000","last_undegraded":"2024-09-15T21:55:55.235561+0000","last_fullsized":"2024-09-15T21:55:55.235561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293562+0000","last_change":"2024-09-15T21:55:56.278716+0000","last_active":"2024-09-15T21:55:57.293562+0000","last_peered":"2024-09-15T21:55:57.293562+0000","last_clean":"2024-09-15T21:55:57.293562+0000","last_became_active":"2024-09-15T21:55:56.277722+0000","last_became_peered":"2024-09-15T21:55:56.277722+0000","last_unstale":"2024-09-15T21:55:57.293562+0000","last_undegraded":"2024-09-15T21:55:57.293562+0000","last_fullsized":"2024-09-15T21:55:57.293562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:18.528351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230066+0000","last_change":"2024-09-15T21:55:55.230066+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230066+0000","last_undegraded":"2024-09-15T21:55:55.230066+0000","last_fullsized":"2024-09-15T21:55:55.230066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.231822+0000","last_change":"2024-09-15T21:55:55.231822+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.231822+0000","last_undegraded":"2024-09-15T21:55:55.231822+0000","last_fullsized":"2024-09-15T21:55:55.231822+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295625+0000","last_change":"2024-09-15T21:55:56.300687+0000","last_active":"2024-09-15T21:55:57.295625+0000","last_peered":"2024-09-15T21:55:57.295625+0000","last_clean":"2024-09-15T21:55:57.295625+0000","last_became_active":"2024-09-15T21:55:56.300004+0000","last_became_peered":"2024-09-15T21:55:56.300004+0000","last_unstale":"2024-09-15T21:55:57.295625+0000","last_undegraded":"2024-09-15T21:55:57.295625+0000","last_fullsized":"2024-09-15T21:55:57.295625+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:47.385096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295452+0000","last_change":"2024-09-15T21:55:56.277883+0000","last_active":"2024-09-15T21:55:57.295452+0000","last_peered":"2024-09-15T21:55:57.295452+0000","last_clean":"2024-09-15T21:55:57.295452+0000","last_became_active":"2024-09-15T21:55:56.277149+0000","last_became_peered":"2024-09-15T21:55:56.277149+0000","last_unstale":"2024-09-15T21:55:57.295452+0000","last_undegraded":"2024-09-15T21:55:57.295452+0000","last_fullsized":"2024-09-15T21:55:57.295452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:54.377784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229862+0000","last_change":"2024-09-15T21:55:55.229862+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229862+0000","last_undegraded":"2024-09-15T21:55:55.229862+0000","last_fullsized":"2024-09-15T21:55:55.229862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228248+0000","last_change":"2024-09-15T21:55:55.228248+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228248+0000","last_undegraded":"2024-09-15T21:55:55.228248+0000","last_fullsized":"2024-09-15T21:55:55.228248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293340+0000","last_change":"2024-09-15T21:55:56.308957+0000","last_active":"2024-09-15T21:55:57.293340+0000","last_peered":"2024-09-15T21:55:57.293340+0000","last_clean":"2024-09-15T21:55:57.293340+0000","last_became_active":"2024-09-15T21:55:56.308655+0000","last_became_peered":"2024-09-15T21:55:56.308655+0000","last_unstale":"2024-09-15T21:55:57.293340+0000","last_undegraded":"2024-09-15T21:55:57.293340+0000","last_fullsized":"2024-09-15T21:55:57.293340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:42.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.255281+0000","last_change":"2024-09-15T21:55:55.255281+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.255281+0000","last_undegraded":"2024-09-15T21:55:55.255281+0000","last_fullsized":"2024-09-15T21:55:55.255281+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.231596+0000","last_change":"2024-09-15T21:55:55.231596+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.231596+0000","last_undegraded":"2024-09-15T21:55:55.231596+0000","last_fullsized":"2024-09-15T21:55:55.231596+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.224324+0000","last_change":"2024-09-15T21:55:55.224324+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.224324+0000","last_undegraded":"2024-09-15T21:55:55.224324+0000","last_fullsized":"2024-09-15T21:55:55.224324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230946+0000","last_change":"2024-09-15T21:55:55.230946+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230946+0000","last_undegraded":"2024-09-15T21:55:55.230946+0000","last_fullsized":"2024-09-15T21:55:55.230946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229576+0000","last_change":"2024-09-15T21:55:55.229576+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229576+0000","last_undegraded":"2024-09-15T21:55:55.229576+0000","last_fullsized":"2024-09-15T21:55:55.229576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228310+0000","last_change":"2024-09-15T21:55:55.228310+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228310+0000","last_undegraded":"2024-09-15T21:55:55.228310+0000","last_fullsized":"2024-09-15T21:55:55.228310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230086+0000","last_change":"2024-09-15T21:55:55.230086+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230086+0000","last_undegraded":"2024-09-15T21:55:55.230086+0000","last_fullsized":"2024-09-15T21:55:55.230086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.234426+0000","last_change":"2024-09-15T21:55:55.234426+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.234426+0000","last_undegraded":"2024-09-15T21:55:55.234426+0000","last_fullsized":"2024-09-15T21:55:55.234426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.233282+0000","last_change":"2024-09-15T21:55:55.233282+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.233282+0000","last_undegraded":"2024-09-15T21:55:55.233282+0000","last_fullsized":"2024-09-15T21:55:55.233282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295041+0000","last_change":"2024-09-15T21:55:56.278013+0000","last_active":"2024-09-15T21:55:57.295041+0000","last_peered":"2024-09-15T21:55:57.295041+0000","last_clean":"2024-09-15T21:55:57.295041+0000","last_became_active":"2024-09-15T21:55:56.277260+0000","last_became_peered":"2024-09-15T21:55:56.277260+0000","last_unstale":"2024-09-15T21:55:57.295041+0000","last_undegraded":"2024-09-15T21:55:57.295041+0000","last_fullsized":"2024-09-15T21:55:57.295041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:07.090183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.227090+0000","last_change":"2024-09-15T21:55:55.227090+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.227090+0000","last_undegraded":"2024-09-15T21:55:55.227090+0000","last_fullsized":"2024-09-15T21:55:55.227090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294405+0000","last_change":"2024-09-15T21:55:56.298083+0000","last_active":"2024-09-15T21:55:57.294405+0000","last_peered":"2024-09-15T21:55:57.294405+0000","last_clean":"2024-09-15T21:55:57.294405+0000","last_became_active":"2024-09-15T21:55:56.286370+0000","last_became_peered":"2024-09-15T21:55:56.286370+0000","last_unstale":"2024-09-15T21:55:57.294405+0000","last_undegraded":"2024-09-15T21:55:57.294405+0000","last_fullsized":"2024-09-15T21:55:57.294405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:40.099978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.224764+0000","last_change":"2024-09-15T21:55:55.224764+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.224764+0000","last_undegraded":"2024-09-15T21:55:55.224764+0000","last_fullsized":"2024-09-15T21:55:55.224764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.252556+0000","last_change":"2024-09-15T21:55:55.249652+0000","last_active":"2024-09-15T21:55:55.252556+0000","last_peered":"2024-09-15T21:55:55.252556+0000","last_clean":"2024-09-15T21:55:55.252556+0000","last_became_active":"2024-09-15T21:55:55.248947+0000","last_became_peered":"2024-09-15T21:55:55.248947+0000","last_unstale":"2024-09-15T21:55:55.252556+0000","last_undegraded":"2024-09-15T21:55:55.252556+0000","last_fullsized":"2024-09-15T21:55:55.252556+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:44.329135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.225091+0000","last_change":"2024-09-15T21:55:55.225091+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.225091+0000","last_undegraded":"2024-09-15T21:55:55.225091+0000","last_fullsized":"2024-09-15T21:55:55.225091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.242840+0000","last_change":"2024-09-15T21:55:55.240388+0000","last_active":"2024-09-15T21:55:55.242840+0000","last_peered":"2024-09-15T21:55:55.242840+0000","last_clean":"2024-09-15T21:55:55.242840+0000","last_became_active":"2024-09-15T21:55:55.239837+0000","last_became_peered":"2024-09-15T21:55:55.239837+0000","last_unstale":"2024-09-15T21:55:55.242840+0000","last_undegraded":"2024-09-15T21:55:55.242840+0000","last_fullsized":"2024-09-15T21:55:55.242840+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:34:47.778872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229016+0000","last_change":"2024-09-15T21:55:55.229016+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229016+0000","last_undegraded":"2024-09-15T21:55:55.229016+0000","last_fullsized":"2024-09-15T21:55:55.229016+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.242212+0000","last_change":"2024-09-15T21:55:55.240018+0000","last_active":"2024-09-15T21:55:55.242212+0000","last_peered":"2024-09-15T21:55:55.242212+0000","last_clean":"2024-09-15T21:55:55.242212+0000","last_became_active":"2024-09-15T21:55:55.239512+0000","last_became_peered":"2024-09-15T21:55:55.239512+0000","last_unstale":"2024-09-15T21:55:55.242212+0000","last_undegraded":"2024-09-15T21:55:55.242212+0000","last_fullsized":"2024-09-15T21:55:55.242212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:25.819619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.227070+0000","last_change":"2024-09-15T21:55:55.227070+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.227070+0000","last_undegraded":"2024-09-15T21:55:55.227070+0000","last_fullsized":"2024-09-15T21:55:55.227070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293444+0000","last_change":"2024-09-15T21:55:55.241122+0000","last_active":"2024-09-15T21:55:57.293444+0000","last_peered":"2024-09-15T21:55:57.293444+0000","last_clean":"2024-09-15T21:55:57.293444+0000","last_became_active":"2024-09-15T21:55:55.240704+0000","last_became_peered":"2024-09-15T21:55:55.240704+0000","last_unstale":"2024-09-15T21:55:57.293444+0000","last_undegraded":"2024-09-15T21:55:57.293444+0000","last_fullsized":"2024-09-15T21:55:57.293444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:13.090176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295034+0000","last_change":"2024-09-15T21:55:56.288570+0000","last_active":"2024-09-15T21:55:57.295034+0000","last_peered":"2024-09-15T21:55:57.295034+0000","last_clean":"2024-09-15T21:55:57.295034+0000","last_became_active":"2024-09-15T21:55:56.279697+0000","last_became_peered":"2024-09-15T21:55:56.279697+0000","last_unstale":"2024-09-15T21:55:57.295034+0000","last_undegraded":"2024-09-15T21:55:57.295034+0000","last_fullsized":"2024-09-15T21:55:57.295034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:44.393748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266728+0000","last_change":"2024-09-15T21:55:55.260925+0000","last_active":"2024-09-15T21:55:55.266728+0000","last_peered":"2024-09-15T21:55:55.266728+0000","last_clean":"2024-09-15T21:55:55.266728+0000","last_became_active":"2024-09-15T21:55:55.257306+0000","last_became_peered":"2024-09-15T21:55:55.257306+0000","last_unstale":"2024-09-15T21:55:55.266728+0000","last_undegraded":"2024-09-15T21:55:55.266728+0000","last_fullsized":"2024-09-15T21:55:55.266728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:25.926217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.232427+0000","last_change":"2024-09-15T21:55:55.232427+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.232427+0000","last_undegraded":"2024-09-15T21:55:55.232427+0000","last_fullsized":"2024-09-15T21:55:55.232427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266754+0000","last_change":"2024-09-15T21:55:55.261177+0000","last_active":"2024-09-15T21:55:55.266754+0000","last_peered":"2024-09-15T21:55:55.266754+0000","last_clean":"2024-09-15T21:55:55.266754+0000","last_became_active":"2024-09-15T21:55:55.256722+0000","last_became_peered":"2024-09-15T21:55:55.256722+0000","last_unstale":"2024-09-15T21:55:55.266754+0000","last_undegraded":"2024-09-15T21:55:55.266754+0000","last_fullsized":"2024-09-15T21:55:55.266754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:16:53.722416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230410+0000","last_change":"2024-09-15T21:55:55.230410+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230410+0000","last_undegraded":"2024-09-15T21:55:55.230410+0000","last_fullsized":"2024-09-15T21:55:55.230410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.240719+0000","last_change":"2024-09-15T21:55:55.235928+0000","last_active":"2024-09-15T21:55:55.240719+0000","last_peered":"2024-09-15T21:55:55.240719+0000","last_clean":"2024-09-15T21:55:55.240719+0000","last_became_active":"2024-09-15T21:55:55.235501+0000","last_became_peered":"2024-09-15T21:55:55.235501+0000","last_unstale":"2024-09-15T21:55:55.240719+0000","last_undegraded":"2024-09-15T21:55:55.240719+0000","last_fullsized":"2024-09-15T21:55:55.240719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:58.304088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.227139+0000","last_change":"2024-09-15T21:55:55.227139+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.227139+0000","last_undegraded":"2024-09-15T21:55:55.227139+0000","last_fullsized":"2024-09-15T21:55:55.227139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266906+0000","last_change":"2024-09-15T21:55:55.262772+0000","last_active":"2024-09-15T21:55:55.266906+0000","last_peered":"2024-09-15T21:55:55.266906+0000","last_clean":"2024-09-15T21:55:55.266906+0000","last_became_active":"2024-09-15T21:55:55.262001+0000","last_became_peered":"2024-09-15T21:55:55.262001+0000","last_unstale":"2024-09-15T21:55:55.266906+0000","last_undegraded":"2024-09-15T21:55:55.266906+0000","last_fullsized":"2024-09-15T21:55:55.266906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:45:57.077886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230359+0000","last_change":"2024-09-15T21:55:55.230359+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230359+0000","last_undegraded":"2024-09-15T21:55:55.230359+0000","last_fullsized":"2024-09-15T21:55:55.230359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.252235+0000","last_change":"2024-09-15T21:55:55.251449+0000","last_active":"2024-09-15T21:55:55.252235+0000","last_peered":"2024-09-15T21:55:55.252235+0000","last_clean":"2024-09-15T21:55:55.252235+0000","last_became_active":"2024-09-15T21:55:55.251192+0000","last_became_peered":"2024-09-15T21:55:55.251192+0000","last_unstale":"2024-09-15T21:55:55.252235+0000","last_undegraded":"2024-09-15T21:55:55.252235+0000","last_fullsized":"2024-09-15T21:55:55.252235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:05.391521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.226032+0000","last_change":"2024-09-15T21:55:55.226032+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.226032+0000","last_undegraded":"2024-09-15T21:55:55.226032+0000","last_fullsized":"2024-09-15T21:55:55.226032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.238189+0000","last_change":"2024-09-15T21:55:55.234667+0000","last_active":"2024-09-15T21:55:55.238189+0000","last_peered":"2024-09-15T21:55:55.238189+0000","last_clean":"2024-09-15T21:55:55.238189+0000","last_became_active":"2024-09-15T21:55:55.234277+0000","last_became_peered":"2024-09-15T21:55:55.234277+0000","last_unstale":"2024-09-15T21:55:55.238189+0000","last_undegraded":"2024-09-15T21:55:55.238189+0000","last_fullsized":"2024-09-15T21:55:55.238189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:03.652358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228532+0000","last_change":"2024-09-15T21:55:55.228532+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228532+0000","last_undegraded":"2024-09-15T21:55:55.228532+0000","last_fullsized":"2024-09-15T21:55:55.228532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.249211+0000","last_change":"2024-09-15T21:55:55.246855+0000","last_active":"2024-09-15T21:55:55.249211+0000","last_peered":"2024-09-15T21:55:55.249211+0000","last_clean":"2024-09-15T21:55:55.249211+0000","last_became_active":"2024-09-15T21:55:55.245901+0000","last_became_peered":"2024-09-15T21:55:55.245901+0000","last_unstale":"2024-09-15T21:55:55.249211+0000","last_undegraded":"2024-09-15T21:55:55.249211+0000","last_fullsized":"2024-09-15T21:55:55.249211+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:59.580457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.236200+0000","last_change":"2024-09-15T21:55:55.236200+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.236200+0000","last_undegraded":"2024-09-15T21:55:55.236200+0000","last_fullsized":"2024-09-15T21:55:55.236200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.241483+0000","last_change":"2024-09-15T21:55:55.239321+0000","last_active":"2024-09-15T21:55:55.241483+0000","last_peered":"2024-09-15T21:55:55.241483+0000","last_clean":"2024-09-15T21:55:55.241483+0000","last_became_active":"2024-09-15T21:55:55.238833+0000","last_became_peered":"2024-09-15T21:55:55.238833+0000","last_unstale":"2024-09-15T21:55:55.241483+0000","last_undegraded":"2024-09-15T21:55:55.241483+0000","last_fullsized":"2024-09-15T21:55:55.241483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:52.957424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228171+0000","last_change":"2024-09-15T21:55:55.228171+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228171+0000","last_undegraded":"2024-09-15T21:55:55.228171+0000","last_fullsized":"2024-09-15T21:55:55.228171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.267616+0000","last_change":"2024-09-15T21:55:55.262964+0000","last_active":"2024-09-15T21:55:55.267616+0000","last_peered":"2024-09-15T21:55:55.267616+0000","last_clean":"2024-09-15T21:55:55.267616+0000","last_became_active":"2024-09-15T21:55:55.262238+0000","last_became_peered":"2024-09-15T21:55:55.262238+0000","last_unstale":"2024-09-15T21:55:55.267616+0000","last_undegraded":"2024-09-15T21:55:55.267616+0000","last_fullsized":"2024-09-15T21:55:55.267616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:41:38.005796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.225274+0000","last_change":"2024-09-15T21:55:55.225274+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.225274+0000","last_undegraded":"2024-09-15T21:55:55.225274+0000","last_fullsized":"2024-09-15T21:55:55.225274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.243349+0000","last_change":"2024-09-15T21:55:55.242337+0000","last_active":"2024-09-15T21:55:55.243349+0000","last_peered":"2024-09-15T21:55:55.243349+0000","last_clean":"2024-09-15T21:55:55.243349+0000","last_became_active":"2024-09-15T21:55:55.241660+0000","last_became_peered":"2024-09-15T21:55:55.241660+0000","last_unstale":"2024-09-15T21:55:55.243349+0000","last_undegraded":"2024-09-15T21:55:55.243349+0000","last_fullsized":"2024-09-15T21:55:55.243349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:12.038959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294850+0000","last_change":"2024-09-15T21:55:56.286828+0000","last_active":"2024-09-15T21:55:57.294850+0000","last_peered":"2024-09-15T21:55:57.294850+0000","last_clean":"2024-09-15T21:55:57.294850+0000","last_became_active":"2024-09-15T21:55:56.279323+0000","last_became_peered":"2024-09-15T21:55:56.279323+0000","last_unstale":"2024-09-15T21:55:57.294850+0000","last_undegraded":"2024-09-15T21:55:57.294850+0000","last_fullsized":"2024-09-15T21:55:57.294850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:49.172006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.245516+0000","last_change":"2024-09-15T21:55:55.244961+0000","last_active":"2024-09-15T21:55:55.245516+0000","last_peered":"2024-09-15T21:55:55.245516+0000","last_clean":"2024-09-15T21:55:55.245516+0000","last_became_active":"2024-09-15T21:55:55.244608+0000","last_became_peered":"2024-09-15T21:55:55.244608+0000","last_unstale":"2024-09-15T21:55:55.245516+0000","last_undegraded":"2024-09-15T21:55:55.245516+0000","last_fullsized":"2024-09-15T21:55:55.245516+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:59.580457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.225955+0000","last_change":"2024-09-15T21:55:55.225955+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.225955+0000","last_undegraded":"2024-09-15T21:55:55.225955+0000","last_fullsized":"2024-09-15T21:55:55.225955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.241521+0000","last_change":"2024-09-15T21:55:55.239119+0000","last_active":"2024-09-15T21:55:55.241521+0000","last_peered":"2024-09-15T21:55:55.241521+0000","last_clean":"2024-09-15T21:55:55.241521+0000","last_became_active":"2024-09-15T21:55:55.238740+0000","last_became_peered":"2024-09-15T21:55:55.238740+0000","last_unstale":"2024-09-15T21:55:55.241521+0000","last_undegraded":"2024-09-15T21:55:55.241521+0000","last_fullsized":"2024-09-15T21:55:55.241521+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:52.176799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229839+0000","last_change":"2024-09-15T21:55:55.229839+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229839+0000","last_undegraded":"2024-09-15T21:55:55.229839+0000","last_fullsized":"2024-09-15T21:55:55.229839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.242778+0000","last_change":"2024-09-15T21:55:55.237840+0000","last_active":"2024-09-15T21:55:55.242778+0000","last_peered":"2024-09-15T21:55:55.242778+0000","last_clean":"2024-09-15T21:55:55.242778+0000","last_became_active":"2024-09-15T21:55:55.237551+0000","last_became_peered":"2024-09-15T21:55:55.237551+0000","last_unstale":"2024-09-15T21:55:55.242778+0000","last_undegraded":"2024-09-15T21:55:55.242778+0000","last_fullsized":"2024-09-15T21:55:55.242778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:03.652358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.234876+0000","last_change":"2024-09-15T21:55:55.234876+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.234876+0000","last_undegraded":"2024-09-15T21:55:55.234876+0000","last_fullsized":"2024-09-15T21:55:55.234876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266917+0000","last_change":"2024-09-15T21:55:55.262914+0000","last_active":"2024-09-15T21:55:55.266917+0000","last_peered":"2024-09-15T21:55:55.266917+0000","last_clean":"2024-09-15T21:55:55.266917+0000","last_became_active":"2024-09-15T21:55:55.262306+0000","last_became_peered":"2024-09-15T21:55:55.262306+0000","last_unstale":"2024-09-15T21:55:55.266917+0000","last_undegraded":"2024-09-15T21:55:55.266917+0000","last_fullsized":"2024-09-15T21:55:55.266917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:47.384542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.229614+0000","last_change":"2024-09-15T21:55:55.229614+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.229614+0000","last_undegraded":"2024-09-15T21:55:55.229614+0000","last_fullsized":"2024-09-15T21:55:55.229614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266337+0000","last_change":"2024-09-15T21:55:55.255577+0000","last_active":"2024-09-15T21:55:55.266337+0000","last_peered":"2024-09-15T21:55:55.266337+0000","last_clean":"2024-09-15T21:55:55.266337+0000","last_became_active":"2024-09-15T21:55:55.254828+0000","last_became_peered":"2024-09-15T21:55:55.254828+0000","last_unstale":"2024-09-15T21:55:55.266337+0000","last_undegraded":"2024-09-15T21:55:55.266337+0000","last_fullsized":"2024-09-15T21:55:55.266337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:24:28.095912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293173+0000","last_change":"2024-09-15T21:55:56.267608+0000","last_active":"2024-09-15T21:55:57.293173+0000","last_peered":"2024-09-15T21:55:57.293173+0000","last_clean":"2024-09-15T21:55:57.293173+0000","last_became_active":"2024-09-15T21:55:56.266561+0000","last_became_peered":"2024-09-15T21:55:56.266561+0000","last_unstale":"2024-09-15T21:55:57.293173+0000","last_undegraded":"2024-09-15T21:55:57.293173+0000","last_fullsized":"2024-09-15T21:55:57.293173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:22.093251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.267771+0000","last_change":"2024-09-15T21:55:55.265495+0000","last_active":"2024-09-15T21:55:55.267771+0000","last_peered":"2024-09-15T21:55:55.267771+0000","last_clean":"2024-09-15T21:55:55.267771+0000","last_became_active":"2024-09-15T21:55:55.256531+0000","last_became_peered":"2024-09-15T21:55:55.256531+0000","last_unstale":"2024-09-15T21:55:55.267771+0000","last_undegraded":"2024-09-15T21:55:55.267771+0000","last_fullsized":"2024-09-15T21:55:55.267771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:17.977636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293350+0000","last_change":"2024-09-15T21:55:56.278289+0000","last_active":"2024-09-15T21:55:57.293350+0000","last_peered":"2024-09-15T21:55:57.293350+0000","last_clean":"2024-09-15T21:55:57.293350+0000","last_became_active":"2024-09-15T21:55:56.277211+0000","last_became_peered":"2024-09-15T21:55:56.277211+0000","last_unstale":"2024-09-15T21:55:57.293350+0000","last_undegraded":"2024-09-15T21:55:57.293350+0000","last_fullsized":"2024-09-15T21:55:57.293350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:38.020249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.232079+0000","last_change":"2024-09-15T21:55:55.229233+0000","last_active":"2024-09-15T21:55:55.232079+0000","last_peered":"2024-09-15T21:55:55.232079+0000","last_clean":"2024-09-15T21:55:55.232079+0000","last_became_active":"2024-09-15T21:55:55.228846+0000","last_became_peered":"2024-09-15T21:55:55.228846+0000","last_unstale":"2024-09-15T21:55:55.232079+0000","last_undegraded":"2024-09-15T21:55:55.232079+0000","last_fullsized":"2024-09-15T21:55:55.232079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:45.804383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293839+0000","last_change":"2024-09-15T21:55:56.280721+0000","last_active":"2024-09-15T21:55:57.293839+0000","last_peered":"2024-09-15T21:55:57.293839+0000","last_clean":"2024-09-15T21:55:57.293839+0000","last_became_active":"2024-09-15T21:55:56.280319+0000","last_became_peered":"2024-09-15T21:55:56.280319+0000","last_unstale":"2024-09-15T21:55:57.293839+0000","last_undegraded":"2024-09-15T21:55:57.293839+0000","last_fullsized":"2024-09-15T21:55:57.293839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:00.996297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.250609+0000","last_change":"2024-09-15T21:55:55.246626+0000","last_active":"2024-09-15T21:55:55.250609+0000","last_peered":"2024-09-15T21:55:55.250609+0000","last_clean":"2024-09-15T21:55:55.250609+0000","last_became_active":"2024-09-15T21:55:55.245886+0000","last_became_peered":"2024-09-15T21:55:55.245886+0000","last_unstale":"2024-09-15T21:55:55.250609+0000","last_undegraded":"2024-09-15T21:55:55.250609+0000","last_fullsized":"2024-09-15T21:55:55.250609+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:12.038959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293170+0000","last_change":"2024-09-15T21:55:56.267393+0000","last_active":"2024-09-15T21:55:57.293170+0000","last_peered":"2024-09-15T21:55:57.293170+0000","last_clean":"2024-09-15T21:55:57.293170+0000","last_became_active":"2024-09-15T21:55:56.266556+0000","last_became_peered":"2024-09-15T21:55:56.266556+0000","last_unstale":"2024-09-15T21:55:57.293170+0000","last_undegraded":"2024-09-15T21:55:57.293170+0000","last_fullsized":"2024-09-15T21:55:57.293170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:10.617836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.266837+0000","last_change":"2024-09-15T21:55:55.261924+0000","last_active":"2024-09-15T21:55:55.266837+0000","last_peered":"2024-09-15T21:55:55.266837+0000","last_clean":"2024-09-15T21:55:55.266837+0000","last_became_active":"2024-09-15T21:55:55.261207+0000","last_became_peered":"2024-09-15T21:55:55.261207+0000","last_unstale":"2024-09-15T21:55:55.266837+0000","last_undegraded":"2024-09-15T21:55:55.266837+0000","last_fullsized":"2024-09-15T21:55:55.266837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:05.016266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294629+0000","last_change":"2024-09-15T21:55:56.290591+0000","last_active":"2024-09-15T21:55:57.294629+0000","last_peered":"2024-09-15T21:55:57.294629+0000","last_clean":"2024-09-15T21:55:57.294629+0000","last_became_active":"2024-09-15T21:55:56.289211+0000","last_became_peered":"2024-09-15T21:55:56.289211+0000","last_unstale":"2024-09-15T21:55:57.294629+0000","last_undegraded":"2024-09-15T21:55:57.294629+0000","last_fullsized":"2024-09-15T21:55:57.294629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:53.958162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.257986+0000","last_change":"2024-09-15T21:55:55.255670+0000","last_active":"2024-09-15T21:55:55.257986+0000","last_peered":"2024-09-15T21:55:55.257986+0000","last_clean":"2024-09-15T21:55:55.257986+0000","last_became_active":"2024-09-15T21:55:55.254936+0000","last_became_peered":"2024-09-15T21:55:55.254936+0000","last_unstale":"2024-09-15T21:55:55.257986+0000","last_undegraded":"2024-09-15T21:55:55.257986+0000","last_fullsized":"2024-09-15T21:55:55.257986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:05.391521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293617+0000","last_change":"2024-09-15T21:55:56.310032+0000","last_active":"2024-09-15T21:55:57.293617+0000","last_peered":"2024-09-15T21:55:57.293617+0000","last_clean":"2024-09-15T21:55:57.293617+0000","last_became_active":"2024-09-15T21:55:56.309746+0000","last_became_peered":"2024-09-15T21:55:56.309746+0000","last_unstale":"2024-09-15T21:55:57.293617+0000","last_undegraded":"2024-09-15T21:55:57.293617+0000","last_fullsized":"2024-09-15T21:55:57.293617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:13.626595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.248462+0000","last_change":"2024-09-15T21:55:55.247682+0000","last_active":"2024-09-15T21:55:55.248462+0000","last_peered":"2024-09-15T21:55:55.248462+0000","last_clean":"2024-09-15T21:55:55.248462+0000","last_became_active":"2024-09-15T21:55:55.247324+0000","last_became_peered":"2024-09-15T21:55:55.247324+0000","last_unstale":"2024-09-15T21:55:55.248462+0000","last_undegraded":"2024-09-15T21:55:55.248462+0000","last_fullsized":"2024-09-15T21:55:55.248462+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:34:47.778872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.230372+0000","last_change":"2024-09-15T21:55:55.230372+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.230372+0000","last_undegraded":"2024-09-15T21:55:55.230372+0000","last_fullsized":"2024-09-15T21:55:55.230372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.240644+0000","last_change":"2024-09-15T21:55:55.238010+0000","last_active":"2024-09-15T21:55:55.240644+0000","last_peered":"2024-09-15T21:55:55.240644+0000","last_clean":"2024-09-15T21:55:55.240644+0000","last_became_active":"2024-09-15T21:55:55.237459+0000","last_became_peered":"2024-09-15T21:55:55.237459+0000","last_unstale":"2024-09-15T21:55:55.240644+0000","last_undegraded":"2024-09-15T21:55:55.240644+0000","last_fullsized":"2024-09-15T21:55:55.240644+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:44.329135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.224236+0000","last_change":"2024-09-15T21:55:55.224236+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.224236+0000","last_undegraded":"2024-09-15T21:55:55.224236+0000","last_fullsized":"2024-09-15T21:55:55.224236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.241499+0000","last_change":"2024-09-15T21:55:55.236793+0000","last_active":"2024-09-15T21:55:55.241499+0000","last_peered":"2024-09-15T21:55:55.241499+0000","last_clean":"2024-09-15T21:55:55.241499+0000","last_became_active":"2024-09-15T21:55:55.236398+0000","last_became_peered":"2024-09-15T21:55:55.236398+0000","last_unstale":"2024-09-15T21:55:55.241499+0000","last_undegraded":"2024-09-15T21:55:55.241499+0000","last_fullsized":"2024-09-15T21:55:55.241499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:45.804383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.224549+0000","last_change":"2024-09-15T21:55:55.224549+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.224549+0000","last_undegraded":"2024-09-15T21:55:55.224549+0000","last_fullsized":"2024-09-15T21:55:55.224549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.237478+0000","last_change":"2024-09-15T21:55:55.236177+0000","last_active":"2024-09-15T21:55:55.237478+0000","last_peered":"2024-09-15T21:55:55.237478+0000","last_clean":"2024-09-15T21:55:55.237478+0000","last_became_active":"2024-09-15T21:55:55.235890+0000","last_became_peered":"2024-09-15T21:55:55.235890+0000","last_unstale":"2024-09-15T21:55:55.237478+0000","last_undegraded":"2024-09-15T21:55:55.237478+0000","last_fullsized":"2024-09-15T21:55:55.237478+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:12.038959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.228377+0000","last_change":"2024-09-15T21:55:55.228377+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.228377+0000","last_undegraded":"2024-09-15T21:55:55.228377+0000","last_fullsized":"2024-09-15T21:55:55.228377+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.248451+0000","last_change":"2024-09-15T21:55:55.247687+0000","last_active":"2024-09-15T21:55:55.248451+0000","last_peered":"2024-09-15T21:55:55.248451+0000","last_clean":"2024-09-15T21:55:55.248451+0000","last_became_active":"2024-09-15T21:55:55.247348+0000","last_became_peered":"2024-09-15T21:55:55.247348+0000","last_unstale":"2024-09-15T21:55:55.248451+0000","last_undegraded":"2024-09-15T21:55:55.248451+0000","last_fullsized":"2024-09-15T21:55:55.248451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:44.329135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.226648+0000","last_change":"2024-09-15T21:55:55.226648+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.226648+0000","last_undegraded":"2024-09-15T21:55:55.226648+0000","last_fullsized":"2024-09-15T21:55:55.226648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.263341+0000","last_change":"2024-09-15T21:55:55.254121+0000","last_active":"2024-09-15T21:55:55.263341+0000","last_peered":"2024-09-15T21:55:55.263341+0000","last_clean":"2024-09-15T21:55:55.263341+0000","last_became_active":"2024-09-15T21:55:55.237665+0000","last_became_peered":"2024-09-15T21:55:55.237665+0000","last_unstale":"2024-09-15T21:55:55.263341+0000","last_undegraded":"2024-09-15T21:55:55.263341+0000","last_fullsized":"2024-09-15T21:55:55.263341+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:18.893644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-09-15T21:55:55.227678+0000","last_change":"2024-09-15T21:55:55.227678+0000","last_active":"2024-09-15T21:55:55.212487+0000","last_peered":"2024-09-15T21:55:55.212487+0000","last_clean":"2024-09-15T21:55:55.212487+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T21:55:55.227678+0000","last_undegraded":"2024-09-15T21:55:55.227678+0000","last_fullsized":"2024-09-15T21:55:55.227678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.254541+0000","last_change":"2024-09-15T21:55:55.253393+0000","last_active":"2024-09-15T21:55:55.254541+0000","last_peered":"2024-09-15T21:55:55.254541+0000","last_clean":"2024-09-15T21:55:55.254541+0000","last_became_active":"2024-09-15T21:55:55.253070+0000","last_became_peered":"2024-09-15T21:55:55.253070+0000","last_unstale":"2024-09-15T21:55:55.254541+0000","last_undegraded":"2024-09-15T21:55:55.254541+0000","last_fullsized":"2024-09-15T21:55:55.254541+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:23.173121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295447+0000","last_change":"2024-09-15T21:55:56.269103+0000","last_active":"2024-09-15T21:55:57.295447+0000","last_peered":"2024-09-15T21:55:57.295447+0000","last_clean":"2024-09-15T21:55:57.295447+0000","last_became_active":"2024-09-15T21:55:56.268360+0000","last_became_peered":"2024-09-15T21:55:56.268360+0000","last_unstale":"2024-09-15T21:55:57.295447+0000","last_undegraded":"2024-09-15T21:55:57.295447+0000","last_fullsized":"2024-09-15T21:55:57.295447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:11.274512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-15T21:55:55.270910+0000","last_change":"2024-09-15T21:55:55.269693+0000","last_active":"2024-09-15T21:55:55.270910+0000","last_peered":"2024-09-15T21:55:55.270910+0000","last_clean":"2024-09-15T21:55:55.270910+0000","last_became_active":"2024-09-15T21:55:55.268821+0000","last_became_peered":"2024-09-15T21:55:55.268821+0000","last_unstale":"2024-09-15T21:55:55.270910+0000","last_undegraded":"2024-09-15T21:55:55.270910+0000","last_fullsized":"2024-09-15T21:55:55.270910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:34:47.778872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295729+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:57.295729+0000","last_peered":"2024-09-15T21:55:57.295729+0000","last_clean":"2024-09-15T21:55:57.295729+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:57.295729+0000","last_undegraded":"2024-09-15T21:55:57.295729+0000","last_fullsized":"2024-09-15T21:55:57.295729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":106483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":884736,"data_stored":696851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":925696,"data_stored":716283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35676,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336164,"statfs":{"total":96636764160,"available":96600231936,"internally_reserved":0,"allocated":331776,"data_stored":125895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:56:01.085 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-15T21:56:01.085 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.226282+0000', 'last_change': '2024-09-15T21:55:55.226282+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.226282+0000', 'last_undegraded': '2024-09-15T21:55:55.226282+0000', 'last_fullsized': '2024-09-15T21:55:55.226282+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T21:56:01.085 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-15T21:56:01.085 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.230490+0000', 'last_change': '2024-09-15T21:55:55.230490+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.230490+0000', 'last_undegraded': '2024-09-15T21:55:55.230490+0000', 'last_fullsized': '2024-09-15T21:55:55.230490+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:56:01.085 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-15T21:56:01.085 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.234702+0000', 'last_change': '2024-09-15T21:55:55.234702+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.234702+0000', 'last_undegraded': '2024-09-15T21:55:55.234702+0000', 'last_fullsized': '2024-09-15T21:55:55.234702+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:56:01.086 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-15T21:56:01.086 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.230208+0000', 'last_change': '2024-09-15T21:55:55.230208+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.230208+0000', 'last_undegraded': '2024-09-15T21:55:55.230208+0000', 'last_fullsized': '2024-09-15T21:55:55.230208+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:56:01.086 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-15T21:56:01.086 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.230652+0000', 'last_change': '2024-09-15T21:55:55.230652+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.230652+0000', 'last_undegraded': '2024-09-15T21:55:55.230652+0000', 'last_fullsized': '2024-09-15T21:55:55.230652+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:56:01.086 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-15T21:56:01.086 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.255317+0000', 'last_change': '2024-09-15T21:55:55.255317+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.255317+0000', 'last_undegraded': '2024-09-15T21:55:55.255317+0000', 'last_fullsized': '2024-09-15T21:55:55.255317+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T21:56:01.086 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-15T21:56:01.086 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.229145+0000', 'last_change': '2024-09-15T21:55:55.229145+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.229145+0000', 'last_undegraded': '2024-09-15T21:55:55.229145+0000', 'last_fullsized': '2024-09-15T21:55:55.229145+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:56:01.086 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-15T21:56:01.086 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.235561+0000', 'last_change': '2024-09-15T21:55:55.235561+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.235561+0000', 'last_undegraded': '2024-09-15T21:55:55.235561+0000', 'last_fullsized': '2024-09-15T21:55:55.235561+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:56:01.086 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-15T21:56:01.087 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.230066+0000', 'last_change': '2024-09-15T21:55:55.230066+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.230066+0000', 'last_undegraded': '2024-09-15T21:55:55.230066+0000', 'last_fullsized': '2024-09-15T21:55:55.230066+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:56:01.087 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-15T21:56:01.087 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.231822+0000', 'last_change': '2024-09-15T21:55:55.231822+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.231822+0000', 'last_undegraded': '2024-09-15T21:55:55.231822+0000', 'last_fullsized': '2024-09-15T21:55:55.231822+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:56:01.087 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-15T21:56:01.087 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.229862+0000', 'last_change': '2024-09-15T21:55:55.229862+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.229862+0000', 'last_undegraded': '2024-09-15T21:55:55.229862+0000', 'last_fullsized': '2024-09-15T21:55:55.229862+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:56:01.087 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-15T21:56:01.087 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.228248+0000', 'last_change': '2024-09-15T21:55:55.228248+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.228248+0000', 'last_undegraded': '2024-09-15T21:55:55.228248+0000', 'last_fullsized': '2024-09-15T21:55:55.228248+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:56:01.087 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-15T21:56:01.087 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.255281+0000', 'last_change': '2024-09-15T21:55:55.255281+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.255281+0000', 'last_undegraded': '2024-09-15T21:55:55.255281+0000', 'last_fullsized': '2024-09-15T21:55:55.255281+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T21:56:01.087 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-15T21:56:01.088 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.231596+0000', 'last_change': '2024-09-15T21:55:55.231596+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.231596+0000', 'last_undegraded': '2024-09-15T21:55:55.231596+0000', 'last_fullsized': '2024-09-15T21:55:55.231596+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T21:56:01.088 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-15T21:56:01.088 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.224324+0000', 'last_change': '2024-09-15T21:55:55.224324+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.224324+0000', 'last_undegraded': '2024-09-15T21:55:55.224324+0000', 'last_fullsized': '2024-09-15T21:55:55.224324+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:56:01.088 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-15T21:56:01.088 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.230946+0000', 'last_change': '2024-09-15T21:55:55.230946+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.230946+0000', 'last_undegraded': '2024-09-15T21:55:55.230946+0000', 'last_fullsized': '2024-09-15T21:55:55.230946+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:56:01.088 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-15T21:56:01.088 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.229576+0000', 'last_change': '2024-09-15T21:55:55.229576+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.229576+0000', 'last_undegraded': '2024-09-15T21:55:55.229576+0000', 'last_fullsized': '2024-09-15T21:55:55.229576+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:56:01.088 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-15T21:56:01.088 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.228310+0000', 'last_change': '2024-09-15T21:55:55.228310+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.228310+0000', 'last_undegraded': '2024-09-15T21:55:55.228310+0000', 'last_fullsized': '2024-09-15T21:55:55.228310+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:56:01.088 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-15T21:56:01.088 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.230086+0000', 'last_change': '2024-09-15T21:55:55.230086+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.230086+0000', 'last_undegraded': '2024-09-15T21:55:55.230086+0000', 'last_fullsized': '2024-09-15T21:55:55.230086+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:56:01.088 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-15T21:56:01.089 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.234426+0000', 'last_change': '2024-09-15T21:55:55.234426+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.234426+0000', 'last_undegraded': '2024-09-15T21:55:55.234426+0000', 'last_fullsized': '2024-09-15T21:55:55.234426+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:56:01.089 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-15T21:56:01.089 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.233282+0000', 'last_change': '2024-09-15T21:55:55.233282+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.233282+0000', 'last_undegraded': '2024-09-15T21:55:55.233282+0000', 'last_fullsized': '2024-09-15T21:55:55.233282+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T21:56:01.089 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-15T21:56:01.089 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.227090+0000', 'last_change': '2024-09-15T21:55:55.227090+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.227090+0000', 'last_undegraded': '2024-09-15T21:55:55.227090+0000', 'last_fullsized': '2024-09-15T21:55:55.227090+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T21:56:01.089 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-15T21:56:01.089 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.224764+0000', 'last_change': '2024-09-15T21:55:55.224764+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.224764+0000', 'last_undegraded': '2024-09-15T21:55:55.224764+0000', 'last_fullsized': '2024-09-15T21:55:55.224764+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:56:01.089 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-15T21:56:01.089 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.225091+0000', 'last_change': '2024-09-15T21:55:55.225091+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.225091+0000', 'last_undegraded': '2024-09-15T21:55:55.225091+0000', 'last_fullsized': '2024-09-15T21:55:55.225091+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T21:56:01.089 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-15T21:56:01.090 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.229016+0000', 'last_change': '2024-09-15T21:55:55.229016+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.229016+0000', 'last_undegraded': '2024-09-15T21:55:55.229016+0000', 'last_fullsized': '2024-09-15T21:55:55.229016+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T21:56:01.090 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-15T21:56:01.090 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.227070+0000', 'last_change': '2024-09-15T21:55:55.227070+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.227070+0000', 'last_undegraded': '2024-09-15T21:55:55.227070+0000', 'last_fullsized': '2024-09-15T21:55:55.227070+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:56:01.090 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-15T21:56:01.090 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.232427+0000', 'last_change': '2024-09-15T21:55:55.232427+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.232427+0000', 'last_undegraded': '2024-09-15T21:55:55.232427+0000', 'last_fullsized': '2024-09-15T21:55:55.232427+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:56:01.090 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-15T21:56:01.090 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.230410+0000', 'last_change': '2024-09-15T21:55:55.230410+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.230410+0000', 'last_undegraded': '2024-09-15T21:55:55.230410+0000', 'last_fullsized': '2024-09-15T21:55:55.230410+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T21:56:01.090 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-15T21:56:01.090 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.227139+0000', 'last_change': '2024-09-15T21:55:55.227139+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.227139+0000', 'last_undegraded': '2024-09-15T21:55:55.227139+0000', 'last_fullsized': '2024-09-15T21:55:55.227139+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:56:01.090 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-15T21:56:01.090 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.230359+0000', 'last_change': '2024-09-15T21:55:55.230359+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.230359+0000', 'last_undegraded': '2024-09-15T21:55:55.230359+0000', 'last_fullsized': '2024-09-15T21:55:55.230359+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:56:01.091 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-15T21:56:01.091 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.226032+0000', 'last_change': '2024-09-15T21:55:55.226032+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.226032+0000', 'last_undegraded': '2024-09-15T21:55:55.226032+0000', 'last_fullsized': '2024-09-15T21:55:55.226032+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:56:01.091 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-15T21:56:01.091 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.228532+0000', 'last_change': '2024-09-15T21:55:55.228532+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.228532+0000', 'last_undegraded': '2024-09-15T21:55:55.228532+0000', 'last_fullsized': '2024-09-15T21:55:55.228532+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:56:01.091 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-15T21:56:01.091 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.236200+0000', 'last_change': '2024-09-15T21:55:55.236200+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.236200+0000', 'last_undegraded': '2024-09-15T21:55:55.236200+0000', 'last_fullsized': '2024-09-15T21:55:55.236200+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:56:01.091 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-15T21:56:01.091 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.228171+0000', 'last_change': '2024-09-15T21:55:55.228171+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.228171+0000', 'last_undegraded': '2024-09-15T21:55:55.228171+0000', 'last_fullsized': '2024-09-15T21:55:55.228171+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:56:01.091 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-15T21:56:01.091 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.225274+0000', 'last_change': '2024-09-15T21:55:55.225274+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.225274+0000', 'last_undegraded': '2024-09-15T21:55:55.225274+0000', 'last_fullsized': '2024-09-15T21:55:55.225274+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:56:01.092 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-15T21:56:01.092 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.225955+0000', 'last_change': '2024-09-15T21:55:55.225955+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.225955+0000', 'last_undegraded': '2024-09-15T21:55:55.225955+0000', 'last_fullsized': '2024-09-15T21:55:55.225955+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T21:56:01.092 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-15T21:56:01.092 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.229839+0000', 'last_change': '2024-09-15T21:55:55.229839+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.229839+0000', 'last_undegraded': '2024-09-15T21:55:55.229839+0000', 'last_fullsized': '2024-09-15T21:55:55.229839+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T21:56:01.092 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-15T21:56:01.092 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.234876+0000', 'last_change': '2024-09-15T21:55:55.234876+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.234876+0000', 'last_undegraded': '2024-09-15T21:55:55.234876+0000', 'last_fullsized': '2024-09-15T21:55:55.234876+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:56:01.092 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-15T21:56:01.092 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.229614+0000', 'last_change': '2024-09-15T21:55:55.229614+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.229614+0000', 'last_undegraded': '2024-09-15T21:55:55.229614+0000', 'last_fullsized': '2024-09-15T21:55:55.229614+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T21:56:01.092 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-15T21:56:01.092 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.230372+0000', 'last_change': '2024-09-15T21:55:55.230372+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.230372+0000', 'last_undegraded': '2024-09-15T21:55:55.230372+0000', 'last_fullsized': '2024-09-15T21:55:55.230372+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T21:56:01.092 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-15T21:56:01.092 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.224236+0000', 'last_change': '2024-09-15T21:55:55.224236+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.224236+0000', 'last_undegraded': '2024-09-15T21:55:55.224236+0000', 'last_fullsized': '2024-09-15T21:55:55.224236+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:56:01.093 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-15T21:56:01.093 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.224549+0000', 'last_change': '2024-09-15T21:55:55.224549+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.224549+0000', 'last_undegraded': '2024-09-15T21:55:55.224549+0000', 'last_fullsized': '2024-09-15T21:55:55.224549+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T21:56:01.093 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-15T21:56:01.093 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.228377+0000', 'last_change': '2024-09-15T21:55:55.228377+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.228377+0000', 'last_undegraded': '2024-09-15T21:55:55.228377+0000', 'last_fullsized': '2024-09-15T21:55:55.228377+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T21:56:01.093 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-15T21:56:01.093 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.226648+0000', 'last_change': '2024-09-15T21:55:55.226648+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.226648+0000', 'last_undegraded': '2024-09-15T21:55:55.226648+0000', 'last_fullsized': '2024-09-15T21:55:55.226648+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T21:56:01.093 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-15T21:56:01.093 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-09-15T21:55:55.227678+0000', 'last_change': '2024-09-15T21:55:55.227678+0000', 'last_active': '2024-09-15T21:55:55.212487+0000', 'last_peered': '2024-09-15T21:55:55.212487+0000', 'last_clean': '2024-09-15T21:55:55.212487+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T21:55:55.227678+0000', 'last_undegraded': '2024-09-15T21:55:55.227678+0000', 'last_fullsized': '2024-09-15T21:55:55.227678+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'last_clean_scrub_stamp': '2024-09-15T21:55:55.212487+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T21:56:01.094 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T21:56:01.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.237+0000 7f00b4544640 1 Processor -- start 2024-09-15T21:56:01.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.237+0000 7f00b4544640 1 -- start start 2024-09-15T21:56:01.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.237+0000 7f00b4544640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00ac0b5220 0x7f00ac09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:01.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.237+0000 7f00b4544640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f00ac0b5600 0x7f00ac09ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:01.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.237+0000 7f00b4544640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00ac0b6a50 con 0x7f00ac148f20 2024-09-15T21:56:01.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.237+0000 7f00b4544640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f00ac09b800 con 0x7f00ac0b5600 2024-09-15T21:56:01.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.237+0000 7f00b4544640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f00ac0b4dd0 con 0x7f00ac0b5220 2024-09-15T21:56:01.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.237+0000 7f00b22e0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00ac0b5220 0x7f00ac09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:01.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.237+0000 7f00b1adf640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f00ac0b5600 0x7f00ac09ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:01.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b2ae1640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f00ac148f20 0x7f00ac0b3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.1:48610/0 (socket says 172.21.15.1:48610) 2024-09-15T21:56:01.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b2ae1640 1 -- 172.21.15.1:0/722492815 learned_addr learned my addr 172.21.15.1:0/722492815 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:01.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b22e0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00ac0b5220 0x7f00ac09aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.1:51024/0 (socket says 172.21.15.1:51024) 2024-09-15T21:56:01.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b12de640 1 -- 172.21.15.1:0/722492815 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2370563683 0 0) 0x7f00ac0b6a50 con 0x7f00ac148f20 2024-09-15T21:56:01.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b12de640 1 -- 172.21.15.1:0/722492815 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0094003530 con 0x7f00ac148f20 2024-09-15T21:56:01.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b22e0640 1 -- 172.21.15.1:0/722492815 >> v2:172.21.15.70:3300/0 conn(0x7f00ac0b5600 msgr2=0x7f00ac09ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:01.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b22e0640 1 --2- 172.21.15.1:0/722492815 >> v2:172.21.15.70:3300/0 conn(0x7f00ac0b5600 0x7f00ac09ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b22e0640 1 -- 172.21.15.1:0/722492815 >> v1:172.21.15.70:6789/0 conn(0x7f00ac148f20 legacy=0x7f00ac0b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b22e0640 1 -- 172.21.15.1:0/722492815 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ac09af90 con 0x7f00ac0b5220 2024-09-15T21:56:01.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b1adf640 1 --2- 172.21.15.1:0/722492815 >> v2:172.21.15.70:3300/0 conn(0x7f00ac0b5600 0x7f00ac09ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:56:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b22e0640 1 --2- 172.21.15.1:0/722492815 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00ac0b5220 0x7f00ac09aa50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f00a40097c0 tx=0x7f00a401c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e30b2b105848a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:01.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b12de640 1 -- 172.21.15.1:0/722492815 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a40b0070 con 0x7f00ac0b5220 2024-09-15T21:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b12de640 1 -- 172.21.15.1:0/722492815 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a4004230 con 0x7f00ac0b5220 2024-09-15T21:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b12de640 1 -- 172.21.15.1:0/722492815 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4003620 con 0x7f00ac0b5220 2024-09-15T21:56:01.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b4544640 1 -- 172.21.15.1:0/722492815 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00ac0b5220 msgr2=0x7f00ac09aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b4544640 1 --2- 172.21.15.1:0/722492815 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00ac0b5220 0x7f00ac09aa50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f00a40097c0 tx=0x7f00a401c350 comp rx=0 tx=0).stop 2024-09-15T21:56:01.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b4544640 1 -- 172.21.15.1:0/722492815 shutdown_connections 2024-09-15T21:56:01.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b4544640 1 --2- 172.21.15.1:0/722492815 >> v2:172.21.15.70:3300/0 conn(0x7f00ac0b5600 0x7f00ac09ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b4544640 1 --2- 172.21.15.1:0/722492815 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00ac0b5220 0x7f00ac09aa50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b4544640 1 -- 172.21.15.1:0/722492815 >> 172.21.15.1:0/722492815 conn(0x7f00ac0b5c40 msgr2=0x7f00ac0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:01.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.241+0000 7f00b4544640 1 -- 172.21.15.1:0/722492815 shutdown_connections 2024-09-15T21:56:01.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b4544640 1 -- 172.21.15.1:0/722492815 wait complete. 2024-09-15T21:56:01.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b4544640 1 Processor -- start 2024-09-15T21:56:01.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b4544640 1 -- start start 2024-09-15T21:56:01.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b4544640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00ac0b5220 0x7f00ac13e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:01.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b4544640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ac0b5600 0x7f00ac1dfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b4544640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00ac148f20 0x7f00ac0ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b4544640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac09f4d0 con 0x7f00ac148f20 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b4544640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac09f350 con 0x7f00ac0b5600 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b4544640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f00ac152f00 con 0x7f00ac0b5220 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b2ae1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00ac148f20 0x7f00ac0ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b2ae1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00ac148f20 0x7f00ac0ae160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51492/0 (socket says 172.21.15.1:51492) 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b2ae1640 1 -- 172.21.15.1:0/3089804521 learned_addr learned my addr 172.21.15.1:0/3089804521 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b22e0640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00ac0b5220 0x7f00ac13e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b1adf640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ac0b5600 0x7f00ac1dfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b2ae1640 1 -- 172.21.15.1:0/3089804521 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00ac0b5220 msgr2=0x7f00ac13e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b2ae1640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00ac0b5220 0x7f00ac13e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b2ae1640 1 -- 172.21.15.1:0/3089804521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ac0b5600 msgr2=0x7f00ac1dfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b2ae1640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ac0b5600 0x7f00ac1dfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b2ae1640 1 -- 172.21.15.1:0/3089804521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ac150120 con 0x7f00ac148f20 2024-09-15T21:56:01.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b22e0640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00ac0b5220 0x7f00ac13e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:56:01.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b1adf640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ac0b5600 0x7f00ac1dfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:56:01.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b2ae1640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00ac148f20 0x7f00ac0ae160 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f009c00c450 tx=0x7f009c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:01.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00aaffd640 1 -- 172.21.15.1:0/3089804521 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c017070 con 0x7f00ac148f20 2024-09-15T21:56:01.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00aaffd640 1 -- 172.21.15.1:0/3089804521 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009c005cf0 con 0x7f00ac148f20 2024-09-15T21:56:01.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b4544640 1 -- 172.21.15.1:0/3089804521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ac1e3380 con 0x7f00ac148f20 2024-09-15T21:56:01.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00aaffd640 1 -- 172.21.15.1:0/3089804521 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c0072b0 con 0x7f00ac148f20 2024-09-15T21:56:01.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b4544640 1 -- 172.21.15.1:0/3089804521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ac1e3940 con 0x7f00ac148f20 2024-09-15T21:56:01.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.245+0000 7f00b4544640 1 -- 172.21.15.1:0/3089804521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00ac09aa50 con 0x7f00ac148f20 2024-09-15T21:56:01.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.249+0000 7f00aaffd640 1 -- 172.21.15.1:0/3089804521 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f009c01a070 con 0x7f00ac148f20 2024-09-15T21:56:01.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.249+0000 7f00aaffd640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f00980678c0 0x7f0098069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:01.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.249+0000 7f00aaffd640 1 -- 172.21.15.1:0/3089804521 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f009c0852f0 con 0x7f00ac148f20 2024-09-15T21:56:01.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.249+0000 7f00b22e0640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f00980678c0 0x7f0098069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:01.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.249+0000 7f00b22e0640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f00980678c0 0x7f0098069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f00a40ad000 tx=0x7f00a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:01.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.253+0000 7f00aaffd640 1 -- 172.21.15.1:0/3089804521 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f009c021080 con 0x7f00ac148f20 2024-09-15T21:56:01.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.473+0000 7f00b4544640 1 -- 172.21.15.1:0/3089804521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f00ac0b8dd0 con 0x7f00ac148f20 2024-09-15T21:56:01.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.473+0000 7f00aaffd640 1 -- 172.21.15.1:0/3089804521 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1054 (secure 0 0 0) 0x7f009c055ea0 con 0x7f00ac148f20 2024-09-15T21:56:01.478 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:01.478 INFO:teuthology.orchestra.run.smithi001.stdout:{"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":65,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":30,"num_osds":8,"num_up_osds":8,"osd_up_since":1726437309,"num_in_osds":8,"osd_in_since":1726437299,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":267923456,"bytes_avail":772826189824,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"btime":"2024-09-15T21:55:59:270348+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4731}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-15T21:54:56.304483+0000","services":{}},"progress_events":{}} 2024-09-15T21:56:01.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.477+0000 7f00b4544640 1 -- 172.21.15.1:0/3089804521 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f00980678c0 msgr2=0x7f0098069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.477+0000 7f00b4544640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f00980678c0 0x7f0098069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f00a40ad000 tx=0x7f00a4008040 comp rx=0 tx=0).stop 2024-09-15T21:56:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.477+0000 7f00b4544640 1 -- 172.21.15.1:0/3089804521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00ac148f20 msgr2=0x7f00ac0ae160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.477+0000 7f00b4544640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00ac148f20 0x7f00ac0ae160 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f009c00c450 tx=0x7f009c00c910 comp rx=0 tx=0).stop 2024-09-15T21:56:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.477+0000 7f00b4544640 1 -- 172.21.15.1:0/3089804521 shutdown_connections 2024-09-15T21:56:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.477+0000 7f00b4544640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00ac148f20 0x7f00ac0ae160 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.477+0000 7f00b4544640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f00980678c0 0x7f0098069d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.477+0000 7f00b4544640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00ac0b5600 0x7f00ac1dfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.477+0000 7f00b4544640 1 --2- 172.21.15.1:0/3089804521 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f00ac0b5220 0x7f00ac13e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.477+0000 7f00b4544640 1 -- 172.21.15.1:0/3089804521 >> 172.21.15.1:0/3089804521 conn(0x7f00ac0b5c40 msgr2=0x7f00ac146e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.477+0000 7f00b4544640 1 -- 172.21.15.1:0/3089804521 shutdown_connections 2024-09-15T21:56:01.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.477+0000 7f00b4544640 1 -- 172.21.15.1:0/3089804521 wait complete. 2024-09-15T21:56:01.495 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T21:56:01.496 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:56:01.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.605+0000 7f1aac435640 1 Processor -- start 2024-09-15T21:56:01.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aac435640 1 -- start start 2024-09-15T21:56:01.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aac435640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1aa40af900 0x7f1aa4071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:01.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aac435640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1aa40b4c50 0x7f1aa40b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:01.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aac435640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa40b5a80 con 0x7f1aa40b55d0 2024-09-15T21:56:01.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aac435640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa40b0ea0 con 0x7f1aa40af900 2024-09-15T21:56:01.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aac435640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa40afce0 con 0x7f1aa40b4c50 2024-09-15T21:56:01.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aaa1d1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1aa40af900 0x7f1aa4071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:01.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aaa1d1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1aa40af900 0x7f1aa4071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51494/0 (socket says 172.21.15.1:51494) 2024-09-15T21:56:01.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aaa1d1640 1 -- 172.21.15.1:0/3461756532 learned_addr learned my addr 172.21.15.1:0/3461756532 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:01.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aaa9d2640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f1aa40b55d0 0x7f1aa414e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41396/0 (socket says 172.21.15.1:41396) 2024-09-15T21:56:01.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aa99d0640 1 --2- 172.21.15.1:0/3461756532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1aa40b4c50 0x7f1aa40b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:01.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aaa1d1640 1 -- 172.21.15.1:0/3461756532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1aa40b4c50 msgr2=0x7f1aa40b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:01.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aaa1d1640 1 --2- 172.21.15.1:0/3461756532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1aa40b4c50 0x7f1aa40b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aaa1d1640 1 -- 172.21.15.1:0/3461756532 >> v1:172.21.15.1:6789/0 conn(0x7f1aa40b55d0 legacy=0x7f1aa414e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aaa1d1640 1 -- 172.21.15.1:0/3461756532 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa40b0bc0 con 0x7f1aa40af900 2024-09-15T21:56:01.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aaa1d1640 1 --2- 172.21.15.1:0/3461756532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1aa40af900 0x7f1aa4071460 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009870 tx=0x7f1aa001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234421f38f12125c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:01.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aa91cf640 1 -- 172.21.15.1:0/3461756532 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00ab430 con 0x7f1aa40af900 2024-09-15T21:56:01.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.609+0000 7f1aa91cf640 1 -- 172.21.15.1:0/3461756532 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa00b0070 con 0x7f1aa40af900 2024-09-15T21:56:01.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aa91cf640 1 -- 172.21.15.1:0/3461756532 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00ab7f0 con 0x7f1aa40af900 2024-09-15T21:56:01.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 -- 172.21.15.1:0/3461756532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1aa40af900 msgr2=0x7f1aa4071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 --2- 172.21.15.1:0/3461756532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1aa40af900 0x7f1aa4071460 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009870 tx=0x7f1aa001c530 comp rx=0 tx=0).stop 2024-09-15T21:56:01.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 -- 172.21.15.1:0/3461756532 shutdown_connections 2024-09-15T21:56:01.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 --2- 172.21.15.1:0/3461756532 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1aa40b4c50 0x7f1aa40b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 --2- 172.21.15.1:0/3461756532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1aa40af900 0x7f1aa4071460 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 -- 172.21.15.1:0/3461756532 >> 172.21.15.1:0/3461756532 conn(0x7f1aa40ba250 msgr2=0x7f1aa40ba660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:01.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 -- 172.21.15.1:0/3461756532 shutdown_connections 2024-09-15T21:56:01.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 -- 172.21.15.1:0/3461756532 wait complete. 2024-09-15T21:56:01.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 Processor -- start 2024-09-15T21:56:01.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 -- start start 2024-09-15T21:56:01.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa40af900 0x7f1aa409bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:01.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1aa40b4c50 0x7f1aa40b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:01.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1aa40b55d0 0x7f1aa409d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:01.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa40b6120 con 0x7f1aa40b4c50 2024-09-15T21:56:01.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa406e5a0 con 0x7f1aa40af900 2024-09-15T21:56:01.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa40719a0 con 0x7f1aa40b55d0 2024-09-15T21:56:01.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aa99d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1aa40b4c50 0x7f1aa40b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aa99d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1aa40b4c50 0x7f1aa40b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51502/0 (socket says 172.21.15.1:51502) 2024-09-15T21:56:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aa99d0640 1 -- 172.21.15.1:0/3651150773 learned_addr learned my addr 172.21.15.1:0/3651150773 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aaa9d2640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1aa40b55d0 0x7f1aa409d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aa99d0640 1 -- 172.21.15.1:0/3651150773 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1aa40b55d0 msgr2=0x7f1aa409d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aa99d0640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1aa40b55d0 0x7f1aa409d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aaa1d1640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa40af900 0x7f1aa409bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aa99d0640 1 -- 172.21.15.1:0/3651150773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa40af900 msgr2=0x7f1aa409bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aa99d0640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa40af900 0x7f1aa409bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aa99d0640 1 -- 172.21.15.1:0/3651150773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa414a520 con 0x7f1aa40b4c50 2024-09-15T21:56:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aaa9d2640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1aa40b55d0 0x7f1aa409d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aa99d0640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1aa40b4c50 0x7f1aa40b2490 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400d7d0 tx=0x7f1a9400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1a9affd640 1 -- 172.21.15.1:0/3651150773 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a94004020 con 0x7f1aa40b4c50 2024-09-15T21:56:01.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1a9affd640 1 -- 172.21.15.1:0/3651150773 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a940041c0 con 0x7f1aa40b4c50 2024-09-15T21:56:01.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 -- 172.21.15.1:0/3651150773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa40b29d0 con 0x7f1aa40b4c50 2024-09-15T21:56:01.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1a9affd640 1 -- 172.21.15.1:0/3651150773 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940043b0 con 0x7f1aa40b4c50 2024-09-15T21:56:01.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.613+0000 7f1aac435640 1 -- 172.21.15.1:0/3651150773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa40b1bf0 con 0x7f1aa40b4c50 2024-09-15T21:56:01.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.617+0000 7f1aac435640 1 -- 172.21.15.1:0/3651150773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa40b1330 con 0x7f1aa40b4c50 2024-09-15T21:56:01.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.617+0000 7f1a9affd640 1 -- 172.21.15.1:0/3651150773 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1a9401b020 con 0x7f1aa40b4c50 2024-09-15T21:56:01.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.617+0000 7f1a9affd640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1a880678c0 0x7f1a88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:01.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.617+0000 7f1a9affd640 1 -- 172.21.15.1:0/3651150773 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f1a94085a50 con 0x7f1aa40b4c50 2024-09-15T21:56:01.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.617+0000 7f1aaa1d1640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1a880678c0 0x7f1a88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:01.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.617+0000 7f1aaa1d1640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1a880678c0 0x7f1a88069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00af000 tx=0x7f1aa00a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:01.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.621+0000 7f1a9affd640 1 -- 172.21.15.1:0/3651150773 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1a94056620 con 0x7f1aa40b4c50 2024-09-15T21:56:01.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.776+0000 7f1aac435640 1 -- 172.21.15.1:0/3651150773 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1aa40b99d0 con 0x7f1a880678c0 2024-09-15T21:56:01.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.792+0000 7f1a9affd640 1 -- 172.21.15.1:0/3651150773 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7f1aa40b99d0 con 0x7f1a880678c0 2024-09-15T21:56:01.802 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:01.803 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:56:01.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.796+0000 7f1aac435640 1 -- 172.21.15.1:0/3651150773 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1a880678c0 msgr2=0x7f1a88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.796+0000 7f1aac435640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1a880678c0 0x7f1a88069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00af000 tx=0x7f1aa00a7000 comp rx=0 tx=0).stop 2024-09-15T21:56:01.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.796+0000 7f1aac435640 1 -- 172.21.15.1:0/3651150773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1aa40b4c50 msgr2=0x7f1aa40b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:01.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.796+0000 7f1aac435640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1aa40b4c50 0x7f1aa40b2490 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400d7d0 tx=0x7f1a9400dc90 comp rx=0 tx=0).stop 2024-09-15T21:56:01.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.796+0000 7f1aac435640 1 -- 172.21.15.1:0/3651150773 shutdown_connections 2024-09-15T21:56:01.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.796+0000 7f1aac435640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1aa40b55d0 0x7f1aa409d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.796+0000 7f1aac435640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1aa40b4c50 0x7f1aa40b2490 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.796+0000 7f1aac435640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1a880678c0 0x7f1a88069d80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.796+0000 7f1aac435640 1 --2- 172.21.15.1:0/3651150773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa40af900 0x7f1aa409bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:01.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.796+0000 7f1aac435640 1 -- 172.21.15.1:0/3651150773 >> 172.21.15.1:0/3651150773 conn(0x7f1aa40ba250 msgr2=0x7f1aa414b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:01.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.800+0000 7f1aac435640 1 -- 172.21.15.1:0/3651150773 shutdown_connections 2024-09-15T21:56:01.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:01.800+0000 7f1aac435640 1 -- 172.21.15.1:0/3651150773 wait complete. 2024-09-15T21:56:01.819 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-15T21:56:01.089653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261644,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754713076,"statfs":{"total":773094113280,"available":772826189824,"internally_reserved":0,"allocated":3874816,"data_stored":2192156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001511"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275375+0000","last_change":"2024-09-15T21:55:56.309097+0000","last_active":"2024-09-15T21:55:57.275375+0000","last_peered":"2024-09-15T21:55:57.275375+0000","last_clean":"2024-09-15T21:55:57.275375+0000","last_became_active":"2024-09-15T21:55:56.308483+0000","last_became_peered":"2024-09-15T21:55:56.308483+0000","last_unstale":"2024-09-15T21:55:57.275375+0000","last_undegraded":"2024-09-15T21:55:57.275375+0000","last_fullsized":"2024-09-15T21:55:57.275375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:49.573129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292131+0000","last_change":"2024-09-15T21:55:56.278159+0000","last_active":"2024-09-15T21:55:57.292131+0000","last_peered":"2024-09-15T21:55:57.292131+0000","last_clean":"2024-09-15T21:55:57.292131+0000","last_became_active":"2024-09-15T21:55:56.277403+0000","last_became_peered":"2024-09-15T21:55:56.277403+0000","last_unstale":"2024-09-15T21:55:57.292131+0000","last_undegraded":"2024-09-15T21:55:57.292131+0000","last_fullsized":"2024-09-15T21:55:57.292131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:02.021065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296131+0000","last_change":"2024-09-15T21:55:56.298221+0000","last_active":"2024-09-15T21:55:57.296131+0000","last_peered":"2024-09-15T21:55:57.296131+0000","last_clean":"2024-09-15T21:55:57.296131+0000","last_became_active":"2024-09-15T21:55:56.297538+0000","last_became_peered":"2024-09-15T21:55:56.297538+0000","last_unstale":"2024-09-15T21:55:57.296131+0000","last_undegraded":"2024-09-15T21:55:57.296131+0000","last_fullsized":"2024-09-15T21:55:57.296131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:19.254994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275744+0000","last_change":"2024-09-15T21:55:56.290630+0000","last_active":"2024-09-15T21:55:57.275744+0000","last_peered":"2024-09-15T21:55:57.275744+0000","last_clean":"2024-09-15T21:55:57.275744+0000","last_became_active":"2024-09-15T21:55:56.288578+0000","last_became_peered":"2024-09-15T21:55:56.288578+0000","last_unstale":"2024-09-15T21:55:57.275744+0000","last_undegraded":"2024-09-15T21:55:57.275744+0000","last_fullsized":"2024-09-15T21:55:57.275744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:10.140144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293463+0000","last_change":"2024-09-15T21:55:56.285178+0000","last_active":"2024-09-15T21:55:57.293463+0000","last_peered":"2024-09-15T21:55:57.293463+0000","last_clean":"2024-09-15T21:55:57.293463+0000","last_became_active":"2024-09-15T21:55:56.284915+0000","last_became_peered":"2024-09-15T21:55:56.284915+0000","last_unstale":"2024-09-15T21:55:57.293463+0000","last_undegraded":"2024-09-15T21:55:57.293463+0000","last_fullsized":"2024-09-15T21:55:57.293463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:53.134305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292340+0000","last_change":"2024-09-15T21:55:56.306995+0000","last_active":"2024-09-15T21:55:57.292340+0000","last_peered":"2024-09-15T21:55:57.292340+0000","last_clean":"2024-09-15T21:55:57.292340+0000","last_became_active":"2024-09-15T21:55:56.306687+0000","last_became_peered":"2024-09-15T21:55:56.306687+0000","last_unstale":"2024-09-15T21:55:57.292340+0000","last_undegraded":"2024-09-15T21:55:57.292340+0000","last_fullsized":"2024-09-15T21:55:57.292340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:55.596017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294848+0000","last_change":"2024-09-15T21:55:56.289977+0000","last_active":"2024-09-15T21:55:57.294848+0000","last_peered":"2024-09-15T21:55:57.294848+0000","last_clean":"2024-09-15T21:55:57.294848+0000","last_became_active":"2024-09-15T21:55:56.288235+0000","last_became_peered":"2024-09-15T21:55:56.288235+0000","last_unstale":"2024-09-15T21:55:57.294848+0000","last_undegraded":"2024-09-15T21:55:57.294848+0000","last_fullsized":"2024-09-15T21:55:57.294848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:28.668639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294435+0000","last_change":"2024-09-15T21:55:56.274499+0000","last_active":"2024-09-15T21:55:57.294435+0000","last_peered":"2024-09-15T21:55:57.294435+0000","last_clean":"2024-09-15T21:55:57.294435+0000","last_became_active":"2024-09-15T21:55:56.273194+0000","last_became_peered":"2024-09-15T21:55:56.273194+0000","last_unstale":"2024-09-15T21:55:57.294435+0000","last_undegraded":"2024-09-15T21:55:57.294435+0000","last_fullsized":"2024-09-15T21:55:57.294435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276230+0000","last_change":"2024-09-15T21:55:56.295357+0000","last_active":"2024-09-15T21:55:57.276230+0000","last_peered":"2024-09-15T21:55:57.276230+0000","last_clean":"2024-09-15T21:55:57.276230+0000","last_became_active":"2024-09-15T21:55:56.294500+0000","last_became_peered":"2024-09-15T21:55:56.294500+0000","last_unstale":"2024-09-15T21:55:57.276230+0000","last_undegraded":"2024-09-15T21:55:57.276230+0000","last_fullsized":"2024-09-15T21:55:57.276230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:10.621648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276112+0000","last_change":"2024-09-15T21:55:56.288047+0000","last_active":"2024-09-15T21:55:57.276112+0000","last_peered":"2024-09-15T21:55:57.276112+0000","last_clean":"2024-09-15T21:55:57.276112+0000","last_became_active":"2024-09-15T21:55:56.287678+0000","last_became_peered":"2024-09-15T21:55:56.287678+0000","last_unstale":"2024-09-15T21:55:57.276112+0000","last_undegraded":"2024-09-15T21:55:57.276112+0000","last_fullsized":"2024-09-15T21:55:57.276112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:03.320745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295306+0000","last_change":"2024-09-15T21:55:56.275939+0000","last_active":"2024-09-15T21:55:57.295306+0000","last_peered":"2024-09-15T21:55:57.295306+0000","last_clean":"2024-09-15T21:55:57.295306+0000","last_became_active":"2024-09-15T21:55:56.275185+0000","last_became_peered":"2024-09-15T21:55:56.275185+0000","last_unstale":"2024-09-15T21:55:57.295306+0000","last_undegraded":"2024-09-15T21:55:57.295306+0000","last_fullsized":"2024-09-15T21:55:57.295306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:04.577354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296198+0000","last_change":"2024-09-15T21:55:56.307216+0000","last_active":"2024-09-15T21:55:57.296198+0000","last_peered":"2024-09-15T21:55:57.296198+0000","last_clean":"2024-09-15T21:55:57.296198+0000","last_became_active":"2024-09-15T21:55:56.306508+0000","last_became_peered":"2024-09-15T21:55:56.306508+0000","last_unstale":"2024-09-15T21:55:57.296198+0000","last_undegraded":"2024-09-15T21:55:57.296198+0000","last_fullsized":"2024-09-15T21:55:57.296198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:52.572647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293562+0000","last_change":"2024-09-15T21:55:56.278716+0000","last_active":"2024-09-15T21:55:57.293562+0000","last_peered":"2024-09-15T21:55:57.293562+0000","last_clean":"2024-09-15T21:55:57.293562+0000","last_became_active":"2024-09-15T21:55:56.277722+0000","last_became_peered":"2024-09-15T21:55:56.277722+0000","last_unstale":"2024-09-15T21:55:57.293562+0000","last_undegraded":"2024-09-15T21:55:57.293562+0000","last_fullsized":"2024-09-15T21:55:57.293562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:18.528351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292525+0000","last_change":"2024-09-15T21:55:56.285279+0000","last_active":"2024-09-15T21:55:57.292525+0000","last_peered":"2024-09-15T21:55:57.292525+0000","last_clean":"2024-09-15T21:55:57.292525+0000","last_became_active":"2024-09-15T21:55:56.284896+0000","last_became_peered":"2024-09-15T21:55:56.284896+0000","last_unstale":"2024-09-15T21:55:57.292525+0000","last_undegraded":"2024-09-15T21:55:57.292525+0000","last_fullsized":"2024-09-15T21:55:57.292525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:58.953469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293739+0000","last_change":"2024-09-15T21:55:56.290484+0000","last_active":"2024-09-15T21:55:57.293739+0000","last_peered":"2024-09-15T21:55:57.293739+0000","last_clean":"2024-09-15T21:55:57.293739+0000","last_became_active":"2024-09-15T21:55:56.289602+0000","last_became_peered":"2024-09-15T21:55:56.289602+0000","last_unstale":"2024-09-15T21:55:57.293739+0000","last_undegraded":"2024-09-15T21:55:57.293739+0000","last_fullsized":"2024-09-15T21:55:57.293739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:55.481298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295625+0000","last_change":"2024-09-15T21:55:56.300687+0000","last_active":"2024-09-15T21:55:57.295625+0000","last_peered":"2024-09-15T21:55:57.295625+0000","last_clean":"2024-09-15T21:55:57.295625+0000","last_became_active":"2024-09-15T21:55:56.300004+0000","last_became_peered":"2024-09-15T21:55:56.300004+0000","last_unstale":"2024-09-15T21:55:57.295625+0000","last_undegraded":"2024-09-15T21:55:57.295625+0000","last_fullsized":"2024-09-15T21:55:57.295625+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:47.385096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295452+0000","last_change":"2024-09-15T21:55:56.277883+0000","last_active":"2024-09-15T21:55:57.295452+0000","last_peered":"2024-09-15T21:55:57.295452+0000","last_clean":"2024-09-15T21:55:57.295452+0000","last_became_active":"2024-09-15T21:55:56.277149+0000","last_became_peered":"2024-09-15T21:55:56.277149+0000","last_unstale":"2024-09-15T21:55:57.295452+0000","last_undegraded":"2024-09-15T21:55:57.295452+0000","last_fullsized":"2024-09-15T21:55:57.295452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:54.377784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292285+0000","last_change":"2024-09-15T21:55:56.290146+0000","last_active":"2024-09-15T21:55:57.292285+0000","last_peered":"2024-09-15T21:55:57.292285+0000","last_clean":"2024-09-15T21:55:57.292285+0000","last_became_active":"2024-09-15T21:55:56.289368+0000","last_became_peered":"2024-09-15T21:55:56.289368+0000","last_unstale":"2024-09-15T21:55:57.292285+0000","last_undegraded":"2024-09-15T21:55:57.292285+0000","last_fullsized":"2024-09-15T21:55:57.292285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:15.829500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292561+0000","last_change":"2024-09-15T21:55:56.296195+0000","last_active":"2024-09-15T21:55:57.292561+0000","last_peered":"2024-09-15T21:55:57.292561+0000","last_clean":"2024-09-15T21:55:57.292561+0000","last_became_active":"2024-09-15T21:55:56.295658+0000","last_became_peered":"2024-09-15T21:55:56.295658+0000","last_unstale":"2024-09-15T21:55:57.292561+0000","last_undegraded":"2024-09-15T21:55:57.292561+0000","last_fullsized":"2024-09-15T21:55:57.292561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:54.349480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293340+0000","last_change":"2024-09-15T21:55:56.308957+0000","last_active":"2024-09-15T21:55:57.293340+0000","last_peered":"2024-09-15T21:55:57.293340+0000","last_clean":"2024-09-15T21:55:57.293340+0000","last_became_active":"2024-09-15T21:55:56.308655+0000","last_became_peered":"2024-09-15T21:55:56.308655+0000","last_unstale":"2024-09-15T21:55:57.293340+0000","last_undegraded":"2024-09-15T21:55:57.293340+0000","last_fullsized":"2024-09-15T21:55:57.293340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:42.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275611+0000","last_change":"2024-09-15T21:55:56.288513+0000","last_active":"2024-09-15T21:55:57.275611+0000","last_peered":"2024-09-15T21:55:57.275611+0000","last_clean":"2024-09-15T21:55:57.275611+0000","last_became_active":"2024-09-15T21:55:56.287428+0000","last_became_peered":"2024-09-15T21:55:56.287428+0000","last_unstale":"2024-09-15T21:55:57.275611+0000","last_undegraded":"2024-09-15T21:55:57.275611+0000","last_fullsized":"2024-09-15T21:55:57.275611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:59.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275015+0000","last_change":"2024-09-15T21:55:56.282116+0000","last_active":"2024-09-15T21:55:57.275015+0000","last_peered":"2024-09-15T21:55:57.275015+0000","last_clean":"2024-09-15T21:55:57.275015+0000","last_became_active":"2024-09-15T21:55:56.281332+0000","last_became_peered":"2024-09-15T21:55:56.281332+0000","last_unstale":"2024-09-15T21:55:57.275015+0000","last_undegraded":"2024-09-15T21:55:57.275015+0000","last_fullsized":"2024-09-15T21:55:57.275015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:45.931965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.271720+0000","last_change":"2024-09-15T21:55:56.274809+0000","last_active":"2024-09-15T21:55:57.271720+0000","last_peered":"2024-09-15T21:55:57.271720+0000","last_clean":"2024-09-15T21:55:57.271720+0000","last_became_active":"2024-09-15T21:55:56.274053+0000","last_became_peered":"2024-09-15T21:55:56.274053+0000","last_unstale":"2024-09-15T21:55:57.271720+0000","last_undegraded":"2024-09-15T21:55:57.271720+0000","last_fullsized":"2024-09-15T21:55:57.271720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:44.628938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293704+0000","last_change":"2024-09-15T21:55:56.301926+0000","last_active":"2024-09-15T21:55:57.293704+0000","last_peered":"2024-09-15T21:55:57.293704+0000","last_clean":"2024-09-15T21:55:57.293704+0000","last_became_active":"2024-09-15T21:55:56.301421+0000","last_became_peered":"2024-09-15T21:55:56.301421+0000","last_unstale":"2024-09-15T21:55:57.293704+0000","last_undegraded":"2024-09-15T21:55:57.293704+0000","last_fullsized":"2024-09-15T21:55:57.293704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:44.075453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276690+0000","last_change":"2024-09-15T21:55:56.302114+0000","last_active":"2024-09-15T21:55:57.276690+0000","last_peered":"2024-09-15T21:55:57.276690+0000","last_clean":"2024-09-15T21:55:57.276690+0000","last_became_active":"2024-09-15T21:55:56.301895+0000","last_became_peered":"2024-09-15T21:55:56.301895+0000","last_unstale":"2024-09-15T21:55:57.276690+0000","last_undegraded":"2024-09-15T21:55:57.276690+0000","last_fullsized":"2024-09-15T21:55:57.276690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:19.254994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292443+0000","last_change":"2024-09-15T21:55:56.301445+0000","last_active":"2024-09-15T21:55:57.292443+0000","last_peered":"2024-09-15T21:55:57.292443+0000","last_clean":"2024-09-15T21:55:57.292443+0000","last_became_active":"2024-09-15T21:55:56.301128+0000","last_became_peered":"2024-09-15T21:55:56.301128+0000","last_unstale":"2024-09-15T21:55:57.292443+0000","last_undegraded":"2024-09-15T21:55:57.292443+0000","last_fullsized":"2024-09-15T21:55:57.292443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:19.929648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276161+0000","last_change":"2024-09-15T21:55:56.291047+0000","last_active":"2024-09-15T21:55:57.276161+0000","last_peered":"2024-09-15T21:55:57.276161+0000","last_clean":"2024-09-15T21:55:57.276161+0000","last_became_active":"2024-09-15T21:55:56.288458+0000","last_became_peered":"2024-09-15T21:55:56.288458+0000","last_unstale":"2024-09-15T21:55:57.276161+0000","last_undegraded":"2024-09-15T21:55:57.276161+0000","last_fullsized":"2024-09-15T21:55:57.276161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:27.877309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296251+0000","last_change":"2024-09-15T21:55:56.300691+0000","last_active":"2024-09-15T21:55:57.296251+0000","last_peered":"2024-09-15T21:55:57.296251+0000","last_clean":"2024-09-15T21:55:57.296251+0000","last_became_active":"2024-09-15T21:55:56.296903+0000","last_became_peered":"2024-09-15T21:55:56.296903+0000","last_unstale":"2024-09-15T21:55:57.296251+0000","last_undegraded":"2024-09-15T21:55:57.296251+0000","last_fullsized":"2024-09-15T21:55:57.296251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:57.994502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276042+0000","last_change":"2024-09-15T21:55:56.288287+0000","last_active":"2024-09-15T21:55:57.276042+0000","last_peered":"2024-09-15T21:55:57.276042+0000","last_clean":"2024-09-15T21:55:57.276042+0000","last_became_active":"2024-09-15T21:55:56.286326+0000","last_became_peered":"2024-09-15T21:55:56.286326+0000","last_unstale":"2024-09-15T21:55:57.276042+0000","last_undegraded":"2024-09-15T21:55:57.276042+0000","last_fullsized":"2024-09-15T21:55:57.276042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:20.885076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295041+0000","last_change":"2024-09-15T21:55:56.278013+0000","last_active":"2024-09-15T21:55:57.295041+0000","last_peered":"2024-09-15T21:55:57.295041+0000","last_clean":"2024-09-15T21:55:57.295041+0000","last_became_active":"2024-09-15T21:55:56.277260+0000","last_became_peered":"2024-09-15T21:55:56.277260+0000","last_unstale":"2024-09-15T21:55:57.295041+0000","last_undegraded":"2024-09-15T21:55:57.295041+0000","last_fullsized":"2024-09-15T21:55:57.295041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:07.090183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275879+0000","last_change":"2024-09-15T21:55:56.271183+0000","last_active":"2024-09-15T21:55:57.275879+0000","last_peered":"2024-09-15T21:55:57.275879+0000","last_clean":"2024-09-15T21:55:57.275879+0000","last_became_active":"2024-09-15T21:55:56.270445+0000","last_became_peered":"2024-09-15T21:55:56.270445+0000","last_unstale":"2024-09-15T21:55:57.275879+0000","last_undegraded":"2024-09-15T21:55:57.275879+0000","last_fullsized":"2024-09-15T21:55:57.275879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:05.944452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294405+0000","last_change":"2024-09-15T21:55:56.298083+0000","last_active":"2024-09-15T21:55:57.294405+0000","last_peered":"2024-09-15T21:55:57.294405+0000","last_clean":"2024-09-15T21:55:57.294405+0000","last_became_active":"2024-09-15T21:55:56.286370+0000","last_became_peered":"2024-09-15T21:55:56.286370+0000","last_unstale":"2024-09-15T21:55:57.294405+0000","last_undegraded":"2024-09-15T21:55:57.294405+0000","last_fullsized":"2024-09-15T21:55:57.294405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:40.099978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.272215+0000","last_change":"2024-09-15T21:55:56.279489+0000","last_active":"2024-09-15T21:55:57.272215+0000","last_peered":"2024-09-15T21:55:57.272215+0000","last_clean":"2024-09-15T21:55:57.272215+0000","last_became_active":"2024-09-15T21:55:56.278762+0000","last_became_peered":"2024-09-15T21:55:56.278762+0000","last_unstale":"2024-09-15T21:55:57.272215+0000","last_undegraded":"2024-09-15T21:55:57.272215+0000","last_fullsized":"2024-09-15T21:55:57.272215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:20.885076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275696+0000","last_change":"2024-09-15T21:55:55.249652+0000","last_active":"2024-09-15T21:55:57.275696+0000","last_peered":"2024-09-15T21:55:57.275696+0000","last_clean":"2024-09-15T21:55:57.275696+0000","last_became_active":"2024-09-15T21:55:55.248947+0000","last_became_peered":"2024-09-15T21:55:55.248947+0000","last_unstale":"2024-09-15T21:55:57.275696+0000","last_undegraded":"2024-09-15T21:55:57.275696+0000","last_fullsized":"2024-09-15T21:55:57.275696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:52.957424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276509+0000","last_change":"2024-09-15T21:55:56.269308+0000","last_active":"2024-09-15T21:55:57.276509+0000","last_peered":"2024-09-15T21:55:57.276509+0000","last_clean":"2024-09-15T21:55:57.276509+0000","last_became_active":"2024-09-15T21:55:56.268535+0000","last_became_peered":"2024-09-15T21:55:56.268535+0000","last_unstale":"2024-09-15T21:55:57.276509+0000","last_undegraded":"2024-09-15T21:55:57.276509+0000","last_fullsized":"2024-09-15T21:55:57.276509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:45.931965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.272275+0000","last_change":"2024-09-15T21:55:55.240388+0000","last_active":"2024-09-15T21:55:57.272275+0000","last_peered":"2024-09-15T21:55:57.272275+0000","last_clean":"2024-09-15T21:55:57.272275+0000","last_became_active":"2024-09-15T21:55:55.239837+0000","last_became_peered":"2024-09-15T21:55:55.239837+0000","last_unstale":"2024-09-15T21:55:57.272275+0000","last_undegraded":"2024-09-15T21:55:57.272275+0000","last_fullsized":"2024-09-15T21:55:57.272275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:52.957424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276971+0000","last_change":"2024-09-15T21:55:56.293316+0000","last_active":"2024-09-15T21:55:57.276971+0000","last_peered":"2024-09-15T21:55:57.276971+0000","last_clean":"2024-09-15T21:55:57.276971+0000","last_became_active":"2024-09-15T21:55:56.292540+0000","last_became_peered":"2024-09-15T21:55:56.292540+0000","last_unstale":"2024-09-15T21:55:57.276971+0000","last_undegraded":"2024-09-15T21:55:57.276971+0000","last_fullsized":"2024-09-15T21:55:57.276971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:52.607353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292841+0000","last_change":"2024-09-15T21:55:55.240018+0000","last_active":"2024-09-15T21:55:57.292841+0000","last_peered":"2024-09-15T21:55:57.292841+0000","last_clean":"2024-09-15T21:55:57.292841+0000","last_became_active":"2024-09-15T21:55:55.239512+0000","last_became_peered":"2024-09-15T21:55:55.239512+0000","last_unstale":"2024-09-15T21:55:57.292841+0000","last_undegraded":"2024-09-15T21:55:57.292841+0000","last_fullsized":"2024-09-15T21:55:57.292841+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:19.876529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276095+0000","last_change":"2024-09-15T21:55:56.291341+0000","last_active":"2024-09-15T21:55:57.276095+0000","last_peered":"2024-09-15T21:55:57.276095+0000","last_clean":"2024-09-15T21:55:57.276095+0000","last_became_active":"2024-09-15T21:55:56.291003+0000","last_became_peered":"2024-09-15T21:55:56.291003+0000","last_unstale":"2024-09-15T21:55:57.276095+0000","last_undegraded":"2024-09-15T21:55:57.276095+0000","last_fullsized":"2024-09-15T21:55:57.276095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:55.481298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293444+0000","last_change":"2024-09-15T21:55:55.241122+0000","last_active":"2024-09-15T21:55:57.293444+0000","last_peered":"2024-09-15T21:55:57.293444+0000","last_clean":"2024-09-15T21:55:57.293444+0000","last_became_active":"2024-09-15T21:55:55.240704+0000","last_became_peered":"2024-09-15T21:55:55.240704+0000","last_unstale":"2024-09-15T21:55:57.293444+0000","last_undegraded":"2024-09-15T21:55:57.293444+0000","last_fullsized":"2024-09-15T21:55:57.293444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:13.090176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295034+0000","last_change":"2024-09-15T21:55:56.288570+0000","last_active":"2024-09-15T21:55:57.295034+0000","last_peered":"2024-09-15T21:55:57.295034+0000","last_clean":"2024-09-15T21:55:57.295034+0000","last_became_active":"2024-09-15T21:55:56.279697+0000","last_became_peered":"2024-09-15T21:55:56.279697+0000","last_unstale":"2024-09-15T21:55:57.295034+0000","last_undegraded":"2024-09-15T21:55:57.295034+0000","last_fullsized":"2024-09-15T21:55:57.295034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:44.393748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276185+0000","last_change":"2024-09-15T21:55:55.260925+0000","last_active":"2024-09-15T21:55:57.276185+0000","last_peered":"2024-09-15T21:55:57.276185+0000","last_clean":"2024-09-15T21:55:57.276185+0000","last_became_active":"2024-09-15T21:55:55.257306+0000","last_became_peered":"2024-09-15T21:55:55.257306+0000","last_unstale":"2024-09-15T21:55:57.276185+0000","last_undegraded":"2024-09-15T21:55:57.276185+0000","last_fullsized":"2024-09-15T21:55:57.276185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:45.804383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295031+0000","last_change":"2024-09-15T21:55:56.307263+0000","last_active":"2024-09-15T21:55:57.295031+0000","last_peered":"2024-09-15T21:55:57.295031+0000","last_clean":"2024-09-15T21:55:57.295031+0000","last_became_active":"2024-09-15T21:55:56.306423+0000","last_became_peered":"2024-09-15T21:55:56.306423+0000","last_unstale":"2024-09-15T21:55:57.295031+0000","last_undegraded":"2024-09-15T21:55:57.295031+0000","last_fullsized":"2024-09-15T21:55:57.295031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:03.320745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274940+0000","last_change":"2024-09-15T21:55:55.261177+0000","last_active":"2024-09-15T21:55:57.274940+0000","last_peered":"2024-09-15T21:55:57.274940+0000","last_clean":"2024-09-15T21:55:57.274940+0000","last_became_active":"2024-09-15T21:55:55.256722+0000","last_became_peered":"2024-09-15T21:55:55.256722+0000","last_unstale":"2024-09-15T21:55:57.274940+0000","last_undegraded":"2024-09-15T21:55:57.274940+0000","last_fullsized":"2024-09-15T21:55:57.274940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:24.321134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274372+0000","last_change":"2024-09-15T21:55:56.277730+0000","last_active":"2024-09-15T21:55:57.274372+0000","last_peered":"2024-09-15T21:55:57.274372+0000","last_clean":"2024-09-15T21:55:57.274372+0000","last_became_active":"2024-09-15T21:55:56.276955+0000","last_became_peered":"2024-09-15T21:55:56.276955+0000","last_unstale":"2024-09-15T21:55:57.274372+0000","last_undegraded":"2024-09-15T21:55:57.274372+0000","last_fullsized":"2024-09-15T21:55:57.274372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:05.944452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.291601+0000","last_change":"2024-09-15T21:55:55.235928+0000","last_active":"2024-09-15T21:55:57.291601+0000","last_peered":"2024-09-15T21:55:57.291601+0000","last_clean":"2024-09-15T21:55:57.291601+0000","last_became_active":"2024-09-15T21:55:55.235501+0000","last_became_peered":"2024-09-15T21:55:55.235501+0000","last_unstale":"2024-09-15T21:55:57.291601+0000","last_undegraded":"2024-09-15T21:55:57.291601+0000","last_fullsized":"2024-09-15T21:55:57.291601+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:48.564582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275375+0000","last_change":"2024-09-15T21:55:56.307601+0000","last_active":"2024-09-15T21:55:57.275375+0000","last_peered":"2024-09-15T21:55:57.275375+0000","last_clean":"2024-09-15T21:55:57.275375+0000","last_became_active":"2024-09-15T21:55:56.306954+0000","last_became_peered":"2024-09-15T21:55:56.306954+0000","last_unstale":"2024-09-15T21:55:57.275375+0000","last_undegraded":"2024-09-15T21:55:57.275375+0000","last_fullsized":"2024-09-15T21:55:57.275375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:04:33.263108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274640+0000","last_change":"2024-09-15T21:55:55.262772+0000","last_active":"2024-09-15T21:55:57.274640+0000","last_peered":"2024-09-15T21:55:57.274640+0000","last_clean":"2024-09-15T21:55:57.274640+0000","last_became_active":"2024-09-15T21:55:55.262001+0000","last_became_peered":"2024-09-15T21:55:55.262001+0000","last_unstale":"2024-09-15T21:55:57.274640+0000","last_undegraded":"2024-09-15T21:55:57.274640+0000","last_fullsized":"2024-09-15T21:55:57.274640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:34:47.778872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296661+0000","last_change":"2024-09-15T21:55:56.308818+0000","last_active":"2024-09-15T21:55:57.296661+0000","last_peered":"2024-09-15T21:55:57.296661+0000","last_clean":"2024-09-15T21:55:57.296661+0000","last_became_active":"2024-09-15T21:55:56.306527+0000","last_became_peered":"2024-09-15T21:55:56.306527+0000","last_unstale":"2024-09-15T21:55:57.296661+0000","last_undegraded":"2024-09-15T21:55:57.296661+0000","last_fullsized":"2024-09-15T21:55:57.296661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:10.855416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292871+0000","last_change":"2024-09-15T21:55:55.251449+0000","last_active":"2024-09-15T21:55:57.292871+0000","last_peered":"2024-09-15T21:55:57.292871+0000","last_clean":"2024-09-15T21:55:57.292871+0000","last_became_active":"2024-09-15T21:55:55.251192+0000","last_became_peered":"2024-09-15T21:55:55.251192+0000","last_unstale":"2024-09-15T21:55:57.292871+0000","last_undegraded":"2024-09-15T21:55:57.292871+0000","last_fullsized":"2024-09-15T21:55:57.292871+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:44.923418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292779+0000","last_change":"2024-09-15T21:55:56.289552+0000","last_active":"2024-09-15T21:55:57.292779+0000","last_peered":"2024-09-15T21:55:57.292779+0000","last_clean":"2024-09-15T21:55:57.292779+0000","last_became_active":"2024-09-15T21:55:56.289265+0000","last_became_peered":"2024-09-15T21:55:56.289265+0000","last_unstale":"2024-09-15T21:55:57.292779+0000","last_undegraded":"2024-09-15T21:55:57.292779+0000","last_fullsized":"2024-09-15T21:55:57.292779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:51.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.272346+0000","last_change":"2024-09-15T21:55:55.234667+0000","last_active":"2024-09-15T21:55:57.272346+0000","last_peered":"2024-09-15T21:55:57.272346+0000","last_clean":"2024-09-15T21:55:57.272346+0000","last_became_active":"2024-09-15T21:55:55.234277+0000","last_became_peered":"2024-09-15T21:55:55.234277+0000","last_unstale":"2024-09-15T21:55:57.272346+0000","last_undegraded":"2024-09-15T21:55:57.272346+0000","last_fullsized":"2024-09-15T21:55:57.272346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:59.580457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292302+0000","last_change":"2024-09-15T21:55:56.301300+0000","last_active":"2024-09-15T21:55:57.292302+0000","last_peered":"2024-09-15T21:55:57.292302+0000","last_clean":"2024-09-15T21:55:57.292302+0000","last_became_active":"2024-09-15T21:55:56.300947+0000","last_became_peered":"2024-09-15T21:55:56.300947+0000","last_unstale":"2024-09-15T21:55:57.292302+0000","last_undegraded":"2024-09-15T21:55:57.292302+0000","last_fullsized":"2024-09-15T21:55:57.292302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:00.980630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296397+0000","last_change":"2024-09-15T21:55:55.246855+0000","last_active":"2024-09-15T21:55:57.296397+0000","last_peered":"2024-09-15T21:55:57.296397+0000","last_clean":"2024-09-15T21:55:57.296397+0000","last_became_active":"2024-09-15T21:55:55.245901+0000","last_became_peered":"2024-09-15T21:55:55.245901+0000","last_unstale":"2024-09-15T21:55:57.296397+0000","last_undegraded":"2024-09-15T21:55:57.296397+0000","last_fullsized":"2024-09-15T21:55:57.296397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:09.182420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296029+0000","last_change":"2024-09-15T21:55:56.299605+0000","last_active":"2024-09-15T21:55:57.296029+0000","last_peered":"2024-09-15T21:55:57.296029+0000","last_clean":"2024-09-15T21:55:57.296029+0000","last_became_active":"2024-09-15T21:55:56.298953+0000","last_became_peered":"2024-09-15T21:55:56.298953+0000","last_unstale":"2024-09-15T21:55:57.296029+0000","last_undegraded":"2024-09-15T21:55:57.296029+0000","last_fullsized":"2024-09-15T21:55:57.296029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:27.877309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'6","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293104+0000","last_change":"2024-09-15T21:55:55.239321+0000","last_active":"2024-09-15T21:55:57.293104+0000","last_peered":"2024-09-15T21:55:57.293104+0000","last_clean":"2024-09-15T21:55:57.293104+0000","last_became_active":"2024-09-15T21:55:55.238833+0000","last_became_peered":"2024-09-15T21:55:55.238833+0000","last_unstale":"2024-09-15T21:55:57.293104+0000","last_undegraded":"2024-09-15T21:55:57.293104+0000","last_fullsized":"2024-09-15T21:55:57.293104+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:58.362609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275669+0000","last_change":"2024-09-15T21:55:56.307917+0000","last_active":"2024-09-15T21:55:57.275669+0000","last_peered":"2024-09-15T21:55:57.275669+0000","last_clean":"2024-09-15T21:55:57.275669+0000","last_became_active":"2024-09-15T21:55:56.307244+0000","last_became_peered":"2024-09-15T21:55:56.307244+0000","last_unstale":"2024-09-15T21:55:57.275669+0000","last_undegraded":"2024-09-15T21:55:57.275669+0000","last_fullsized":"2024-09-15T21:55:57.275669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:52.607353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276440+0000","last_change":"2024-09-15T21:55:55.262964+0000","last_active":"2024-09-15T21:55:57.276440+0000","last_peered":"2024-09-15T21:55:57.276440+0000","last_clean":"2024-09-15T21:55:57.276440+0000","last_became_active":"2024-09-15T21:55:55.262238+0000","last_became_peered":"2024-09-15T21:55:55.262238+0000","last_unstale":"2024-09-15T21:55:57.276440+0000","last_undegraded":"2024-09-15T21:55:57.276440+0000","last_fullsized":"2024-09-15T21:55:57.276440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:12.038959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.291928+0000","last_change":"2024-09-15T21:55:56.284783+0000","last_active":"2024-09-15T21:55:57.291928+0000","last_peered":"2024-09-15T21:55:57.291928+0000","last_clean":"2024-09-15T21:55:57.291928+0000","last_became_active":"2024-09-15T21:55:56.283805+0000","last_became_peered":"2024-09-15T21:55:56.283805+0000","last_unstale":"2024-09-15T21:55:57.291928+0000","last_undegraded":"2024-09-15T21:55:57.291928+0000","last_fullsized":"2024-09-15T21:55:57.291928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:10.855416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275636+0000","last_change":"2024-09-15T21:55:55.242337+0000","last_active":"2024-09-15T21:55:57.275636+0000","last_peered":"2024-09-15T21:55:57.275636+0000","last_clean":"2024-09-15T21:55:57.275636+0000","last_became_active":"2024-09-15T21:55:55.241660+0000","last_became_peered":"2024-09-15T21:55:55.241660+0000","last_unstale":"2024-09-15T21:55:57.275636+0000","last_undegraded":"2024-09-15T21:55:57.275636+0000","last_fullsized":"2024-09-15T21:55:57.275636+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:52.176799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294850+0000","last_change":"2024-09-15T21:55:56.286828+0000","last_active":"2024-09-15T21:55:57.294850+0000","last_peered":"2024-09-15T21:55:57.294850+0000","last_clean":"2024-09-15T21:55:57.294850+0000","last_became_active":"2024-09-15T21:55:56.279323+0000","last_became_peered":"2024-09-15T21:55:56.279323+0000","last_unstale":"2024-09-15T21:55:57.294850+0000","last_undegraded":"2024-09-15T21:55:57.294850+0000","last_fullsized":"2024-09-15T21:55:57.294850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:49.172006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.291620+0000","last_change":"2024-09-15T21:55:55.244961+0000","last_active":"2024-09-15T21:55:57.291620+0000","last_peered":"2024-09-15T21:55:57.291620+0000","last_clean":"2024-09-15T21:55:57.291620+0000","last_became_active":"2024-09-15T21:55:55.244608+0000","last_became_peered":"2024-09-15T21:55:55.244608+0000","last_unstale":"2024-09-15T21:55:57.291620+0000","last_undegraded":"2024-09-15T21:55:57.291620+0000","last_fullsized":"2024-09-15T21:55:57.291620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:15.089446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276240+0000","last_change":"2024-09-15T21:55:56.269510+0000","last_active":"2024-09-15T21:55:57.276240+0000","last_peered":"2024-09-15T21:55:57.276240+0000","last_clean":"2024-09-15T21:55:57.276240+0000","last_became_active":"2024-09-15T21:55:56.268792+0000","last_became_peered":"2024-09-15T21:55:56.268792+0000","last_unstale":"2024-09-15T21:55:57.276240+0000","last_undegraded":"2024-09-15T21:55:57.276240+0000","last_fullsized":"2024-09-15T21:55:57.276240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:44.628938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.291561+0000","last_change":"2024-09-15T21:55:55.239119+0000","last_active":"2024-09-15T21:55:57.291561+0000","last_peered":"2024-09-15T21:55:57.291561+0000","last_clean":"2024-09-15T21:55:57.291561+0000","last_became_active":"2024-09-15T21:55:55.238740+0000","last_became_peered":"2024-09-15T21:55:55.238740+0000","last_unstale":"2024-09-15T21:55:57.291561+0000","last_undegraded":"2024-09-15T21:55:57.291561+0000","last_fullsized":"2024-09-15T21:55:57.291561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:43.620391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276430+0000","last_change":"2024-09-15T21:55:56.311934+0000","last_active":"2024-09-15T21:55:57.276430+0000","last_peered":"2024-09-15T21:55:57.276430+0000","last_clean":"2024-09-15T21:55:57.276430+0000","last_became_active":"2024-09-15T21:55:56.311222+0000","last_became_peered":"2024-09-15T21:55:56.311222+0000","last_unstale":"2024-09-15T21:55:57.276430+0000","last_undegraded":"2024-09-15T21:55:57.276430+0000","last_fullsized":"2024-09-15T21:55:57.276430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:04:33.263108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276410+0000","last_change":"2024-09-15T21:55:55.237840+0000","last_active":"2024-09-15T21:55:57.276410+0000","last_peered":"2024-09-15T21:55:57.276410+0000","last_clean":"2024-09-15T21:55:57.276410+0000","last_became_active":"2024-09-15T21:55:55.237551+0000","last_became_peered":"2024-09-15T21:55:55.237551+0000","last_unstale":"2024-09-15T21:55:57.276410+0000","last_undegraded":"2024-09-15T21:55:57.276410+0000","last_fullsized":"2024-09-15T21:55:57.276410+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:59.580457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296830+0000","last_change":"2024-09-15T21:55:56.309158+0000","last_active":"2024-09-15T21:55:57.296830+0000","last_peered":"2024-09-15T21:55:57.296830+0000","last_clean":"2024-09-15T21:55:57.296830+0000","last_became_active":"2024-09-15T21:55:56.307298+0000","last_became_peered":"2024-09-15T21:55:56.307298+0000","last_unstale":"2024-09-15T21:55:57.296830+0000","last_undegraded":"2024-09-15T21:55:57.296830+0000","last_fullsized":"2024-09-15T21:55:57.296830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:02.021065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275692+0000","last_change":"2024-09-15T21:55:55.262914+0000","last_active":"2024-09-15T21:55:57.275692+0000","last_peered":"2024-09-15T21:55:57.275692+0000","last_clean":"2024-09-15T21:55:57.275692+0000","last_became_active":"2024-09-15T21:55:55.262306+0000","last_became_peered":"2024-09-15T21:55:55.262306+0000","last_unstale":"2024-09-15T21:55:57.275692+0000","last_undegraded":"2024-09-15T21:55:57.275692+0000","last_fullsized":"2024-09-15T21:55:57.275692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:44.329135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275914+0000","last_change":"2024-09-15T21:55:56.282334+0000","last_active":"2024-09-15T21:55:57.275914+0000","last_peered":"2024-09-15T21:55:57.275914+0000","last_clean":"2024-09-15T21:55:57.275914+0000","last_became_active":"2024-09-15T21:55:56.281990+0000","last_became_peered":"2024-09-15T21:55:56.281990+0000","last_unstale":"2024-09-15T21:55:57.275914+0000","last_undegraded":"2024-09-15T21:55:57.275914+0000","last_fullsized":"2024-09-15T21:55:57.275914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:44.075453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276259+0000","last_change":"2024-09-15T21:55:55.255577+0000","last_active":"2024-09-15T21:55:57.276259+0000","last_peered":"2024-09-15T21:55:57.276259+0000","last_clean":"2024-09-15T21:55:57.276259+0000","last_became_active":"2024-09-15T21:55:55.254828+0000","last_became_peered":"2024-09-15T21:55:55.254828+0000","last_unstale":"2024-09-15T21:55:57.276259+0000","last_undegraded":"2024-09-15T21:55:57.276259+0000","last_fullsized":"2024-09-15T21:55:57.276259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:43.455863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293173+0000","last_change":"2024-09-15T21:55:56.267608+0000","last_active":"2024-09-15T21:55:57.293173+0000","last_peered":"2024-09-15T21:55:57.293173+0000","last_clean":"2024-09-15T21:55:57.293173+0000","last_became_active":"2024-09-15T21:55:56.266561+0000","last_became_peered":"2024-09-15T21:55:56.266561+0000","last_unstale":"2024-09-15T21:55:57.293173+0000","last_undegraded":"2024-09-15T21:55:57.293173+0000","last_fullsized":"2024-09-15T21:55:57.293173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:22.093251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276890+0000","last_change":"2024-09-15T21:55:55.265495+0000","last_active":"2024-09-15T21:55:57.276890+0000","last_peered":"2024-09-15T21:55:57.276890+0000","last_clean":"2024-09-15T21:55:57.276890+0000","last_became_active":"2024-09-15T21:55:55.256531+0000","last_became_peered":"2024-09-15T21:55:55.256531+0000","last_unstale":"2024-09-15T21:55:57.276890+0000","last_undegraded":"2024-09-15T21:55:57.276890+0000","last_fullsized":"2024-09-15T21:55:57.276890+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:03.652358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293350+0000","last_change":"2024-09-15T21:55:56.278289+0000","last_active":"2024-09-15T21:55:57.293350+0000","last_peered":"2024-09-15T21:55:57.293350+0000","last_clean":"2024-09-15T21:55:57.293350+0000","last_became_active":"2024-09-15T21:55:56.277211+0000","last_became_peered":"2024-09-15T21:55:56.277211+0000","last_unstale":"2024-09-15T21:55:57.293350+0000","last_undegraded":"2024-09-15T21:55:57.293350+0000","last_fullsized":"2024-09-15T21:55:57.293350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:38.020249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.271993+0000","last_change":"2024-09-15T21:55:55.229233+0000","last_active":"2024-09-15T21:55:57.271993+0000","last_peered":"2024-09-15T21:55:57.271993+0000","last_clean":"2024-09-15T21:55:57.271993+0000","last_became_active":"2024-09-15T21:55:55.228846+0000","last_became_peered":"2024-09-15T21:55:55.228846+0000","last_unstale":"2024-09-15T21:55:57.271993+0000","last_undegraded":"2024-09-15T21:55:57.271993+0000","last_fullsized":"2024-09-15T21:55:57.271993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:23.173121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293839+0000","last_change":"2024-09-15T21:55:56.280721+0000","last_active":"2024-09-15T21:55:57.293839+0000","last_peered":"2024-09-15T21:55:57.293839+0000","last_clean":"2024-09-15T21:55:57.293839+0000","last_became_active":"2024-09-15T21:55:56.280319+0000","last_became_peered":"2024-09-15T21:55:56.280319+0000","last_unstale":"2024-09-15T21:55:57.293839+0000","last_undegraded":"2024-09-15T21:55:57.293839+0000","last_fullsized":"2024-09-15T21:55:57.293839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:00.996297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275335+0000","last_change":"2024-09-15T21:55:55.246626+0000","last_active":"2024-09-15T21:55:57.275335+0000","last_peered":"2024-09-15T21:55:57.275335+0000","last_clean":"2024-09-15T21:55:57.275335+0000","last_became_active":"2024-09-15T21:55:55.245886+0000","last_became_peered":"2024-09-15T21:55:55.245886+0000","last_unstale":"2024-09-15T21:55:57.275335+0000","last_undegraded":"2024-09-15T21:55:57.275335+0000","last_fullsized":"2024-09-15T21:55:57.275335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:52.176799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293170+0000","last_change":"2024-09-15T21:55:56.267393+0000","last_active":"2024-09-15T21:55:57.293170+0000","last_peered":"2024-09-15T21:55:57.293170+0000","last_clean":"2024-09-15T21:55:57.293170+0000","last_became_active":"2024-09-15T21:55:56.266556+0000","last_became_peered":"2024-09-15T21:55:56.266556+0000","last_unstale":"2024-09-15T21:55:57.293170+0000","last_undegraded":"2024-09-15T21:55:57.293170+0000","last_fullsized":"2024-09-15T21:55:57.293170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:10.617836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274509+0000","last_change":"2024-09-15T21:55:55.261924+0000","last_active":"2024-09-15T21:55:57.274509+0000","last_peered":"2024-09-15T21:55:57.274509+0000","last_clean":"2024-09-15T21:55:57.274509+0000","last_became_active":"2024-09-15T21:55:55.261207+0000","last_became_peered":"2024-09-15T21:55:55.261207+0000","last_unstale":"2024-09-15T21:55:57.274509+0000","last_undegraded":"2024-09-15T21:55:57.274509+0000","last_fullsized":"2024-09-15T21:55:57.274509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:58.304088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294629+0000","last_change":"2024-09-15T21:55:56.290591+0000","last_active":"2024-09-15T21:55:57.294629+0000","last_peered":"2024-09-15T21:55:57.294629+0000","last_clean":"2024-09-15T21:55:57.294629+0000","last_became_active":"2024-09-15T21:55:56.289211+0000","last_became_peered":"2024-09-15T21:55:56.289211+0000","last_unstale":"2024-09-15T21:55:57.294629+0000","last_undegraded":"2024-09-15T21:55:57.294629+0000","last_fullsized":"2024-09-15T21:55:57.294629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:53.958162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293530+0000","last_change":"2024-09-15T21:55:55.255670+0000","last_active":"2024-09-15T21:55:57.293530+0000","last_peered":"2024-09-15T21:55:57.293530+0000","last_clean":"2024-09-15T21:55:57.293530+0000","last_became_active":"2024-09-15T21:55:55.254936+0000","last_became_peered":"2024-09-15T21:55:55.254936+0000","last_unstale":"2024-09-15T21:55:57.293530+0000","last_undegraded":"2024-09-15T21:55:57.293530+0000","last_fullsized":"2024-09-15T21:55:57.293530+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:15.089446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293617+0000","last_change":"2024-09-15T21:55:56.310032+0000","last_active":"2024-09-15T21:55:57.293617+0000","last_peered":"2024-09-15T21:55:57.293617+0000","last_clean":"2024-09-15T21:55:57.293617+0000","last_became_active":"2024-09-15T21:55:56.309746+0000","last_became_peered":"2024-09-15T21:55:56.309746+0000","last_unstale":"2024-09-15T21:55:57.293617+0000","last_undegraded":"2024-09-15T21:55:57.293617+0000","last_fullsized":"2024-09-15T21:55:57.293617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:13.626595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276542+0000","last_change":"2024-09-15T21:55:55.247682+0000","last_active":"2024-09-15T21:55:57.276542+0000","last_peered":"2024-09-15T21:55:57.276542+0000","last_clean":"2024-09-15T21:55:57.276542+0000","last_became_active":"2024-09-15T21:55:55.247324+0000","last_became_peered":"2024-09-15T21:55:55.247324+0000","last_unstale":"2024-09-15T21:55:57.276542+0000","last_undegraded":"2024-09-15T21:55:57.276542+0000","last_fullsized":"2024-09-15T21:55:57.276542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:05.391521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.297099+0000","last_change":"2024-09-15T21:55:56.307459+0000","last_active":"2024-09-15T21:55:57.297099+0000","last_peered":"2024-09-15T21:55:57.297099+0000","last_clean":"2024-09-15T21:55:57.297099+0000","last_became_active":"2024-09-15T21:55:56.306864+0000","last_became_peered":"2024-09-15T21:55:56.306864+0000","last_unstale":"2024-09-15T21:55:57.297099+0000","last_undegraded":"2024-09-15T21:55:57.297099+0000","last_fullsized":"2024-09-15T21:55:57.297099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:15.829500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"30'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.272302+0000","last_change":"2024-09-15T21:55:55.238010+0000","last_active":"2024-09-15T21:55:57.272302+0000","last_peered":"2024-09-15T21:55:57.272302+0000","last_clean":"2024-09-15T21:55:57.272302+0000","last_became_active":"2024-09-15T21:55:55.237459+0000","last_became_peered":"2024-09-15T21:55:55.237459+0000","last_unstale":"2024-09-15T21:55:57.272302+0000","last_undegraded":"2024-09-15T21:55:57.272302+0000","last_fullsized":"2024-09-15T21:55:57.272302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:25.819619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.272137+0000","last_change":"2024-09-15T21:55:56.270706+0000","last_active":"2024-09-15T21:55:57.272137+0000","last_peered":"2024-09-15T21:55:57.272137+0000","last_clean":"2024-09-15T21:55:57.272137+0000","last_became_active":"2024-09-15T21:55:56.270300+0000","last_became_peered":"2024-09-15T21:55:56.270300+0000","last_unstale":"2024-09-15T21:55:57.272137+0000","last_undegraded":"2024-09-15T21:55:57.272137+0000","last_fullsized":"2024-09-15T21:55:57.272137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:59.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275857+0000","last_change":"2024-09-15T21:55:55.236793+0000","last_active":"2024-09-15T21:55:57.275857+0000","last_peered":"2024-09-15T21:55:57.275857+0000","last_clean":"2024-09-15T21:55:57.275857+0000","last_became_active":"2024-09-15T21:55:55.236398+0000","last_became_peered":"2024-09-15T21:55:55.236398+0000","last_unstale":"2024-09-15T21:55:57.275857+0000","last_undegraded":"2024-09-15T21:55:57.275857+0000","last_fullsized":"2024-09-15T21:55:57.275857+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:52.957424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275293+0000","last_change":"2024-09-15T21:55:56.267392+0000","last_active":"2024-09-15T21:55:57.275293+0000","last_peered":"2024-09-15T21:55:57.275293+0000","last_clean":"2024-09-15T21:55:57.275293+0000","last_became_active":"2024-09-15T21:55:56.266669+0000","last_became_peered":"2024-09-15T21:55:56.266669+0000","last_unstale":"2024-09-15T21:55:57.275293+0000","last_undegraded":"2024-09-15T21:55:57.275293+0000","last_fullsized":"2024-09-15T21:55:57.275293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:16.097993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.272067+0000","last_change":"2024-09-15T21:55:55.236177+0000","last_active":"2024-09-15T21:55:57.272067+0000","last_peered":"2024-09-15T21:55:57.272067+0000","last_clean":"2024-09-15T21:55:57.272067+0000","last_became_active":"2024-09-15T21:55:55.235890+0000","last_became_peered":"2024-09-15T21:55:55.235890+0000","last_unstale":"2024-09-15T21:55:57.272067+0000","last_undegraded":"2024-09-15T21:55:57.272067+0000","last_fullsized":"2024-09-15T21:55:57.272067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:09.182420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.271935+0000","last_change":"2024-09-15T21:55:56.284897+0000","last_active":"2024-09-15T21:55:57.271935+0000","last_peered":"2024-09-15T21:55:57.271935+0000","last_clean":"2024-09-15T21:55:57.271935+0000","last_became_active":"2024-09-15T21:55:56.282272+0000","last_became_peered":"2024-09-15T21:55:56.282272+0000","last_unstale":"2024-09-15T21:55:57.271935+0000","last_undegraded":"2024-09-15T21:55:57.271935+0000","last_fullsized":"2024-09-15T21:55:57.271935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:45.931965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275901+0000","last_change":"2024-09-15T21:55:55.247687+0000","last_active":"2024-09-15T21:55:57.275901+0000","last_peered":"2024-09-15T21:55:57.275901+0000","last_clean":"2024-09-15T21:55:57.275901+0000","last_became_active":"2024-09-15T21:55:55.247348+0000","last_became_peered":"2024-09-15T21:55:55.247348+0000","last_unstale":"2024-09-15T21:55:57.275901+0000","last_undegraded":"2024-09-15T21:55:57.275901+0000","last_fullsized":"2024-09-15T21:55:57.275901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:25.819619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.291668+0000","last_change":"2024-09-15T21:55:56.289584+0000","last_active":"2024-09-15T21:55:57.291668+0000","last_peered":"2024-09-15T21:55:57.291668+0000","last_clean":"2024-09-15T21:55:57.291668+0000","last_became_active":"2024-09-15T21:55:56.289148+0000","last_became_peered":"2024-09-15T21:55:56.289148+0000","last_unstale":"2024-09-15T21:55:57.291668+0000","last_undegraded":"2024-09-15T21:55:57.291668+0000","last_fullsized":"2024-09-15T21:55:57.291668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:57.994502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274820+0000","last_change":"2024-09-15T21:55:55.254121+0000","last_active":"2024-09-15T21:55:57.274820+0000","last_peered":"2024-09-15T21:55:57.274820+0000","last_clean":"2024-09-15T21:55:57.274820+0000","last_became_active":"2024-09-15T21:55:55.237665+0000","last_became_peered":"2024-09-15T21:55:55.237665+0000","last_unstale":"2024-09-15T21:55:57.274820+0000","last_undegraded":"2024-09-15T21:55:57.274820+0000","last_fullsized":"2024-09-15T21:55:57.274820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:52.176799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274642+0000","last_change":"2024-09-15T21:55:56.282098+0000","last_active":"2024-09-15T21:55:57.274642+0000","last_peered":"2024-09-15T21:55:57.274642+0000","last_clean":"2024-09-15T21:55:57.274642+0000","last_became_active":"2024-09-15T21:55:56.281081+0000","last_became_peered":"2024-09-15T21:55:56.281081+0000","last_unstale":"2024-09-15T21:55:57.274642+0000","last_undegraded":"2024-09-15T21:55:57.274642+0000","last_fullsized":"2024-09-15T21:55:57.274642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:44.628938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.291457+0000","last_change":"2024-09-15T21:55:55.253393+0000","last_active":"2024-09-15T21:55:57.291457+0000","last_peered":"2024-09-15T21:55:57.291457+0000","last_clean":"2024-09-15T21:55:57.291457+0000","last_became_active":"2024-09-15T21:55:55.253070+0000","last_became_peered":"2024-09-15T21:55:55.253070+0000","last_unstale":"2024-09-15T21:55:57.291457+0000","last_undegraded":"2024-09-15T21:55:57.291457+0000","last_fullsized":"2024-09-15T21:55:57.291457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:04.935905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295447+0000","last_change":"2024-09-15T21:55:56.269103+0000","last_active":"2024-09-15T21:55:57.295447+0000","last_peered":"2024-09-15T21:55:57.295447+0000","last_clean":"2024-09-15T21:55:57.295447+0000","last_became_active":"2024-09-15T21:55:56.268360+0000","last_became_peered":"2024-09-15T21:55:56.268360+0000","last_unstale":"2024-09-15T21:55:57.295447+0000","last_undegraded":"2024-09-15T21:55:57.295447+0000","last_fullsized":"2024-09-15T21:55:57.295447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:11.274512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274866+0000","last_change":"2024-09-15T21:55:55.269693+0000","last_active":"2024-09-15T21:55:57.274866+0000","last_peered":"2024-09-15T21:55:57.274866+0000","last_clean":"2024-09-15T21:55:57.274866+0000","last_became_active":"2024-09-15T21:55:55.268821+0000","last_became_peered":"2024-09-15T21:55:55.268821+0000","last_unstale":"2024-09-15T21:55:57.274866+0000","last_undegraded":"2024-09-15T21:55:57.274866+0000","last_fullsized":"2024-09-15T21:55:57.274866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:58.304088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295729+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:57.295729+0000","last_peered":"2024-09-15T21:55:57.295729+0000","last_clean":"2024-09-15T21:55:57.295729+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:57.295729+0000","last_undegraded":"2024-09-15T21:55:57.295729+0000","last_fullsized":"2024-09-15T21:55:57.295729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":335872,"data_stored":126441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":335872,"data_stored":126497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":335872,"data_stored":125929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":344064,"data_stored":127459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":344064,"data_stored":127459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36256,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335584,"statfs":{"total":96636764160,"available":96599638016,"internally_reserved":0,"allocated":921600,"data_stored":716193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":925696,"data_stored":716283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35676,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336164,"statfs":{"total":96636764160,"available":96600231936,"internally_reserved":0,"allocated":331776,"data_stored":125895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:56:04.823 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:56:04.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.952+0000 7f23c99e2640 1 Processor -- start 2024-09-15T21:56:04.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.952+0000 7f23c99e2640 1 -- start start 2024-09-15T21:56:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c99e2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40b6120 0x7f23c414b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c99e2640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c40b6500 con 0x7f23c4141ac0 2024-09-15T21:56:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c99e2640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c414bc60 con 0x7f23c41480c0 2024-09-15T21:56:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c99e2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f23c4147ba0 con 0x7f23c40b6120 2024-09-15T21:56:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c37fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f23c4141ac0 0x7f23c41521d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41398/0 (socket says 172.21.15.1:41398) 2024-09-15T21:56:04.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c37fe640 1 -- 172.21.15.1:0/3071753137 learned_addr learned my addr 172.21.15.1:0/3071753137 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:04.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c2ffd640 1 --2- 172.21.15.1:0/3071753137 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40b6120 0x7f23c414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:04.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3263841878 0 0) 0x7f23c40b6500 con 0x7f23c4141ac0 2024-09-15T21:56:04.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23ac003530 con 0x7f23c4141ac0 2024-09-15T21:56:04.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3392803826 0 0) 0x7f23ac003530 con 0x7f23c4141ac0 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40b6120 msgr2=0x7f23c414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 --2- 172.21.15.1:0/3071753137 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40b6120 0x7f23c414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 >> v1:172.21.15.70:6789/0 conn(0x7f23c41480c0 legacy=0x7f23c41413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c40b76c0 con 0x7f23c4141ac0 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f23bc001a00 con 0x7f23c4141ac0 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 >> v1:172.21.15.1:6789/0 conn(0x7f23c4141ac0 legacy=0x7f23c41521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 --2- 172.21.15.1:0/3071753137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ac0039f0 0x7f23ac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 --2- 172.21.15.1:0/3071753137 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40b6120 0x7f23ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 --2- 172.21.15.1:0/3071753137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23ac004d50 0x7f23ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f23c4147ba0 con 0x7f23ac004d50 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac00bb00 con 0x7f23ac0039f0 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f23ac00bd00 con 0x7f23c40b6120 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c37fe640 1 --2- 172.21.15.1:0/3071753137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23ac004d50 0x7f23ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c2ffd640 1 --2- 172.21.15.1:0/3071753137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ac0039f0 0x7f23ac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c27fc640 1 --2- 172.21.15.1:0/3071753137 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40b6120 0x7f23ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:04.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c37fe640 1 -- 172.21.15.1:0/3071753137 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40b6120 msgr2=0x7f23ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:04.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c37fe640 1 --2- 172.21.15.1:0/3071753137 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40b6120 0x7f23ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:04.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c37fe640 1 -- 172.21.15.1:0/3071753137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ac0039f0 msgr2=0x7f23ac003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:04.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c37fe640 1 --2- 172.21.15.1:0/3071753137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ac0039f0 0x7f23ac003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:04.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c37fe640 1 -- 172.21.15.1:0/3071753137 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac003530 con 0x7f23ac004d50 2024-09-15T21:56:04.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.956+0000 7f23c2ffd640 1 --2- 172.21.15.1:0/3071753137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ac0039f0 0x7f23ac003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:56:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c37fe640 1 --2- 172.21.15.1:0/3071753137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23ac004d50 0x7f23ac0051d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00a830 tx=0x7f23bc01fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f5419c817b7ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc00a480 con 0x7f23ac004d50 2024-09-15T21:56:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc0aa6f0 con 0x7f23ac004d50 2024-09-15T21:56:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c1ffb640 1 -- 172.21.15.1:0/3071753137 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0aab00 con 0x7f23ac004d50 2024-09-15T21:56:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 -- 172.21.15.1:0/3071753137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23ac004d50 msgr2=0x7f23ac0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 --2- 172.21.15.1:0/3071753137 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23ac004d50 0x7f23ac0051d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00a830 tx=0x7f23bc01fac0 comp rx=0 tx=0).stop 2024-09-15T21:56:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c37fe640 1 -- 172.21.15.1:0/3071753137 reap_dead start 2024-09-15T21:56:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 -- 172.21.15.1:0/3071753137 shutdown_connections 2024-09-15T21:56:04.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 -- 172.21.15.1:0/3071753137 >> 172.21.15.1:0/3071753137 conn(0x7f23c40bd2f0 msgr2=0x7f23c40bd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:04.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 -- 172.21.15.1:0/3071753137 shutdown_connections 2024-09-15T21:56:04.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 -- 172.21.15.1:0/3071753137 wait complete. 2024-09-15T21:56:04.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 Processor -- start 2024-09-15T21:56:04.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 -- start start 2024-09-15T21:56:04.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ac004d50 0x7f23c40ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:04.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40a99c0 0x7f23c40ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:04.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23c40acda0 0x7f23c41e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:04.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f23c4148520 con 0x7f23c40acda0 2024-09-15T21:56:04.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23c40b7c70 con 0x7f23ac004d50 2024-09-15T21:56:04.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c99e2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f23c41486a0 con 0x7f23c40a99c0 2024-09-15T21:56:04.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23c40acda0 0x7f23c41e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:04.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23c40acda0 0x7f23c41e06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51526/0 (socket says 172.21.15.1:51526) 2024-09-15T21:56:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c37fe640 1 -- 172.21.15.1:0/3263473080 learned_addr learned my addr 172.21.15.1:0/3263473080 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c27fc640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40a99c0 0x7f23c40ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c2ffd640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ac004d50 0x7f23c40ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c37fe640 1 -- 172.21.15.1:0/3263473080 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40a99c0 msgr2=0x7f23c40ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c37fe640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40a99c0 0x7f23c40ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c37fe640 1 -- 172.21.15.1:0/3263473080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ac004d50 msgr2=0x7f23c40ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c37fe640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ac004d50 0x7f23c40ac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c37fe640 1 -- 172.21.15.1:0/3263473080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c40acab0 con 0x7f23c40acda0 2024-09-15T21:56:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c27fc640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40a99c0 0x7f23c40ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:56:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.960+0000 7f23c2ffd640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ac004d50 0x7f23c40ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:56:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.964+0000 7f23c37fe640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23c40acda0 0x7f23c41e06c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00a830 tx=0x7f23ac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.964+0000 7f23abfff640 1 -- 172.21.15.1:0/3263473080 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc00a480 con 0x7f23c40acda0 2024-09-15T21:56:04.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.964+0000 7f23abfff640 1 -- 172.21.15.1:0/3263473080 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc0aa8a0 con 0x7f23c40acda0 2024-09-15T21:56:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.964+0000 7f23c99e2640 1 -- 172.21.15.1:0/3263473080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c40b3840 con 0x7f23c40acda0 2024-09-15T21:56:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.964+0000 7f23abfff640 1 -- 172.21.15.1:0/3263473080 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0aac50 con 0x7f23c40acda0 2024-09-15T21:56:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.964+0000 7f23c99e2640 1 -- 172.21.15.1:0/3263473080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c40ab3f0 con 0x7f23c40acda0 2024-09-15T21:56:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.964+0000 7f23c99e2640 1 -- 172.21.15.1:0/3263473080 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c41413b0 con 0x7f23c40acda0 2024-09-15T21:56:04.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.964+0000 7f23abfff640 1 -- 172.21.15.1:0/3263473080 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f23bc0b2400 con 0x7f23c40acda0 2024-09-15T21:56:04.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.964+0000 7f23abfff640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f23b00678f0 0x7f23b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:04.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.964+0000 7f23c2ffd640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f23b00678f0 0x7f23b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:04.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.964+0000 7f23abfff640 1 -- 172.21.15.1:0/3263473080 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f23bc123800 con 0x7f23c40acda0 2024-09-15T21:56:04.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.964+0000 7f23c2ffd640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f23b00678f0 0x7f23b0069db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009af0 tx=0x7f23b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:04.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:04.968+0000 7f23abfff640 1 -- 172.21.15.1:0/3263473080 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f23bc0ae030 con 0x7f23c40acda0 2024-09-15T21:56:05.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.128+0000 7f23c99e2640 1 -- 172.21.15.1:0/3263473080 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f23c40691c0 con 0x7f23b00678f0 2024-09-15T21:56:05.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.144+0000 7f23abfff640 1 -- 172.21.15.1:0/3263473080 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251935 (secure 0 0 0) 0x7f23c40691c0 con 0x7f23b00678f0 2024-09-15T21:56:05.152 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:05.153 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:56:05.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.148+0000 7f23c99e2640 1 -- 172.21.15.1:0/3263473080 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f23b00678f0 msgr2=0x7f23b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.148+0000 7f23c99e2640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f23b00678f0 0x7f23b0069db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009af0 tx=0x7f23b4008040 comp rx=0 tx=0).stop 2024-09-15T21:56:05.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.148+0000 7f23c99e2640 1 -- 172.21.15.1:0/3263473080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23c40acda0 msgr2=0x7f23c41e06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.148+0000 7f23c99e2640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23c40acda0 0x7f23c41e06c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00a830 tx=0x7f23ac005840 comp rx=0 tx=0).stop 2024-09-15T21:56:05.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.148+0000 7f23c99e2640 1 -- 172.21.15.1:0/3263473080 shutdown_connections 2024-09-15T21:56:05.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.148+0000 7f23c99e2640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f23c40acda0 0x7f23c41e06c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.148+0000 7f23c99e2640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f23c40a99c0 0x7f23c40ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.148+0000 7f23c99e2640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f23b00678f0 0x7f23b0069db0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.148+0000 7f23c99e2640 1 --2- 172.21.15.1:0/3263473080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ac004d50 0x7f23c40ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.148+0000 7f23c99e2640 1 -- 172.21.15.1:0/3263473080 >> 172.21.15.1:0/3263473080 conn(0x7f23c40bd2f0 msgr2=0x7f23c4145f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:05.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.148+0000 7f23c99e2640 1 -- 172.21.15.1:0/3263473080 shutdown_connections 2024-09-15T21:56:05.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.148+0000 7f23c99e2640 1 -- 172.21.15.1:0/3263473080 wait complete. 2024-09-15T21:56:05.170 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-15T21:56:05.090966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261644,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754713076,"statfs":{"total":773094113280,"available":772826189824,"internally_reserved":0,"allocated":3874816,"data_stored":2192156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.845032"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275375+0000","last_change":"2024-09-15T21:55:56.309097+0000","last_active":"2024-09-15T21:55:57.275375+0000","last_peered":"2024-09-15T21:55:57.275375+0000","last_clean":"2024-09-15T21:55:57.275375+0000","last_became_active":"2024-09-15T21:55:56.308483+0000","last_became_peered":"2024-09-15T21:55:56.308483+0000","last_unstale":"2024-09-15T21:55:57.275375+0000","last_undegraded":"2024-09-15T21:55:57.275375+0000","last_fullsized":"2024-09-15T21:55:57.275375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:49.573129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292131+0000","last_change":"2024-09-15T21:55:56.278159+0000","last_active":"2024-09-15T21:55:57.292131+0000","last_peered":"2024-09-15T21:55:57.292131+0000","last_clean":"2024-09-15T21:55:57.292131+0000","last_became_active":"2024-09-15T21:55:56.277403+0000","last_became_peered":"2024-09-15T21:55:56.277403+0000","last_unstale":"2024-09-15T21:55:57.292131+0000","last_undegraded":"2024-09-15T21:55:57.292131+0000","last_fullsized":"2024-09-15T21:55:57.292131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:02.021065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296131+0000","last_change":"2024-09-15T21:55:56.298221+0000","last_active":"2024-09-15T21:55:57.296131+0000","last_peered":"2024-09-15T21:55:57.296131+0000","last_clean":"2024-09-15T21:55:57.296131+0000","last_became_active":"2024-09-15T21:55:56.297538+0000","last_became_peered":"2024-09-15T21:55:56.297538+0000","last_unstale":"2024-09-15T21:55:57.296131+0000","last_undegraded":"2024-09-15T21:55:57.296131+0000","last_fullsized":"2024-09-15T21:55:57.296131+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:19.254994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275744+0000","last_change":"2024-09-15T21:55:56.290630+0000","last_active":"2024-09-15T21:55:57.275744+0000","last_peered":"2024-09-15T21:55:57.275744+0000","last_clean":"2024-09-15T21:55:57.275744+0000","last_became_active":"2024-09-15T21:55:56.288578+0000","last_became_peered":"2024-09-15T21:55:56.288578+0000","last_unstale":"2024-09-15T21:55:57.275744+0000","last_undegraded":"2024-09-15T21:55:57.275744+0000","last_fullsized":"2024-09-15T21:55:57.275744+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:10.140144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293463+0000","last_change":"2024-09-15T21:55:56.285178+0000","last_active":"2024-09-15T21:55:57.293463+0000","last_peered":"2024-09-15T21:55:57.293463+0000","last_clean":"2024-09-15T21:55:57.293463+0000","last_became_active":"2024-09-15T21:55:56.284915+0000","last_became_peered":"2024-09-15T21:55:56.284915+0000","last_unstale":"2024-09-15T21:55:57.293463+0000","last_undegraded":"2024-09-15T21:55:57.293463+0000","last_fullsized":"2024-09-15T21:55:57.293463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:53.134305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292340+0000","last_change":"2024-09-15T21:55:56.306995+0000","last_active":"2024-09-15T21:55:57.292340+0000","last_peered":"2024-09-15T21:55:57.292340+0000","last_clean":"2024-09-15T21:55:57.292340+0000","last_became_active":"2024-09-15T21:55:56.306687+0000","last_became_peered":"2024-09-15T21:55:56.306687+0000","last_unstale":"2024-09-15T21:55:57.292340+0000","last_undegraded":"2024-09-15T21:55:57.292340+0000","last_fullsized":"2024-09-15T21:55:57.292340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:55.596017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294848+0000","last_change":"2024-09-15T21:55:56.289977+0000","last_active":"2024-09-15T21:55:57.294848+0000","last_peered":"2024-09-15T21:55:57.294848+0000","last_clean":"2024-09-15T21:55:57.294848+0000","last_became_active":"2024-09-15T21:55:56.288235+0000","last_became_peered":"2024-09-15T21:55:56.288235+0000","last_unstale":"2024-09-15T21:55:57.294848+0000","last_undegraded":"2024-09-15T21:55:57.294848+0000","last_fullsized":"2024-09-15T21:55:57.294848+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:28.668639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294435+0000","last_change":"2024-09-15T21:55:56.274499+0000","last_active":"2024-09-15T21:55:57.294435+0000","last_peered":"2024-09-15T21:55:57.294435+0000","last_clean":"2024-09-15T21:55:57.294435+0000","last_became_active":"2024-09-15T21:55:56.273194+0000","last_became_peered":"2024-09-15T21:55:56.273194+0000","last_unstale":"2024-09-15T21:55:57.294435+0000","last_undegraded":"2024-09-15T21:55:57.294435+0000","last_fullsized":"2024-09-15T21:55:57.294435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:28.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276230+0000","last_change":"2024-09-15T21:55:56.295357+0000","last_active":"2024-09-15T21:55:57.276230+0000","last_peered":"2024-09-15T21:55:57.276230+0000","last_clean":"2024-09-15T21:55:57.276230+0000","last_became_active":"2024-09-15T21:55:56.294500+0000","last_became_peered":"2024-09-15T21:55:56.294500+0000","last_unstale":"2024-09-15T21:55:57.276230+0000","last_undegraded":"2024-09-15T21:55:57.276230+0000","last_fullsized":"2024-09-15T21:55:57.276230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:10.621648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276112+0000","last_change":"2024-09-15T21:55:56.288047+0000","last_active":"2024-09-15T21:55:57.276112+0000","last_peered":"2024-09-15T21:55:57.276112+0000","last_clean":"2024-09-15T21:55:57.276112+0000","last_became_active":"2024-09-15T21:55:56.287678+0000","last_became_peered":"2024-09-15T21:55:56.287678+0000","last_unstale":"2024-09-15T21:55:57.276112+0000","last_undegraded":"2024-09-15T21:55:57.276112+0000","last_fullsized":"2024-09-15T21:55:57.276112+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:03.320745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295306+0000","last_change":"2024-09-15T21:55:56.275939+0000","last_active":"2024-09-15T21:55:57.295306+0000","last_peered":"2024-09-15T21:55:57.295306+0000","last_clean":"2024-09-15T21:55:57.295306+0000","last_became_active":"2024-09-15T21:55:56.275185+0000","last_became_peered":"2024-09-15T21:55:56.275185+0000","last_unstale":"2024-09-15T21:55:57.295306+0000","last_undegraded":"2024-09-15T21:55:57.295306+0000","last_fullsized":"2024-09-15T21:55:57.295306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:04.577354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296198+0000","last_change":"2024-09-15T21:55:56.307216+0000","last_active":"2024-09-15T21:55:57.296198+0000","last_peered":"2024-09-15T21:55:57.296198+0000","last_clean":"2024-09-15T21:55:57.296198+0000","last_became_active":"2024-09-15T21:55:56.306508+0000","last_became_peered":"2024-09-15T21:55:56.306508+0000","last_unstale":"2024-09-15T21:55:57.296198+0000","last_undegraded":"2024-09-15T21:55:57.296198+0000","last_fullsized":"2024-09-15T21:55:57.296198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:52.572647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293562+0000","last_change":"2024-09-15T21:55:56.278716+0000","last_active":"2024-09-15T21:55:57.293562+0000","last_peered":"2024-09-15T21:55:57.293562+0000","last_clean":"2024-09-15T21:55:57.293562+0000","last_became_active":"2024-09-15T21:55:56.277722+0000","last_became_peered":"2024-09-15T21:55:56.277722+0000","last_unstale":"2024-09-15T21:55:57.293562+0000","last_undegraded":"2024-09-15T21:55:57.293562+0000","last_fullsized":"2024-09-15T21:55:57.293562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:18.528351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292525+0000","last_change":"2024-09-15T21:55:56.285279+0000","last_active":"2024-09-15T21:55:57.292525+0000","last_peered":"2024-09-15T21:55:57.292525+0000","last_clean":"2024-09-15T21:55:57.292525+0000","last_became_active":"2024-09-15T21:55:56.284896+0000","last_became_peered":"2024-09-15T21:55:56.284896+0000","last_unstale":"2024-09-15T21:55:57.292525+0000","last_undegraded":"2024-09-15T21:55:57.292525+0000","last_fullsized":"2024-09-15T21:55:57.292525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:58.953469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293739+0000","last_change":"2024-09-15T21:55:56.290484+0000","last_active":"2024-09-15T21:55:57.293739+0000","last_peered":"2024-09-15T21:55:57.293739+0000","last_clean":"2024-09-15T21:55:57.293739+0000","last_became_active":"2024-09-15T21:55:56.289602+0000","last_became_peered":"2024-09-15T21:55:56.289602+0000","last_unstale":"2024-09-15T21:55:57.293739+0000","last_undegraded":"2024-09-15T21:55:57.293739+0000","last_fullsized":"2024-09-15T21:55:57.293739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:55.481298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295625+0000","last_change":"2024-09-15T21:55:56.300687+0000","last_active":"2024-09-15T21:55:57.295625+0000","last_peered":"2024-09-15T21:55:57.295625+0000","last_clean":"2024-09-15T21:55:57.295625+0000","last_became_active":"2024-09-15T21:55:56.300004+0000","last_became_peered":"2024-09-15T21:55:56.300004+0000","last_unstale":"2024-09-15T21:55:57.295625+0000","last_undegraded":"2024-09-15T21:55:57.295625+0000","last_fullsized":"2024-09-15T21:55:57.295625+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:47.385096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295452+0000","last_change":"2024-09-15T21:55:56.277883+0000","last_active":"2024-09-15T21:55:57.295452+0000","last_peered":"2024-09-15T21:55:57.295452+0000","last_clean":"2024-09-15T21:55:57.295452+0000","last_became_active":"2024-09-15T21:55:56.277149+0000","last_became_peered":"2024-09-15T21:55:56.277149+0000","last_unstale":"2024-09-15T21:55:57.295452+0000","last_undegraded":"2024-09-15T21:55:57.295452+0000","last_fullsized":"2024-09-15T21:55:57.295452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:54.377784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292285+0000","last_change":"2024-09-15T21:55:56.290146+0000","last_active":"2024-09-15T21:55:57.292285+0000","last_peered":"2024-09-15T21:55:57.292285+0000","last_clean":"2024-09-15T21:55:57.292285+0000","last_became_active":"2024-09-15T21:55:56.289368+0000","last_became_peered":"2024-09-15T21:55:56.289368+0000","last_unstale":"2024-09-15T21:55:57.292285+0000","last_undegraded":"2024-09-15T21:55:57.292285+0000","last_fullsized":"2024-09-15T21:55:57.292285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:15.829500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292561+0000","last_change":"2024-09-15T21:55:56.296195+0000","last_active":"2024-09-15T21:55:57.292561+0000","last_peered":"2024-09-15T21:55:57.292561+0000","last_clean":"2024-09-15T21:55:57.292561+0000","last_became_active":"2024-09-15T21:55:56.295658+0000","last_became_peered":"2024-09-15T21:55:56.295658+0000","last_unstale":"2024-09-15T21:55:57.292561+0000","last_undegraded":"2024-09-15T21:55:57.292561+0000","last_fullsized":"2024-09-15T21:55:57.292561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:54.349480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293340+0000","last_change":"2024-09-15T21:55:56.308957+0000","last_active":"2024-09-15T21:55:57.293340+0000","last_peered":"2024-09-15T21:55:57.293340+0000","last_clean":"2024-09-15T21:55:57.293340+0000","last_became_active":"2024-09-15T21:55:56.308655+0000","last_became_peered":"2024-09-15T21:55:56.308655+0000","last_unstale":"2024-09-15T21:55:57.293340+0000","last_undegraded":"2024-09-15T21:55:57.293340+0000","last_fullsized":"2024-09-15T21:55:57.293340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:42.500109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275611+0000","last_change":"2024-09-15T21:55:56.288513+0000","last_active":"2024-09-15T21:55:57.275611+0000","last_peered":"2024-09-15T21:55:57.275611+0000","last_clean":"2024-09-15T21:55:57.275611+0000","last_became_active":"2024-09-15T21:55:56.287428+0000","last_became_peered":"2024-09-15T21:55:56.287428+0000","last_unstale":"2024-09-15T21:55:57.275611+0000","last_undegraded":"2024-09-15T21:55:57.275611+0000","last_fullsized":"2024-09-15T21:55:57.275611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:59.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275015+0000","last_change":"2024-09-15T21:55:56.282116+0000","last_active":"2024-09-15T21:55:57.275015+0000","last_peered":"2024-09-15T21:55:57.275015+0000","last_clean":"2024-09-15T21:55:57.275015+0000","last_became_active":"2024-09-15T21:55:56.281332+0000","last_became_peered":"2024-09-15T21:55:56.281332+0000","last_unstale":"2024-09-15T21:55:57.275015+0000","last_undegraded":"2024-09-15T21:55:57.275015+0000","last_fullsized":"2024-09-15T21:55:57.275015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:45.931965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.271720+0000","last_change":"2024-09-15T21:55:56.274809+0000","last_active":"2024-09-15T21:55:57.271720+0000","last_peered":"2024-09-15T21:55:57.271720+0000","last_clean":"2024-09-15T21:55:57.271720+0000","last_became_active":"2024-09-15T21:55:56.274053+0000","last_became_peered":"2024-09-15T21:55:56.274053+0000","last_unstale":"2024-09-15T21:55:57.271720+0000","last_undegraded":"2024-09-15T21:55:57.271720+0000","last_fullsized":"2024-09-15T21:55:57.271720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:44.628938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293704+0000","last_change":"2024-09-15T21:55:56.301926+0000","last_active":"2024-09-15T21:55:57.293704+0000","last_peered":"2024-09-15T21:55:57.293704+0000","last_clean":"2024-09-15T21:55:57.293704+0000","last_became_active":"2024-09-15T21:55:56.301421+0000","last_became_peered":"2024-09-15T21:55:56.301421+0000","last_unstale":"2024-09-15T21:55:57.293704+0000","last_undegraded":"2024-09-15T21:55:57.293704+0000","last_fullsized":"2024-09-15T21:55:57.293704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:44.075453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276690+0000","last_change":"2024-09-15T21:55:56.302114+0000","last_active":"2024-09-15T21:55:57.276690+0000","last_peered":"2024-09-15T21:55:57.276690+0000","last_clean":"2024-09-15T21:55:57.276690+0000","last_became_active":"2024-09-15T21:55:56.301895+0000","last_became_peered":"2024-09-15T21:55:56.301895+0000","last_unstale":"2024-09-15T21:55:57.276690+0000","last_undegraded":"2024-09-15T21:55:57.276690+0000","last_fullsized":"2024-09-15T21:55:57.276690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:19.254994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292443+0000","last_change":"2024-09-15T21:55:56.301445+0000","last_active":"2024-09-15T21:55:57.292443+0000","last_peered":"2024-09-15T21:55:57.292443+0000","last_clean":"2024-09-15T21:55:57.292443+0000","last_became_active":"2024-09-15T21:55:56.301128+0000","last_became_peered":"2024-09-15T21:55:56.301128+0000","last_unstale":"2024-09-15T21:55:57.292443+0000","last_undegraded":"2024-09-15T21:55:57.292443+0000","last_fullsized":"2024-09-15T21:55:57.292443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:19.929648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276161+0000","last_change":"2024-09-15T21:55:56.291047+0000","last_active":"2024-09-15T21:55:57.276161+0000","last_peered":"2024-09-15T21:55:57.276161+0000","last_clean":"2024-09-15T21:55:57.276161+0000","last_became_active":"2024-09-15T21:55:56.288458+0000","last_became_peered":"2024-09-15T21:55:56.288458+0000","last_unstale":"2024-09-15T21:55:57.276161+0000","last_undegraded":"2024-09-15T21:55:57.276161+0000","last_fullsized":"2024-09-15T21:55:57.276161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:27.877309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296251+0000","last_change":"2024-09-15T21:55:56.300691+0000","last_active":"2024-09-15T21:55:57.296251+0000","last_peered":"2024-09-15T21:55:57.296251+0000","last_clean":"2024-09-15T21:55:57.296251+0000","last_became_active":"2024-09-15T21:55:56.296903+0000","last_became_peered":"2024-09-15T21:55:56.296903+0000","last_unstale":"2024-09-15T21:55:57.296251+0000","last_undegraded":"2024-09-15T21:55:57.296251+0000","last_fullsized":"2024-09-15T21:55:57.296251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:57.994502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276042+0000","last_change":"2024-09-15T21:55:56.288287+0000","last_active":"2024-09-15T21:55:57.276042+0000","last_peered":"2024-09-15T21:55:57.276042+0000","last_clean":"2024-09-15T21:55:57.276042+0000","last_became_active":"2024-09-15T21:55:56.286326+0000","last_became_peered":"2024-09-15T21:55:56.286326+0000","last_unstale":"2024-09-15T21:55:57.276042+0000","last_undegraded":"2024-09-15T21:55:57.276042+0000","last_fullsized":"2024-09-15T21:55:57.276042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:20.885076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295041+0000","last_change":"2024-09-15T21:55:56.278013+0000","last_active":"2024-09-15T21:55:57.295041+0000","last_peered":"2024-09-15T21:55:57.295041+0000","last_clean":"2024-09-15T21:55:57.295041+0000","last_became_active":"2024-09-15T21:55:56.277260+0000","last_became_peered":"2024-09-15T21:55:56.277260+0000","last_unstale":"2024-09-15T21:55:57.295041+0000","last_undegraded":"2024-09-15T21:55:57.295041+0000","last_fullsized":"2024-09-15T21:55:57.295041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:07.090183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275879+0000","last_change":"2024-09-15T21:55:56.271183+0000","last_active":"2024-09-15T21:55:57.275879+0000","last_peered":"2024-09-15T21:55:57.275879+0000","last_clean":"2024-09-15T21:55:57.275879+0000","last_became_active":"2024-09-15T21:55:56.270445+0000","last_became_peered":"2024-09-15T21:55:56.270445+0000","last_unstale":"2024-09-15T21:55:57.275879+0000","last_undegraded":"2024-09-15T21:55:57.275879+0000","last_fullsized":"2024-09-15T21:55:57.275879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:05.944452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294405+0000","last_change":"2024-09-15T21:55:56.298083+0000","last_active":"2024-09-15T21:55:57.294405+0000","last_peered":"2024-09-15T21:55:57.294405+0000","last_clean":"2024-09-15T21:55:57.294405+0000","last_became_active":"2024-09-15T21:55:56.286370+0000","last_became_peered":"2024-09-15T21:55:56.286370+0000","last_unstale":"2024-09-15T21:55:57.294405+0000","last_undegraded":"2024-09-15T21:55:57.294405+0000","last_fullsized":"2024-09-15T21:55:57.294405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:40.099978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.272215+0000","last_change":"2024-09-15T21:55:56.279489+0000","last_active":"2024-09-15T21:55:57.272215+0000","last_peered":"2024-09-15T21:55:57.272215+0000","last_clean":"2024-09-15T21:55:57.272215+0000","last_became_active":"2024-09-15T21:55:56.278762+0000","last_became_peered":"2024-09-15T21:55:56.278762+0000","last_unstale":"2024-09-15T21:55:57.272215+0000","last_undegraded":"2024-09-15T21:55:57.272215+0000","last_fullsized":"2024-09-15T21:55:57.272215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:20.885076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275696+0000","last_change":"2024-09-15T21:55:55.249652+0000","last_active":"2024-09-15T21:55:57.275696+0000","last_peered":"2024-09-15T21:55:57.275696+0000","last_clean":"2024-09-15T21:55:57.275696+0000","last_became_active":"2024-09-15T21:55:55.248947+0000","last_became_peered":"2024-09-15T21:55:55.248947+0000","last_unstale":"2024-09-15T21:55:57.275696+0000","last_undegraded":"2024-09-15T21:55:57.275696+0000","last_fullsized":"2024-09-15T21:55:57.275696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:52.957424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276509+0000","last_change":"2024-09-15T21:55:56.269308+0000","last_active":"2024-09-15T21:55:57.276509+0000","last_peered":"2024-09-15T21:55:57.276509+0000","last_clean":"2024-09-15T21:55:57.276509+0000","last_became_active":"2024-09-15T21:55:56.268535+0000","last_became_peered":"2024-09-15T21:55:56.268535+0000","last_unstale":"2024-09-15T21:55:57.276509+0000","last_undegraded":"2024-09-15T21:55:57.276509+0000","last_fullsized":"2024-09-15T21:55:57.276509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:45.931965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.272275+0000","last_change":"2024-09-15T21:55:55.240388+0000","last_active":"2024-09-15T21:55:57.272275+0000","last_peered":"2024-09-15T21:55:57.272275+0000","last_clean":"2024-09-15T21:55:57.272275+0000","last_became_active":"2024-09-15T21:55:55.239837+0000","last_became_peered":"2024-09-15T21:55:55.239837+0000","last_unstale":"2024-09-15T21:55:57.272275+0000","last_undegraded":"2024-09-15T21:55:57.272275+0000","last_fullsized":"2024-09-15T21:55:57.272275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:52.957424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276971+0000","last_change":"2024-09-15T21:55:56.293316+0000","last_active":"2024-09-15T21:55:57.276971+0000","last_peered":"2024-09-15T21:55:57.276971+0000","last_clean":"2024-09-15T21:55:57.276971+0000","last_became_active":"2024-09-15T21:55:56.292540+0000","last_became_peered":"2024-09-15T21:55:56.292540+0000","last_unstale":"2024-09-15T21:55:57.276971+0000","last_undegraded":"2024-09-15T21:55:57.276971+0000","last_fullsized":"2024-09-15T21:55:57.276971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:52.607353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292841+0000","last_change":"2024-09-15T21:55:55.240018+0000","last_active":"2024-09-15T21:55:57.292841+0000","last_peered":"2024-09-15T21:55:57.292841+0000","last_clean":"2024-09-15T21:55:57.292841+0000","last_became_active":"2024-09-15T21:55:55.239512+0000","last_became_peered":"2024-09-15T21:55:55.239512+0000","last_unstale":"2024-09-15T21:55:57.292841+0000","last_undegraded":"2024-09-15T21:55:57.292841+0000","last_fullsized":"2024-09-15T21:55:57.292841+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:19.876529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276095+0000","last_change":"2024-09-15T21:55:56.291341+0000","last_active":"2024-09-15T21:55:57.276095+0000","last_peered":"2024-09-15T21:55:57.276095+0000","last_clean":"2024-09-15T21:55:57.276095+0000","last_became_active":"2024-09-15T21:55:56.291003+0000","last_became_peered":"2024-09-15T21:55:56.291003+0000","last_unstale":"2024-09-15T21:55:57.276095+0000","last_undegraded":"2024-09-15T21:55:57.276095+0000","last_fullsized":"2024-09-15T21:55:57.276095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:55.481298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293444+0000","last_change":"2024-09-15T21:55:55.241122+0000","last_active":"2024-09-15T21:55:57.293444+0000","last_peered":"2024-09-15T21:55:57.293444+0000","last_clean":"2024-09-15T21:55:57.293444+0000","last_became_active":"2024-09-15T21:55:55.240704+0000","last_became_peered":"2024-09-15T21:55:55.240704+0000","last_unstale":"2024-09-15T21:55:57.293444+0000","last_undegraded":"2024-09-15T21:55:57.293444+0000","last_fullsized":"2024-09-15T21:55:57.293444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:13.090176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295034+0000","last_change":"2024-09-15T21:55:56.288570+0000","last_active":"2024-09-15T21:55:57.295034+0000","last_peered":"2024-09-15T21:55:57.295034+0000","last_clean":"2024-09-15T21:55:57.295034+0000","last_became_active":"2024-09-15T21:55:56.279697+0000","last_became_peered":"2024-09-15T21:55:56.279697+0000","last_unstale":"2024-09-15T21:55:57.295034+0000","last_undegraded":"2024-09-15T21:55:57.295034+0000","last_fullsized":"2024-09-15T21:55:57.295034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:44.393748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276185+0000","last_change":"2024-09-15T21:55:55.260925+0000","last_active":"2024-09-15T21:55:57.276185+0000","last_peered":"2024-09-15T21:55:57.276185+0000","last_clean":"2024-09-15T21:55:57.276185+0000","last_became_active":"2024-09-15T21:55:55.257306+0000","last_became_peered":"2024-09-15T21:55:55.257306+0000","last_unstale":"2024-09-15T21:55:57.276185+0000","last_undegraded":"2024-09-15T21:55:57.276185+0000","last_fullsized":"2024-09-15T21:55:57.276185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:45.804383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295031+0000","last_change":"2024-09-15T21:55:56.307263+0000","last_active":"2024-09-15T21:55:57.295031+0000","last_peered":"2024-09-15T21:55:57.295031+0000","last_clean":"2024-09-15T21:55:57.295031+0000","last_became_active":"2024-09-15T21:55:56.306423+0000","last_became_peered":"2024-09-15T21:55:56.306423+0000","last_unstale":"2024-09-15T21:55:57.295031+0000","last_undegraded":"2024-09-15T21:55:57.295031+0000","last_fullsized":"2024-09-15T21:55:57.295031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:03.320745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274940+0000","last_change":"2024-09-15T21:55:55.261177+0000","last_active":"2024-09-15T21:55:57.274940+0000","last_peered":"2024-09-15T21:55:57.274940+0000","last_clean":"2024-09-15T21:55:57.274940+0000","last_became_active":"2024-09-15T21:55:55.256722+0000","last_became_peered":"2024-09-15T21:55:55.256722+0000","last_unstale":"2024-09-15T21:55:57.274940+0000","last_undegraded":"2024-09-15T21:55:57.274940+0000","last_fullsized":"2024-09-15T21:55:57.274940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:24.321134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274372+0000","last_change":"2024-09-15T21:55:56.277730+0000","last_active":"2024-09-15T21:55:57.274372+0000","last_peered":"2024-09-15T21:55:57.274372+0000","last_clean":"2024-09-15T21:55:57.274372+0000","last_became_active":"2024-09-15T21:55:56.276955+0000","last_became_peered":"2024-09-15T21:55:56.276955+0000","last_unstale":"2024-09-15T21:55:57.274372+0000","last_undegraded":"2024-09-15T21:55:57.274372+0000","last_fullsized":"2024-09-15T21:55:57.274372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:05.944452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.291601+0000","last_change":"2024-09-15T21:55:55.235928+0000","last_active":"2024-09-15T21:55:57.291601+0000","last_peered":"2024-09-15T21:55:57.291601+0000","last_clean":"2024-09-15T21:55:57.291601+0000","last_became_active":"2024-09-15T21:55:55.235501+0000","last_became_peered":"2024-09-15T21:55:55.235501+0000","last_unstale":"2024-09-15T21:55:57.291601+0000","last_undegraded":"2024-09-15T21:55:57.291601+0000","last_fullsized":"2024-09-15T21:55:57.291601+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:48.564582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275375+0000","last_change":"2024-09-15T21:55:56.307601+0000","last_active":"2024-09-15T21:55:57.275375+0000","last_peered":"2024-09-15T21:55:57.275375+0000","last_clean":"2024-09-15T21:55:57.275375+0000","last_became_active":"2024-09-15T21:55:56.306954+0000","last_became_peered":"2024-09-15T21:55:56.306954+0000","last_unstale":"2024-09-15T21:55:57.275375+0000","last_undegraded":"2024-09-15T21:55:57.275375+0000","last_fullsized":"2024-09-15T21:55:57.275375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:04:33.263108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274640+0000","last_change":"2024-09-15T21:55:55.262772+0000","last_active":"2024-09-15T21:55:57.274640+0000","last_peered":"2024-09-15T21:55:57.274640+0000","last_clean":"2024-09-15T21:55:57.274640+0000","last_became_active":"2024-09-15T21:55:55.262001+0000","last_became_peered":"2024-09-15T21:55:55.262001+0000","last_unstale":"2024-09-15T21:55:57.274640+0000","last_undegraded":"2024-09-15T21:55:57.274640+0000","last_fullsized":"2024-09-15T21:55:57.274640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:34:47.778872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296661+0000","last_change":"2024-09-15T21:55:56.308818+0000","last_active":"2024-09-15T21:55:57.296661+0000","last_peered":"2024-09-15T21:55:57.296661+0000","last_clean":"2024-09-15T21:55:57.296661+0000","last_became_active":"2024-09-15T21:55:56.306527+0000","last_became_peered":"2024-09-15T21:55:56.306527+0000","last_unstale":"2024-09-15T21:55:57.296661+0000","last_undegraded":"2024-09-15T21:55:57.296661+0000","last_fullsized":"2024-09-15T21:55:57.296661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:10.855416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292871+0000","last_change":"2024-09-15T21:55:55.251449+0000","last_active":"2024-09-15T21:55:57.292871+0000","last_peered":"2024-09-15T21:55:57.292871+0000","last_clean":"2024-09-15T21:55:57.292871+0000","last_became_active":"2024-09-15T21:55:55.251192+0000","last_became_peered":"2024-09-15T21:55:55.251192+0000","last_unstale":"2024-09-15T21:55:57.292871+0000","last_undegraded":"2024-09-15T21:55:57.292871+0000","last_fullsized":"2024-09-15T21:55:57.292871+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:44.923418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292779+0000","last_change":"2024-09-15T21:55:56.289552+0000","last_active":"2024-09-15T21:55:57.292779+0000","last_peered":"2024-09-15T21:55:57.292779+0000","last_clean":"2024-09-15T21:55:57.292779+0000","last_became_active":"2024-09-15T21:55:56.289265+0000","last_became_peered":"2024-09-15T21:55:56.289265+0000","last_unstale":"2024-09-15T21:55:57.292779+0000","last_undegraded":"2024-09-15T21:55:57.292779+0000","last_fullsized":"2024-09-15T21:55:57.292779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:51.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.272346+0000","last_change":"2024-09-15T21:55:55.234667+0000","last_active":"2024-09-15T21:55:57.272346+0000","last_peered":"2024-09-15T21:55:57.272346+0000","last_clean":"2024-09-15T21:55:57.272346+0000","last_became_active":"2024-09-15T21:55:55.234277+0000","last_became_peered":"2024-09-15T21:55:55.234277+0000","last_unstale":"2024-09-15T21:55:57.272346+0000","last_undegraded":"2024-09-15T21:55:57.272346+0000","last_fullsized":"2024-09-15T21:55:57.272346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:59.580457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.292302+0000","last_change":"2024-09-15T21:55:56.301300+0000","last_active":"2024-09-15T21:55:57.292302+0000","last_peered":"2024-09-15T21:55:57.292302+0000","last_clean":"2024-09-15T21:55:57.292302+0000","last_became_active":"2024-09-15T21:55:56.300947+0000","last_became_peered":"2024-09-15T21:55:56.300947+0000","last_unstale":"2024-09-15T21:55:57.292302+0000","last_undegraded":"2024-09-15T21:55:57.292302+0000","last_fullsized":"2024-09-15T21:55:57.292302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:00.980630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296397+0000","last_change":"2024-09-15T21:55:55.246855+0000","last_active":"2024-09-15T21:55:57.296397+0000","last_peered":"2024-09-15T21:55:57.296397+0000","last_clean":"2024-09-15T21:55:57.296397+0000","last_became_active":"2024-09-15T21:55:55.245901+0000","last_became_peered":"2024-09-15T21:55:55.245901+0000","last_unstale":"2024-09-15T21:55:57.296397+0000","last_undegraded":"2024-09-15T21:55:57.296397+0000","last_fullsized":"2024-09-15T21:55:57.296397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:09.182420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296029+0000","last_change":"2024-09-15T21:55:56.299605+0000","last_active":"2024-09-15T21:55:57.296029+0000","last_peered":"2024-09-15T21:55:57.296029+0000","last_clean":"2024-09-15T21:55:57.296029+0000","last_became_active":"2024-09-15T21:55:56.298953+0000","last_became_peered":"2024-09-15T21:55:56.298953+0000","last_unstale":"2024-09-15T21:55:57.296029+0000","last_undegraded":"2024-09-15T21:55:57.296029+0000","last_fullsized":"2024-09-15T21:55:57.296029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:27.877309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'6","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293104+0000","last_change":"2024-09-15T21:55:55.239321+0000","last_active":"2024-09-15T21:55:57.293104+0000","last_peered":"2024-09-15T21:55:57.293104+0000","last_clean":"2024-09-15T21:55:57.293104+0000","last_became_active":"2024-09-15T21:55:55.238833+0000","last_became_peered":"2024-09-15T21:55:55.238833+0000","last_unstale":"2024-09-15T21:55:57.293104+0000","last_undegraded":"2024-09-15T21:55:57.293104+0000","last_fullsized":"2024-09-15T21:55:57.293104+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:58.362609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275669+0000","last_change":"2024-09-15T21:55:56.307917+0000","last_active":"2024-09-15T21:55:57.275669+0000","last_peered":"2024-09-15T21:55:57.275669+0000","last_clean":"2024-09-15T21:55:57.275669+0000","last_became_active":"2024-09-15T21:55:56.307244+0000","last_became_peered":"2024-09-15T21:55:56.307244+0000","last_unstale":"2024-09-15T21:55:57.275669+0000","last_undegraded":"2024-09-15T21:55:57.275669+0000","last_fullsized":"2024-09-15T21:55:57.275669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:52.607353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276440+0000","last_change":"2024-09-15T21:55:55.262964+0000","last_active":"2024-09-15T21:55:57.276440+0000","last_peered":"2024-09-15T21:55:57.276440+0000","last_clean":"2024-09-15T21:55:57.276440+0000","last_became_active":"2024-09-15T21:55:55.262238+0000","last_became_peered":"2024-09-15T21:55:55.262238+0000","last_unstale":"2024-09-15T21:55:57.276440+0000","last_undegraded":"2024-09-15T21:55:57.276440+0000","last_fullsized":"2024-09-15T21:55:57.276440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:12.038959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.291928+0000","last_change":"2024-09-15T21:55:56.284783+0000","last_active":"2024-09-15T21:55:57.291928+0000","last_peered":"2024-09-15T21:55:57.291928+0000","last_clean":"2024-09-15T21:55:57.291928+0000","last_became_active":"2024-09-15T21:55:56.283805+0000","last_became_peered":"2024-09-15T21:55:56.283805+0000","last_unstale":"2024-09-15T21:55:57.291928+0000","last_undegraded":"2024-09-15T21:55:57.291928+0000","last_fullsized":"2024-09-15T21:55:57.291928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:10.855416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275636+0000","last_change":"2024-09-15T21:55:55.242337+0000","last_active":"2024-09-15T21:55:57.275636+0000","last_peered":"2024-09-15T21:55:57.275636+0000","last_clean":"2024-09-15T21:55:57.275636+0000","last_became_active":"2024-09-15T21:55:55.241660+0000","last_became_peered":"2024-09-15T21:55:55.241660+0000","last_unstale":"2024-09-15T21:55:57.275636+0000","last_undegraded":"2024-09-15T21:55:57.275636+0000","last_fullsized":"2024-09-15T21:55:57.275636+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:52.176799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294850+0000","last_change":"2024-09-15T21:55:56.286828+0000","last_active":"2024-09-15T21:55:57.294850+0000","last_peered":"2024-09-15T21:55:57.294850+0000","last_clean":"2024-09-15T21:55:57.294850+0000","last_became_active":"2024-09-15T21:55:56.279323+0000","last_became_peered":"2024-09-15T21:55:56.279323+0000","last_unstale":"2024-09-15T21:55:57.294850+0000","last_undegraded":"2024-09-15T21:55:57.294850+0000","last_fullsized":"2024-09-15T21:55:57.294850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:49.172006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.291620+0000","last_change":"2024-09-15T21:55:55.244961+0000","last_active":"2024-09-15T21:55:57.291620+0000","last_peered":"2024-09-15T21:55:57.291620+0000","last_clean":"2024-09-15T21:55:57.291620+0000","last_became_active":"2024-09-15T21:55:55.244608+0000","last_became_peered":"2024-09-15T21:55:55.244608+0000","last_unstale":"2024-09-15T21:55:57.291620+0000","last_undegraded":"2024-09-15T21:55:57.291620+0000","last_fullsized":"2024-09-15T21:55:57.291620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:15.089446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276240+0000","last_change":"2024-09-15T21:55:56.269510+0000","last_active":"2024-09-15T21:55:57.276240+0000","last_peered":"2024-09-15T21:55:57.276240+0000","last_clean":"2024-09-15T21:55:57.276240+0000","last_became_active":"2024-09-15T21:55:56.268792+0000","last_became_peered":"2024-09-15T21:55:56.268792+0000","last_unstale":"2024-09-15T21:55:57.276240+0000","last_undegraded":"2024-09-15T21:55:57.276240+0000","last_fullsized":"2024-09-15T21:55:57.276240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:44.628938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.291561+0000","last_change":"2024-09-15T21:55:55.239119+0000","last_active":"2024-09-15T21:55:57.291561+0000","last_peered":"2024-09-15T21:55:57.291561+0000","last_clean":"2024-09-15T21:55:57.291561+0000","last_became_active":"2024-09-15T21:55:55.238740+0000","last_became_peered":"2024-09-15T21:55:55.238740+0000","last_unstale":"2024-09-15T21:55:57.291561+0000","last_undegraded":"2024-09-15T21:55:57.291561+0000","last_fullsized":"2024-09-15T21:55:57.291561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:43.620391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276430+0000","last_change":"2024-09-15T21:55:56.311934+0000","last_active":"2024-09-15T21:55:57.276430+0000","last_peered":"2024-09-15T21:55:57.276430+0000","last_clean":"2024-09-15T21:55:57.276430+0000","last_became_active":"2024-09-15T21:55:56.311222+0000","last_became_peered":"2024-09-15T21:55:56.311222+0000","last_unstale":"2024-09-15T21:55:57.276430+0000","last_undegraded":"2024-09-15T21:55:57.276430+0000","last_fullsized":"2024-09-15T21:55:57.276430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:04:33.263108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276410+0000","last_change":"2024-09-15T21:55:55.237840+0000","last_active":"2024-09-15T21:55:57.276410+0000","last_peered":"2024-09-15T21:55:57.276410+0000","last_clean":"2024-09-15T21:55:57.276410+0000","last_became_active":"2024-09-15T21:55:55.237551+0000","last_became_peered":"2024-09-15T21:55:55.237551+0000","last_unstale":"2024-09-15T21:55:57.276410+0000","last_undegraded":"2024-09-15T21:55:57.276410+0000","last_fullsized":"2024-09-15T21:55:57.276410+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:59.580457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.296830+0000","last_change":"2024-09-15T21:55:56.309158+0000","last_active":"2024-09-15T21:55:57.296830+0000","last_peered":"2024-09-15T21:55:57.296830+0000","last_clean":"2024-09-15T21:55:57.296830+0000","last_became_active":"2024-09-15T21:55:56.307298+0000","last_became_peered":"2024-09-15T21:55:56.307298+0000","last_unstale":"2024-09-15T21:55:57.296830+0000","last_undegraded":"2024-09-15T21:55:57.296830+0000","last_fullsized":"2024-09-15T21:55:57.296830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:02.021065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275692+0000","last_change":"2024-09-15T21:55:55.262914+0000","last_active":"2024-09-15T21:55:57.275692+0000","last_peered":"2024-09-15T21:55:57.275692+0000","last_clean":"2024-09-15T21:55:57.275692+0000","last_became_active":"2024-09-15T21:55:55.262306+0000","last_became_peered":"2024-09-15T21:55:55.262306+0000","last_unstale":"2024-09-15T21:55:57.275692+0000","last_undegraded":"2024-09-15T21:55:57.275692+0000","last_fullsized":"2024-09-15T21:55:57.275692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:44.329135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275914+0000","last_change":"2024-09-15T21:55:56.282334+0000","last_active":"2024-09-15T21:55:57.275914+0000","last_peered":"2024-09-15T21:55:57.275914+0000","last_clean":"2024-09-15T21:55:57.275914+0000","last_became_active":"2024-09-15T21:55:56.281990+0000","last_became_peered":"2024-09-15T21:55:56.281990+0000","last_unstale":"2024-09-15T21:55:57.275914+0000","last_undegraded":"2024-09-15T21:55:57.275914+0000","last_fullsized":"2024-09-15T21:55:57.275914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:44.075453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276259+0000","last_change":"2024-09-15T21:55:55.255577+0000","last_active":"2024-09-15T21:55:57.276259+0000","last_peered":"2024-09-15T21:55:57.276259+0000","last_clean":"2024-09-15T21:55:57.276259+0000","last_became_active":"2024-09-15T21:55:55.254828+0000","last_became_peered":"2024-09-15T21:55:55.254828+0000","last_unstale":"2024-09-15T21:55:57.276259+0000","last_undegraded":"2024-09-15T21:55:57.276259+0000","last_fullsized":"2024-09-15T21:55:57.276259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:43.455863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293173+0000","last_change":"2024-09-15T21:55:56.267608+0000","last_active":"2024-09-15T21:55:57.293173+0000","last_peered":"2024-09-15T21:55:57.293173+0000","last_clean":"2024-09-15T21:55:57.293173+0000","last_became_active":"2024-09-15T21:55:56.266561+0000","last_became_peered":"2024-09-15T21:55:56.266561+0000","last_unstale":"2024-09-15T21:55:57.293173+0000","last_undegraded":"2024-09-15T21:55:57.293173+0000","last_fullsized":"2024-09-15T21:55:57.293173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:22.093251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276890+0000","last_change":"2024-09-15T21:55:55.265495+0000","last_active":"2024-09-15T21:55:57.276890+0000","last_peered":"2024-09-15T21:55:57.276890+0000","last_clean":"2024-09-15T21:55:57.276890+0000","last_became_active":"2024-09-15T21:55:55.256531+0000","last_became_peered":"2024-09-15T21:55:55.256531+0000","last_unstale":"2024-09-15T21:55:57.276890+0000","last_undegraded":"2024-09-15T21:55:57.276890+0000","last_fullsized":"2024-09-15T21:55:57.276890+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:03.652358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293350+0000","last_change":"2024-09-15T21:55:56.278289+0000","last_active":"2024-09-15T21:55:57.293350+0000","last_peered":"2024-09-15T21:55:57.293350+0000","last_clean":"2024-09-15T21:55:57.293350+0000","last_became_active":"2024-09-15T21:55:56.277211+0000","last_became_peered":"2024-09-15T21:55:56.277211+0000","last_unstale":"2024-09-15T21:55:57.293350+0000","last_undegraded":"2024-09-15T21:55:57.293350+0000","last_fullsized":"2024-09-15T21:55:57.293350+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:38.020249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.271993+0000","last_change":"2024-09-15T21:55:55.229233+0000","last_active":"2024-09-15T21:55:57.271993+0000","last_peered":"2024-09-15T21:55:57.271993+0000","last_clean":"2024-09-15T21:55:57.271993+0000","last_became_active":"2024-09-15T21:55:55.228846+0000","last_became_peered":"2024-09-15T21:55:55.228846+0000","last_unstale":"2024-09-15T21:55:57.271993+0000","last_undegraded":"2024-09-15T21:55:57.271993+0000","last_fullsized":"2024-09-15T21:55:57.271993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:23.173121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293839+0000","last_change":"2024-09-15T21:55:56.280721+0000","last_active":"2024-09-15T21:55:57.293839+0000","last_peered":"2024-09-15T21:55:57.293839+0000","last_clean":"2024-09-15T21:55:57.293839+0000","last_became_active":"2024-09-15T21:55:56.280319+0000","last_became_peered":"2024-09-15T21:55:56.280319+0000","last_unstale":"2024-09-15T21:55:57.293839+0000","last_undegraded":"2024-09-15T21:55:57.293839+0000","last_fullsized":"2024-09-15T21:55:57.293839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:00.996297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275335+0000","last_change":"2024-09-15T21:55:55.246626+0000","last_active":"2024-09-15T21:55:57.275335+0000","last_peered":"2024-09-15T21:55:57.275335+0000","last_clean":"2024-09-15T21:55:57.275335+0000","last_became_active":"2024-09-15T21:55:55.245886+0000","last_became_peered":"2024-09-15T21:55:55.245886+0000","last_unstale":"2024-09-15T21:55:57.275335+0000","last_undegraded":"2024-09-15T21:55:57.275335+0000","last_fullsized":"2024-09-15T21:55:57.275335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:52.176799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293170+0000","last_change":"2024-09-15T21:55:56.267393+0000","last_active":"2024-09-15T21:55:57.293170+0000","last_peered":"2024-09-15T21:55:57.293170+0000","last_clean":"2024-09-15T21:55:57.293170+0000","last_became_active":"2024-09-15T21:55:56.266556+0000","last_became_peered":"2024-09-15T21:55:56.266556+0000","last_unstale":"2024-09-15T21:55:57.293170+0000","last_undegraded":"2024-09-15T21:55:57.293170+0000","last_fullsized":"2024-09-15T21:55:57.293170+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:10.617836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274509+0000","last_change":"2024-09-15T21:55:55.261924+0000","last_active":"2024-09-15T21:55:57.274509+0000","last_peered":"2024-09-15T21:55:57.274509+0000","last_clean":"2024-09-15T21:55:57.274509+0000","last_became_active":"2024-09-15T21:55:55.261207+0000","last_became_peered":"2024-09-15T21:55:55.261207+0000","last_unstale":"2024-09-15T21:55:57.274509+0000","last_undegraded":"2024-09-15T21:55:57.274509+0000","last_fullsized":"2024-09-15T21:55:57.274509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:58.304088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.294629+0000","last_change":"2024-09-15T21:55:56.290591+0000","last_active":"2024-09-15T21:55:57.294629+0000","last_peered":"2024-09-15T21:55:57.294629+0000","last_clean":"2024-09-15T21:55:57.294629+0000","last_became_active":"2024-09-15T21:55:56.289211+0000","last_became_peered":"2024-09-15T21:55:56.289211+0000","last_unstale":"2024-09-15T21:55:57.294629+0000","last_undegraded":"2024-09-15T21:55:57.294629+0000","last_fullsized":"2024-09-15T21:55:57.294629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:53.958162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293530+0000","last_change":"2024-09-15T21:55:55.255670+0000","last_active":"2024-09-15T21:55:57.293530+0000","last_peered":"2024-09-15T21:55:57.293530+0000","last_clean":"2024-09-15T21:55:57.293530+0000","last_became_active":"2024-09-15T21:55:55.254936+0000","last_became_peered":"2024-09-15T21:55:55.254936+0000","last_unstale":"2024-09-15T21:55:57.293530+0000","last_undegraded":"2024-09-15T21:55:57.293530+0000","last_fullsized":"2024-09-15T21:55:57.293530+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:15.089446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.293617+0000","last_change":"2024-09-15T21:55:56.310032+0000","last_active":"2024-09-15T21:55:57.293617+0000","last_peered":"2024-09-15T21:55:57.293617+0000","last_clean":"2024-09-15T21:55:57.293617+0000","last_became_active":"2024-09-15T21:55:56.309746+0000","last_became_peered":"2024-09-15T21:55:56.309746+0000","last_unstale":"2024-09-15T21:55:57.293617+0000","last_undegraded":"2024-09-15T21:55:57.293617+0000","last_fullsized":"2024-09-15T21:55:57.293617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:13.626595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.276542+0000","last_change":"2024-09-15T21:55:55.247682+0000","last_active":"2024-09-15T21:55:57.276542+0000","last_peered":"2024-09-15T21:55:57.276542+0000","last_clean":"2024-09-15T21:55:57.276542+0000","last_became_active":"2024-09-15T21:55:55.247324+0000","last_became_peered":"2024-09-15T21:55:55.247324+0000","last_unstale":"2024-09-15T21:55:57.276542+0000","last_undegraded":"2024-09-15T21:55:57.276542+0000","last_fullsized":"2024-09-15T21:55:57.276542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:05.391521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.297099+0000","last_change":"2024-09-15T21:55:56.307459+0000","last_active":"2024-09-15T21:55:57.297099+0000","last_peered":"2024-09-15T21:55:57.297099+0000","last_clean":"2024-09-15T21:55:57.297099+0000","last_became_active":"2024-09-15T21:55:56.306864+0000","last_became_peered":"2024-09-15T21:55:56.306864+0000","last_unstale":"2024-09-15T21:55:57.297099+0000","last_undegraded":"2024-09-15T21:55:57.297099+0000","last_fullsized":"2024-09-15T21:55:57.297099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:15.829500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"30'1","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.272302+0000","last_change":"2024-09-15T21:55:55.238010+0000","last_active":"2024-09-15T21:55:57.272302+0000","last_peered":"2024-09-15T21:55:57.272302+0000","last_clean":"2024-09-15T21:55:57.272302+0000","last_became_active":"2024-09-15T21:55:55.237459+0000","last_became_peered":"2024-09-15T21:55:55.237459+0000","last_unstale":"2024-09-15T21:55:57.272302+0000","last_undegraded":"2024-09-15T21:55:57.272302+0000","last_fullsized":"2024-09-15T21:55:57.272302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:25.819619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.272137+0000","last_change":"2024-09-15T21:55:56.270706+0000","last_active":"2024-09-15T21:55:57.272137+0000","last_peered":"2024-09-15T21:55:57.272137+0000","last_clean":"2024-09-15T21:55:57.272137+0000","last_became_active":"2024-09-15T21:55:56.270300+0000","last_became_peered":"2024-09-15T21:55:56.270300+0000","last_unstale":"2024-09-15T21:55:57.272137+0000","last_undegraded":"2024-09-15T21:55:57.272137+0000","last_fullsized":"2024-09-15T21:55:57.272137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:59.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275857+0000","last_change":"2024-09-15T21:55:55.236793+0000","last_active":"2024-09-15T21:55:57.275857+0000","last_peered":"2024-09-15T21:55:57.275857+0000","last_clean":"2024-09-15T21:55:57.275857+0000","last_became_active":"2024-09-15T21:55:55.236398+0000","last_became_peered":"2024-09-15T21:55:55.236398+0000","last_unstale":"2024-09-15T21:55:57.275857+0000","last_undegraded":"2024-09-15T21:55:57.275857+0000","last_fullsized":"2024-09-15T21:55:57.275857+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:52.957424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275293+0000","last_change":"2024-09-15T21:55:56.267392+0000","last_active":"2024-09-15T21:55:57.275293+0000","last_peered":"2024-09-15T21:55:57.275293+0000","last_clean":"2024-09-15T21:55:57.275293+0000","last_became_active":"2024-09-15T21:55:56.266669+0000","last_became_peered":"2024-09-15T21:55:56.266669+0000","last_unstale":"2024-09-15T21:55:57.275293+0000","last_undegraded":"2024-09-15T21:55:57.275293+0000","last_fullsized":"2024-09-15T21:55:57.275293+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:52:16.097993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.272067+0000","last_change":"2024-09-15T21:55:55.236177+0000","last_active":"2024-09-15T21:55:57.272067+0000","last_peered":"2024-09-15T21:55:57.272067+0000","last_clean":"2024-09-15T21:55:57.272067+0000","last_became_active":"2024-09-15T21:55:55.235890+0000","last_became_peered":"2024-09-15T21:55:55.235890+0000","last_unstale":"2024-09-15T21:55:57.272067+0000","last_undegraded":"2024-09-15T21:55:57.272067+0000","last_fullsized":"2024-09-15T21:55:57.272067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:09.182420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.271935+0000","last_change":"2024-09-15T21:55:56.284897+0000","last_active":"2024-09-15T21:55:57.271935+0000","last_peered":"2024-09-15T21:55:57.271935+0000","last_clean":"2024-09-15T21:55:57.271935+0000","last_became_active":"2024-09-15T21:55:56.282272+0000","last_became_peered":"2024-09-15T21:55:56.282272+0000","last_unstale":"2024-09-15T21:55:57.271935+0000","last_undegraded":"2024-09-15T21:55:57.271935+0000","last_fullsized":"2024-09-15T21:55:57.271935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:45.931965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.275901+0000","last_change":"2024-09-15T21:55:55.247687+0000","last_active":"2024-09-15T21:55:57.275901+0000","last_peered":"2024-09-15T21:55:57.275901+0000","last_clean":"2024-09-15T21:55:57.275901+0000","last_became_active":"2024-09-15T21:55:55.247348+0000","last_became_peered":"2024-09-15T21:55:55.247348+0000","last_unstale":"2024-09-15T21:55:57.275901+0000","last_undegraded":"2024-09-15T21:55:57.275901+0000","last_fullsized":"2024-09-15T21:55:57.275901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:25.819619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.291668+0000","last_change":"2024-09-15T21:55:56.289584+0000","last_active":"2024-09-15T21:55:57.291668+0000","last_peered":"2024-09-15T21:55:57.291668+0000","last_clean":"2024-09-15T21:55:57.291668+0000","last_became_active":"2024-09-15T21:55:56.289148+0000","last_became_peered":"2024-09-15T21:55:56.289148+0000","last_unstale":"2024-09-15T21:55:57.291668+0000","last_undegraded":"2024-09-15T21:55:57.291668+0000","last_fullsized":"2024-09-15T21:55:57.291668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:57.994502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274820+0000","last_change":"2024-09-15T21:55:55.254121+0000","last_active":"2024-09-15T21:55:57.274820+0000","last_peered":"2024-09-15T21:55:57.274820+0000","last_clean":"2024-09-15T21:55:57.274820+0000","last_became_active":"2024-09-15T21:55:55.237665+0000","last_became_peered":"2024-09-15T21:55:55.237665+0000","last_unstale":"2024-09-15T21:55:57.274820+0000","last_undegraded":"2024-09-15T21:55:57.274820+0000","last_fullsized":"2024-09-15T21:55:57.274820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:52.176799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274642+0000","last_change":"2024-09-15T21:55:56.282098+0000","last_active":"2024-09-15T21:55:57.274642+0000","last_peered":"2024-09-15T21:55:57.274642+0000","last_clean":"2024-09-15T21:55:57.274642+0000","last_became_active":"2024-09-15T21:55:56.281081+0000","last_became_peered":"2024-09-15T21:55:56.281081+0000","last_unstale":"2024-09-15T21:55:57.274642+0000","last_undegraded":"2024-09-15T21:55:57.274642+0000","last_fullsized":"2024-09-15T21:55:57.274642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:44.628938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.291457+0000","last_change":"2024-09-15T21:55:55.253393+0000","last_active":"2024-09-15T21:55:57.291457+0000","last_peered":"2024-09-15T21:55:57.291457+0000","last_clean":"2024-09-15T21:55:57.291457+0000","last_became_active":"2024-09-15T21:55:55.253070+0000","last_became_peered":"2024-09-15T21:55:55.253070+0000","last_unstale":"2024-09-15T21:55:57.291457+0000","last_undegraded":"2024-09-15T21:55:57.291457+0000","last_fullsized":"2024-09-15T21:55:57.291457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:04.935905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295447+0000","last_change":"2024-09-15T21:55:56.269103+0000","last_active":"2024-09-15T21:55:57.295447+0000","last_peered":"2024-09-15T21:55:57.295447+0000","last_clean":"2024-09-15T21:55:57.295447+0000","last_became_active":"2024-09-15T21:55:56.268360+0000","last_became_peered":"2024-09-15T21:55:56.268360+0000","last_unstale":"2024-09-15T21:55:57.295447+0000","last_undegraded":"2024-09-15T21:55:57.295447+0000","last_fullsized":"2024-09-15T21:55:57.295447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:55.212487+0000","last_clean_scrub_stamp":"2024-09-15T21:55:55.212487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:11.274512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.274866+0000","last_change":"2024-09-15T21:55:55.269693+0000","last_active":"2024-09-15T21:55:57.274866+0000","last_peered":"2024-09-15T21:55:57.274866+0000","last_clean":"2024-09-15T21:55:57.274866+0000","last_became_active":"2024-09-15T21:55:55.268821+0000","last_became_peered":"2024-09-15T21:55:55.268821+0000","last_unstale":"2024-09-15T21:55:57.274866+0000","last_undegraded":"2024-09-15T21:55:57.274866+0000","last_fullsized":"2024-09-15T21:55:57.274866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:54.203940+0000","last_clean_scrub_stamp":"2024-09-15T21:55:54.203940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:58.304088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295729+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:57.295729+0000","last_peered":"2024-09-15T21:55:57.295729+0000","last_clean":"2024-09-15T21:55:57.295729+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:57.295729+0000","last_undegraded":"2024-09-15T21:55:57.295729+0000","last_fullsized":"2024-09-15T21:55:57.295729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":335872,"data_stored":126441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":335872,"data_stored":126497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":335872,"data_stored":125929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":344064,"data_stored":127459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":344064,"data_stored":127459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36256,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335584,"statfs":{"total":96636764160,"available":96599638016,"internally_reserved":0,"allocated":921600,"data_stored":716193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":925696,"data_stored":716283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35676,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336164,"statfs":{"total":96636764160,"available":96600231936,"internally_reserved":0,"allocated":331776,"data_stored":125895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:56:05.174 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T21:56:05.174 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T21:56:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc19d75a640 1 Processor -- start 2024-09-15T21:56:05.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc19d75a640 1 -- start start 2024-09-15T21:56:05.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc19d75a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc1980ae0f0 0x7fc1980afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:05.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc19d75a640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1980ae520 con 0x7fc19806d0d0 2024-09-15T21:56:05.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc19d75a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc19813ec80 con 0x7fc1980b5560 2024-09-15T21:56:05.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc19d75a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc1980b0300 con 0x7fc1980ae0f0 2024-09-15T21:56:05.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc1967fc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fc19806d0d0 0x7fc19814cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41402/0 (socket says 172.21.15.1:41402) 2024-09-15T21:56:05.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc1967fc640 1 -- 172.21.15.1:0/1226817035 learned_addr learned my addr 172.21.15.1:0/1226817035 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc1977fe640 1 --2- 172.21.15.1:0/1226817035 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc1980ae0f0 0x7fc1980afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2521244522 0 0) 0x7fc188001120 con 0x7fc19806d0d0 2024-09-15T21:56:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc184003530 con 0x7fc19806d0d0 2024-09-15T21:56:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1885935513 0 0) 0x7fc184003530 con 0x7fc19806d0d0 2024-09-15T21:56:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc1980ae0f0 msgr2=0x7fc1980afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 --2- 172.21.15.1:0/1226817035 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc1980ae0f0 0x7fc1980afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 >> v1:172.21.15.70:6789/0 conn(0x7fc1980b5560 legacy=0x7fc19813e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1980b5940 con 0x7fc19806d0d0 2024-09-15T21:56:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7fc188001850 con 0x7fc19806d0d0 2024-09-15T21:56:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 >> v1:172.21.15.1:6789/0 conn(0x7fc19806d0d0 legacy=0x7fc19814cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 --2- 172.21.15.1:0/1226817035 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc1980ae0f0 0x7fc1840039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 --2- 172.21.15.1:0/1226817035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc184003f70 0x7fc184004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:05.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 --2- 172.21.15.1:0/1226817035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc184004d50 0x7fc1840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc1980b0300 con 0x7fc184003f70 2024-09-15T21:56:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc18400bc10 con 0x7fc184004d50 2024-09-15T21:56:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc18400be10 con 0x7fc1980ae0f0 2024-09-15T21:56:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.344+0000 7fc1967fc640 1 --2- 172.21.15.1:0/1226817035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc184003f70 0x7fc184004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc196ffd640 1 --2- 172.21.15.1:0/1226817035 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc1980ae0f0 0x7fc1840039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc1977fe640 1 --2- 172.21.15.1:0/1226817035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc184004d50 0x7fc1840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc1967fc640 1 -- 172.21.15.1:0/1226817035 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc1980ae0f0 msgr2=0x7fc1840039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc1967fc640 1 --2- 172.21.15.1:0/1226817035 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc1980ae0f0 0x7fc1840039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc1967fc640 1 -- 172.21.15.1:0/1226817035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc184004d50 msgr2=0x7fc1840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc1967fc640 1 --2- 172.21.15.1:0/1226817035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc184004d50 0x7fc1840051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc1967fc640 1 -- 172.21.15.1:0/1226817035 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc184003530 con 0x7fc184003f70 2024-09-15T21:56:05.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc1967fc640 1 --2- 172.21.15.1:0/1226817035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc184003f70 0x7fc184004810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc18800c4c0 tx=0x7fc18801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9423f19fb70b1bc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:05.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18800c0e0 con 0x7fc184003f70 2024-09-15T21:56:05.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1880a9070 con 0x7fc184003f70 2024-09-15T21:56:05.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc195ffb640 1 -- 172.21.15.1:0/1226817035 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188005d80 con 0x7fc184003f70 2024-09-15T21:56:05.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc19d75a640 1 -- 172.21.15.1:0/1226817035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc184003f70 msgr2=0x7fc184004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc19d75a640 1 --2- 172.21.15.1:0/1226817035 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc184003f70 0x7fc184004810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc18800c4c0 tx=0x7fc18801cca0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc1977fe640 1 -- 172.21.15.1:0/1226817035 reap_dead start 2024-09-15T21:56:05.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc19d75a640 1 -- 172.21.15.1:0/1226817035 shutdown_connections 2024-09-15T21:56:05.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc19d75a640 1 -- 172.21.15.1:0/1226817035 >> 172.21.15.1:0/1226817035 conn(0x7fc19806c730 msgr2=0x7fc1980b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:05.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc19d75a640 1 -- 172.21.15.1:0/1226817035 shutdown_connections 2024-09-15T21:56:05.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.348+0000 7fc19d75a640 1 -- 172.21.15.1:0/1226817035 wait complete. 2024-09-15T21:56:05.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc19d75a640 1 Processor -- start 2024-09-15T21:56:05.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc19d75a640 1 -- start start 2024-09-15T21:56:05.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc19d75a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc184003f70 0x7fc19814d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:05.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc19d75a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc198070310 0x7fc198071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:05.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc19d75a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1981e0d40 0x7fc1981e11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:05.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc19d75a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc1980b4cf0 con 0x7fc1981e0d40 2024-09-15T21:56:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc19d75a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc198073ce0 con 0x7fc198070310 2024-09-15T21:56:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc19d75a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fc1980b4e70 con 0x7fc184003f70 2024-09-15T21:56:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc1977fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1981e0d40 0x7fc1981e11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc1977fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1981e0d40 0x7fc1981e11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51530/0 (socket says 172.21.15.1:51530) 2024-09-15T21:56:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc1977fe640 1 -- 172.21.15.1:0/1061543502 learned_addr learned my addr 172.21.15.1:0/1061543502 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc196ffd640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc184003f70 0x7fc19814d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc1967fc640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc198070310 0x7fc198071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc1977fe640 1 -- 172.21.15.1:0/1061543502 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc184003f70 msgr2=0x7fc19814d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc1977fe640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc184003f70 0x7fc19814d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc1977fe640 1 -- 172.21.15.1:0/1061543502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc198070310 msgr2=0x7fc198071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc1977fe640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc198070310 0x7fc198071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc1977fe640 1 -- 172.21.15.1:0/1061543502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1980707f0 con 0x7fc1981e0d40 2024-09-15T21:56:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc1977fe640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1981e0d40 0x7fc1981e11f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc198148b50 tx=0x7fc1900115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc18f7fe640 1 -- 172.21.15.1:0/1061543502 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190011db0 con 0x7fc1981e0d40 2024-09-15T21:56:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc18f7fe640 1 -- 172.21.15.1:0/1061543502 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19001b070 con 0x7fc1981e0d40 2024-09-15T21:56:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc19d75a640 1 -- 172.21.15.1:0/1061543502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1980724d0 con 0x7fc1981e0d40 2024-09-15T21:56:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc18f7fe640 1 -- 172.21.15.1:0/1061543502 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1900039a0 con 0x7fc1981e0d40 2024-09-15T21:56:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc19d75a640 1 -- 172.21.15.1:0/1061543502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc198143fb0 con 0x7fc1981e0d40 2024-09-15T21:56:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc19d75a640 1 -- 172.21.15.1:0/1061543502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc19813e570 con 0x7fc1981e0d40 2024-09-15T21:56:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc18f7fe640 1 -- 172.21.15.1:0/1061543502 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc190003b40 con 0x7fc1981e0d40 2024-09-15T21:56:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc18f7fe640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc1780678c0 0x7fc178069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.352+0000 7fc18f7fe640 1 -- 172.21.15.1:0/1061543502 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7fc1900864c0 con 0x7fc1981e0d40 2024-09-15T21:56:05.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.356+0000 7fc196ffd640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc1780678c0 0x7fc178069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:05.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.356+0000 7fc196ffd640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc1780678c0 0x7fc178069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc180005510 tx=0x7fc180009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:05.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.360+0000 7fc18f7fe640 1 -- 172.21.15.1:0/1061543502 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc190025020 con 0x7fc1981e0d40 2024-09-15T21:56:05.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.584+0000 7fc19d75a640 1 -- 172.21.15.1:0/1061543502 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc1980af350 con 0x7fc1981e0d40 2024-09-15T21:56:05.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.588+0000 7fc18f7fe640 1 -- 172.21.15.1:0/1061543502 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fc190057090 con 0x7fc1981e0d40 2024-09-15T21:56:05.592 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2024-09-15T21:56:05.593 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCMV+dmfpbrGRAA5tTriIldy8QYr+dZxosTvQ== 2024-09-15T21:56:05.593 INFO:teuthology.orchestra.run.smithi001.stdout: caps mds = "allow" 2024-09-15T21:56:05.593 INFO:teuthology.orchestra.run.smithi001.stdout: caps mon = "allow r" 2024-09-15T21:56:05.593 INFO:teuthology.orchestra.run.smithi001.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T21:56:05.593 INFO:teuthology.orchestra.run.smithi001.stderr:updated caps for client.0 2024-09-15T21:56:05.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.592+0000 7fc19d75a640 1 -- 172.21.15.1:0/1061543502 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc1780678c0 msgr2=0x7fc178069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.592+0000 7fc19d75a640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc1780678c0 0x7fc178069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc180005510 tx=0x7fc180009040 comp rx=0 tx=0).stop 2024-09-15T21:56:05.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.592+0000 7fc19d75a640 1 -- 172.21.15.1:0/1061543502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1981e0d40 msgr2=0x7fc1981e11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.592+0000 7fc19d75a640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1981e0d40 0x7fc1981e11f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc198148b50 tx=0x7fc1900115a0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.592+0000 7fc19d75a640 1 -- 172.21.15.1:0/1061543502 shutdown_connections 2024-09-15T21:56:05.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.592+0000 7fc19d75a640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1981e0d40 0x7fc1981e11f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.592+0000 7fc19d75a640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fc1780678c0 0x7fc178069d80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.592+0000 7fc19d75a640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc198070310 0x7fc198071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.592+0000 7fc19d75a640 1 --2- 172.21.15.1:0/1061543502 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc184003f70 0x7fc19814d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.592+0000 7fc19d75a640 1 -- 172.21.15.1:0/1061543502 >> 172.21.15.1:0/1061543502 conn(0x7fc19806c730 msgr2=0x7fc19813da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:05.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.592+0000 7fc19d75a640 1 -- 172.21.15.1:0/1061543502 shutdown_connections 2024-09-15T21:56:05.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.592+0000 7fc19d75a640 1 -- 172.21.15.1:0/1061543502 wait complete. 2024-09-15T21:56:05.614 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:56:05.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.728+0000 7f24932bd640 1 Processor -- start 2024-09-15T21:56:05.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.728+0000 7f24932bd640 1 -- start start 2024-09-15T21:56:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.728+0000 7f24932bd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f248c14ddd0 0x7f248c1501c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.728+0000 7f24932bd640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f248c0b5fb0 con 0x7f248c0b5b20 2024-09-15T21:56:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.728+0000 7f24932bd640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f248c072060 con 0x7f248c0b37f0 2024-09-15T21:56:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.728+0000 7f24932bd640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f248c072860 con 0x7f248c14ddd0 2024-09-15T21:56:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.728+0000 7f249185a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f248c14ddd0 0x7f248c1501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.728+0000 7f2490858640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f248c0b5b20 0x7f248c144470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41410/0 (socket says 172.21.15.1:41410) 2024-09-15T21:56:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.728+0000 7f2490858640 1 -- 172.21.15.1:0/2736686302 learned_addr learned my addr 172.21.15.1:0/2736686302 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.728+0000 7f249185a640 1 -- 172.21.15.1:0/2736686302 >> v1:172.21.15.70:6789/0 conn(0x7f248c0b37f0 legacy=0x7f248c067a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.728+0000 7f249185a640 1 -- 172.21.15.1:0/2736686302 >> v1:172.21.15.1:6789/0 conn(0x7f248c0b5b20 legacy=0x7f248c144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.728+0000 7f249185a640 1 -- 172.21.15.1:0/2736686302 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c072340 con 0x7f248c14ddd0 2024-09-15T21:56:05.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.728+0000 7f248bfff640 1 -- 172.21.15.1:0/2736686302 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705695958 0 0) 0x7f248c0b5fb0 con 0x7f248c0b5b20 2024-09-15T21:56:05.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f249185a640 1 --2- 172.21.15.1:0/2736686302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f248c14ddd0 0x7f248c1501c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f24840097c0 tx=0x7f248401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7af024c26d1e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:05.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f248bfff640 1 -- 172.21.15.1:0/2736686302 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24840b0070 con 0x7f248c14ddd0 2024-09-15T21:56:05.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f248bfff640 1 -- 172.21.15.1:0/2736686302 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24840ab600 con 0x7f248c14ddd0 2024-09-15T21:56:05.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f248bfff640 1 -- 172.21.15.1:0/2736686302 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24840ab9d0 con 0x7f248c14ddd0 2024-09-15T21:56:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 -- 172.21.15.1:0/2736686302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f248c14ddd0 msgr2=0x7f248c1501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 --2- 172.21.15.1:0/2736686302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f248c14ddd0 0x7f248c1501c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f24840097c0 tx=0x7f248401c410 comp rx=0 tx=0).stop 2024-09-15T21:56:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 -- 172.21.15.1:0/2736686302 shutdown_connections 2024-09-15T21:56:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 --2- 172.21.15.1:0/2736686302 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f248c14ddd0 0x7f248c1501c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 -- 172.21.15.1:0/2736686302 >> 172.21.15.1:0/2736686302 conn(0x7f248c0b63a0 msgr2=0x7f248c0b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 -- 172.21.15.1:0/2736686302 shutdown_connections 2024-09-15T21:56:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 -- 172.21.15.1:0/2736686302 wait complete. 2024-09-15T21:56:05.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 Processor -- start 2024-09-15T21:56:05.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 -- start start 2024-09-15T21:56:05.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f248c0b37f0 0x7f248c13d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:05.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f248c14ddd0 0x7f248c139710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:05.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f248c139300 0x7f248c1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f248c0b3bd0 con 0x7f248c139300 2024-09-15T21:56:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f248c073660 con 0x7f248c0b37f0 2024-09-15T21:56:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f248c0b3d50 con 0x7f248c14ddd0 2024-09-15T21:56:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f249185a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f248c139300 0x7f248c1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f249185a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f248c139300 0x7f248c1539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51556/0 (socket says 172.21.15.1:51556) 2024-09-15T21:56:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f249185a640 1 -- 172.21.15.1:0/2353243835 learned_addr learned my addr 172.21.15.1:0/2353243835 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f2491059640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f248c0b37f0 0x7f248c13d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f2490858640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f248c14ddd0 0x7f248c139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f249185a640 1 -- 172.21.15.1:0/2353243835 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f248c14ddd0 msgr2=0x7f248c139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f249185a640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f248c14ddd0 0x7f248c139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f249185a640 1 -- 172.21.15.1:0/2353243835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f248c0b37f0 msgr2=0x7f248c13d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f249185a640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f248c0b37f0 0x7f248c13d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f249185a640 1 -- 172.21.15.1:0/2353243835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c138820 con 0x7f248c139300 2024-09-15T21:56:05.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f249185a640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f248c139300 0x7f248c1539d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2484019020 tx=0x7f24840191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:05.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f2489ffb640 1 -- 172.21.15.1:0/2353243835 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24840b0040 con 0x7f248c139300 2024-09-15T21:56:05.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f2489ffb640 1 -- 172.21.15.1:0/2353243835 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24840b9070 con 0x7f248c139300 2024-09-15T21:56:05.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 -- 172.21.15.1:0/2353243835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248c138b00 con 0x7f248c139300 2024-09-15T21:56:05.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f2489ffb640 1 -- 172.21.15.1:0/2353243835 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24840b4650 con 0x7f248c139300 2024-09-15T21:56:05.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.732+0000 7f24932bd640 1 -- 172.21.15.1:0/2353243835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248c1e3770 con 0x7f248c139300 2024-09-15T21:56:05.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.736+0000 7f24932bd640 1 -- 172.21.15.1:0/2353243835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248c144470 con 0x7f248c139300 2024-09-15T21:56:05.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.736+0000 7f2489ffb640 1 -- 172.21.15.1:0/2353243835 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24840b47f0 con 0x7f248c139300 2024-09-15T21:56:05.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.736+0000 7f2489ffb640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f24780678c0 0x7f2478069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:05.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.736+0000 7f2489ffb640 1 -- 172.21.15.1:0/2353243835 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f248411f990 con 0x7f248c139300 2024-09-15T21:56:05.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.736+0000 7f2491059640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f24780678c0 0x7f2478069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:05.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.736+0000 7f2491059640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f24780678c0 0x7f2478069d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f247c0012f0 tx=0x7f247c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:05.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.740+0000 7f2489ffb640 1 -- 172.21.15.1:0/2353243835 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2484016090 con 0x7f248c139300 2024-09-15T21:56:05.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f24932bd640 1 -- 172.21.15.1:0/2353243835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f248c142f00 con 0x7f248c139300 2024-09-15T21:56:05.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f2489ffb640 1 -- 172.21.15.1:0/2353243835 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3570 (secure 0 0 0) 0x7f24840f0430 con 0x7f248c139300 2024-09-15T21:56:05.945 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:05.945 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"btime":"2024-09-15T21:55:59:270348+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/3285517009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3285517009},{"type":"v1","addr":"172.21.15.70:6833","nonce":3285517009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:55.607624+0000","modified":"2024-09-15T21:55:58.650952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4731":{"gid":4731,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3595905659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3595905659},{"type":"v1","addr":"172.21.15.1:6835","nonce":3595905659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4731,"qdb_cluster":[4731]},"id":2}]} 2024-09-15T21:56:05.945 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 17 2024-09-15T21:56:05.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f24932bd640 1 -- 172.21.15.1:0/2353243835 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f24780678c0 msgr2=0x7f2478069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f24932bd640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f24780678c0 0x7f2478069d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f247c0012f0 tx=0x7f247c009040 comp rx=0 tx=0).stop 2024-09-15T21:56:05.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f24932bd640 1 -- 172.21.15.1:0/2353243835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f248c139300 msgr2=0x7f248c1539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:05.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f24932bd640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f248c139300 0x7f248c1539d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2484019020 tx=0x7f24840191b0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f24932bd640 1 -- 172.21.15.1:0/2353243835 shutdown_connections 2024-09-15T21:56:05.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f24932bd640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f248c139300 0x7f248c1539d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f24932bd640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f248c14ddd0 0x7f248c139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f24932bd640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f24780678c0 0x7f2478069d80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f24932bd640 1 --2- 172.21.15.1:0/2353243835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f248c0b37f0 0x7f248c13d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:05.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f24932bd640 1 -- 172.21.15.1:0/2353243835 >> 172.21.15.1:0/2353243835 conn(0x7f248c0b63a0 msgr2=0x7f248c0b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:05.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f24932bd640 1 -- 172.21.15.1:0/2353243835 shutdown_connections 2024-09-15T21:56:05.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:05.940+0000 7f24932bd640 1 -- 172.21.15.1:0/2353243835 wait complete. 2024-09-15T21:56:06.166 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T21:55:55.607624+0000', 'modified': '2024-09-15T21:55:58.650952+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4731}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4731': {'gid': 4731, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.1:6835/3595905659', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.1:6834', 'nonce': 3595905659}, {'type': 'v1', 'addr': '172.21.15.1:6835', 'nonce': 3595905659}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4731, 'qdb_cluster': [4731]} 2024-09-15T21:56:06.166 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T21:56:06.166 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T21:56:06.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f76a008d640 1 Processor -- start 2024-09-15T21:56:06.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f76a008d640 1 -- start start 2024-09-15T21:56:06.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f76a008d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f769806d0d0 0x7f76980ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f76a008d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76980afdc0 0x7f769814edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f76a008d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f769813ec80 con 0x7f76980b5560 2024-09-15T21:56:06.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f76a008d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f76980b5940 con 0x7f769806d0d0 2024-09-15T21:56:06.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f76a008d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f769806dbd0 con 0x7f76980afdc0 2024-09-15T21:56:06.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f769de29640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f76980b5560 0x7f769813e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:41414/0 (socket says 172.21.15.1:41414) 2024-09-15T21:56:06.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f769de29640 1 -- 172.21.15.1:0/3734502267 learned_addr learned my addr 172.21.15.1:0/3734502267 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:06.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f769d628640 1 --2- 172.21.15.1:0/3734502267 >> v2:172.21.15.1:3300/0 conn(0x7f769806d0d0 0x7f76980ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f769e62a640 1 --2- 172.21.15.1:0/3734502267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76980afdc0 0x7f769814edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f769d628640 1 -- 172.21.15.1:0/3734502267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76980afdc0 msgr2=0x7f769814edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:06.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f769d628640 1 --2- 172.21.15.1:0/3734502267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76980afdc0 0x7f769814edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f769d628640 1 -- 172.21.15.1:0/3734502267 >> v1:172.21.15.1:6789/0 conn(0x7f76980b5560 legacy=0x7f769813e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.296+0000 7f769d628640 1 -- 172.21.15.1:0/3734502267 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769806deb0 con 0x7f769806d0d0 2024-09-15T21:56:06.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f769d628640 1 --2- 172.21.15.1:0/3734502267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f769806d0d0 0x7f76980ae0f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f76880097c0 tx=0x7f768801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc87fef696cbed92 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:06.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f769ce27640 1 -- 172.21.15.1:0/3734502267 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880b0070 con 0x7f769806d0d0 2024-09-15T21:56:06.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f769ce27640 1 -- 172.21.15.1:0/3734502267 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76880ab600 con 0x7f769806d0d0 2024-09-15T21:56:06.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f769ce27640 1 -- 172.21.15.1:0/3734502267 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880ab9d0 con 0x7f769806d0d0 2024-09-15T21:56:06.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f76a008d640 1 -- 172.21.15.1:0/3734502267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f769806d0d0 msgr2=0x7f76980ae0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f76a008d640 1 --2- 172.21.15.1:0/3734502267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f769806d0d0 0x7f76980ae0f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f76880097c0 tx=0x7f768801c380 comp rx=0 tx=0).stop 2024-09-15T21:56:06.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f76a008d640 1 -- 172.21.15.1:0/3734502267 shutdown_connections 2024-09-15T21:56:06.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f76a008d640 1 --2- 172.21.15.1:0/3734502267 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f76980afdc0 0x7f769814edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f76a008d640 1 --2- 172.21.15.1:0/3734502267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f769806d0d0 0x7f76980ae0f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f76a008d640 1 -- 172.21.15.1:0/3734502267 >> 172.21.15.1:0/3734502267 conn(0x7f769806c730 msgr2=0x7f76980b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:06.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f76a008d640 1 -- 172.21.15.1:0/3734502267 shutdown_connections 2024-09-15T21:56:06.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f76a008d640 1 -- 172.21.15.1:0/3734502267 wait complete. 2024-09-15T21:56:06.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f76a008d640 1 Processor -- start 2024-09-15T21:56:06.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.300+0000 7f76a008d640 1 -- start start 2024-09-15T21:56:06.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f76a008d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76980afdc0 0x7f7698072fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f76a008d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76980b5560 0x7f7698149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f76a008d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7698148b80 0x7f76981495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f76a008d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f76980b4e70 con 0x7f76980b5560 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f76a008d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f76980b4cf0 con 0x7f76980afdc0 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f76a008d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f7698151b20 con 0x7f7698148b80 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f769d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76980b5560 0x7f7698149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f769d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76980b5560 0x7f7698149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51570/0 (socket says 172.21.15.1:51570) 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f769d628640 1 -- 172.21.15.1:0/1395379955 learned_addr learned my addr 172.21.15.1:0/1395379955 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f769e62a640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7698148b80 0x7f76981495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f769de29640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76980afdc0 0x7f7698072fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f769d628640 1 -- 172.21.15.1:0/1395379955 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7698148b80 msgr2=0x7f76981495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f769d628640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7698148b80 0x7f76981495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f769d628640 1 -- 172.21.15.1:0/1395379955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76980afdc0 msgr2=0x7f7698072fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f769d628640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76980afdc0 0x7f7698072fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f769d628640 1 -- 172.21.15.1:0/1395379955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769814ae80 con 0x7f76980b5560 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f769de29640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76980afdc0 0x7f7698072fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:06.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f769d628640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76980b5560 0x7f7698149060 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f76880097c0 tx=0x7f7688019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:06.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f768e7fc640 1 -- 172.21.15.1:0/1395379955 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880b0040 con 0x7f76980b5560 2024-09-15T21:56:06.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f768e7fc640 1 -- 172.21.15.1:0/1395379955 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7688004030 con 0x7f76980b5560 2024-09-15T21:56:06.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f76a008d640 1 -- 172.21.15.1:0/1395379955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7698072180 con 0x7f76980b5560 2024-09-15T21:56:06.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f768e7fc640 1 -- 172.21.15.1:0/1395379955 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7688006e20 con 0x7f76980b5560 2024-09-15T21:56:06.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f76a008d640 1 -- 172.21.15.1:0/1395379955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76981df0f0 con 0x7f76980b5560 2024-09-15T21:56:06.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f768e7fc640 1 -- 172.21.15.1:0/1395379955 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7688003620 con 0x7f76980b5560 2024-09-15T21:56:06.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f768e7fc640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f767c0678c0 0x7f767c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f768e7fc640 1 -- 172.21.15.1:0/1395379955 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f768811fa50 con 0x7f76980b5560 2024-09-15T21:56:06.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.304+0000 7f769de29640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f767c0678c0 0x7f767c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769de29640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f767c0678c0 0x7f767c069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7694007fd0 tx=0x7f7694009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 Processor -- start 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 -- start start 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d0b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0b670 0x560c48d0ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0bf90 0x560c48d0c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560c48bf2b60 con 0x560c48d0b670 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560c48b59c70 con 0x560c48d11010 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x560c48affed0 con 0x560c48d0bf90 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0b670 0x560c48d0ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0b670 0x560c48d0ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51584/0 (socket says 172.21.15.1:51584) 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769d628640 1 -- 172.21.15.1:0/3749402811 learned_addr learned my addr 172.21.15.1:0/3749402811 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769de29640 1 --2- 172.21.15.1:0/3749402811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d0b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769e62a640 1 --2- 172.21.15.1:0/3749402811 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0bf90 0x560c48d0c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769d628640 1 -- 172.21.15.1:0/3749402811 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0bf90 msgr2=0x560c48d0c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:06.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769d628640 1 --2- 172.21.15.1:0/3749402811 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0bf90 0x560c48d0c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769d628640 1 -- 172.21.15.1:0/3749402811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 msgr2=0x560c48d0b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:06.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769d628640 1 --2- 172.21.15.1:0/3749402811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d0b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769d628640 1 -- 172.21.15.1:0/3749402811 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c48b11e50 con 0x560c48d0b670 2024-09-15T21:56:06.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769d628640 1 --2- 172.21.15.1:0/3749402811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0b670 0x560c48d0ba50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f76880ec380 tx=0x7f768801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a0be4e15dc5a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:06.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f767b7fe640 1 -- 172.21.15.1:0/3749402811 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880c1040 con 0x560c48d0b670 2024-09-15T21:56:06.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f767b7fe640 1 -- 172.21.15.1:0/3749402811 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76880ee220 con 0x560c48d0b670 2024-09-15T21:56:06.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f767b7fe640 1 -- 172.21.15.1:0/3749402811 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880ec590 con 0x560c48d0b670 2024-09-15T21:56:06.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 -- 172.21.15.1:0/3749402811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0b670 msgr2=0x560c48d0ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 --2- 172.21.15.1:0/3749402811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0b670 0x560c48d0ba50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f76880ec380 tx=0x7f768801c380 comp rx=0 tx=0).stop 2024-09-15T21:56:06.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 -- 172.21.15.1:0/3749402811 shutdown_connections 2024-09-15T21:56:06.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 --2- 172.21.15.1:0/3749402811 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0bf90 0x560c48d0c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 --2- 172.21.15.1:0/3749402811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0b670 0x560c48d0ba50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 --2- 172.21.15.1:0/3749402811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d0b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 -- 172.21.15.1:0/3749402811 >> 172.21.15.1:0/3749402811 conn(0x560c48d07620 msgr2=0x560c48d09a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:06.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 -- 172.21.15.1:0/3749402811 shutdown_connections 2024-09-15T21:56:06.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 -- 172.21.15.1:0/3749402811 wait complete. 2024-09-15T21:56:06.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 -- start start 2024-09-15T21:56:06.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 Processor -- start 2024-09-15T21:56:06.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 0x560c48d15cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d16230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d16770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560c48bbbb00 con 0x560c48d0bf90 2024-09-15T21:56:06.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560c48b34360 con 0x560c48d11010 2024-09-15T21:56:06.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x560c48b312d0 con 0x560c48d0b670 2024-09-15T21:56:06.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f76a3149000 10 client.0 _ll_register_callbacks cb 0x560c48cf6820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T21:56:06.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d16230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d16230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51588/0 (socket says 172.21.15.1:51588) 2024-09-15T21:56:06.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769d628640 1 -- 172.21.15.1:0/3673353330 learned_addr learned my addr 172.21.15.1:0/3673353330 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:06.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.308+0000 7f769de29640 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 0x560c48d15cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f769e62a640 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d16770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f769d628640 1 -- 172.21.15.1:0/3673353330 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 msgr2=0x560c48d15cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:06.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f769d628640 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 0x560c48d15cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f769d628640 1 -- 172.21.15.1:0/3673353330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 msgr2=0x560c48d16770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:06.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f769d628640 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d16770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f769d628640 1 -- 172.21.15.1:0/3673353330 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c48b00120 con 0x560c48d0bf90 2024-09-15T21:56:06.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f769e62a640 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d16770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:06.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f769d628640 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d16230 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f76880efc20 tx=0x7f768811dee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d0148f56acb979 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:06.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f7678ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T21:56:06.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f7678ff9640 1 -- 172.21.15.1:0/3673353330 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880c1070 con 0x560c48d0bf90 2024-09-15T21:56:06.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f7678ff9640 1 -- 172.21.15.1:0/3673353330 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f76880f8670 con 0x560c48d0bf90 2024-09-15T21:56:06.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 -- 172.21.15.1:0/3673353330 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76880ee220 con 0x560c48d0bf90 2024-09-15T21:56:06.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f7678ff9640 1 -- 172.21.15.1:0/3673353330 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f76880f8870 con 0x560c48d0bf90 2024-09-15T21:56:06.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 10 client.4920 fetch_fsmap learned FSMap version 17 2024-09-15T21:56:06.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 -- 172.21.15.1:0/3673353330 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x560c48af9450 con 0x560c48d0bf90 2024-09-15T21:56:06.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f7678ff9640 1 -- 172.21.15.1:0/3673353330 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76880ee220 con 0x560c48d0bf90 2024-09-15T21:56:06.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f7678ff9640 1 -- 172.21.15.1:0/3673353330 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 17) ==== 2292+0+0 (secure 0 0 0) 0x7f76880f3030 con 0x560c48d0bf90 2024-09-15T21:56:06.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 10 client.4920 fetch_fsmap finished waiting for FSMap version 17 2024-09-15T21:56:06.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 10 client.4920 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T21:56:06.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 20 client.4920 populate_metadata read hostname 'smithi001' 2024-09-15T21:56:06.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.1:6834/3595905659,v1:172.21.15.1:6835/3595905659] conn(0x560c48d4e530 0x560c48d50920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 4 client.4920 mds_command: new command op to 4731 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T21:56:06.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 -- 172.21.15.1:0/3673353330 --> [v2:172.21.15.1:6834/3595905659,v1:172.21.15.1:6835/3595905659] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c48af3c00 con 0x560c48d4e530 2024-09-15T21:56:06.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f769de29640 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.1:6834/3595905659,v1:172.21.15.1:6835/3595905659] conn(0x560c48d4e530 0x560c48d50920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f7678ff9640 10 client.4920 ms_handle_connect on v2:172.21.15.1:6834/3595905659 2024-09-15T21:56:06.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f769de29640 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.1:6834/3595905659,v1:172.21.15.1:6835/3595905659] conn(0x560c48d4e530 0x560c48d50920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e7f61ca3fdeae09 server_cookie=f0d4b35575446062 in_seq=0 out_seq=0 2024-09-15T21:56:06.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f7678ff9640 1 -- 172.21.15.1:0/3673353330 <== mds.0 v2:172.21.15.1:6834/3595905659 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560c48af3c00 con 0x560c48d4e530 2024-09-15T21:56:06.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f7678ff9640 10 client.4920 handle_command_reply: tid=0 2024-09-15T21:56:06.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 client.4920 shutdown 2024-09-15T21:56:06.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 -- 172.21.15.1:0/3673353330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 msgr2=0x560c48d16230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d16230 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f76880efc20 tx=0x7f768811dee0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 -- 172.21.15.1:0/3673353330 shutdown_connections 2024-09-15T21:56:06.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.1:6834/3595905659,v1:172.21.15.1:6835/3595905659] conn(0x560c48d4e530 0x560c48d50920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d16770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d16230 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 --2- 172.21.15.1:0/3673353330 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 0x560c48d15cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f7678ff9640 0 client.4920 ms_handle_reset on v2:172.21.15.1:6834/3595905659 2024-09-15T21:56:06.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 -- 172.21.15.1:0/3673353330 >> 172.21.15.1:0/3673353330 conn(0x560c48d07620 msgr2=0x560c48d0a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:06.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 -- 172.21.15.1:0/3673353330 shutdown_connections 2024-09-15T21:56:06.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 1 -- 172.21.15.1:0/3673353330 wait complete. 2024-09-15T21:56:06.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.312+0000 7f76a3149000 20 client.4920 trim_cache size 0 max 16384 2024-09-15T21:56:06.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 Processor -- start 2024-09-15T21:56:06.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 -- start start 2024-09-15T21:56:06.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 0x560c48d0ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d4b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d53950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f76981eae40 con 0x560c48d0bf90 2024-09-15T21:56:06.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7698068900 con 0x560c48d11010 2024-09-15T21:56:06.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x560c48b11ca0 con 0x560c48d0b670 2024-09-15T21:56:06.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f769d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d4b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f769d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d4b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51590/0 (socket says 172.21.15.1:51590) 2024-09-15T21:56:06.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f769d628640 1 -- 172.21.15.1:0/3067523480 learned_addr learned my addr 172.21.15.1:0/3067523480 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:06.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f769de29640 1 --2- 172.21.15.1:0/3067523480 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 0x560c48d0ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f769d628640 1 -- 172.21.15.1:0/3067523480 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 msgr2=0x560c48d0ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f769e62a640 1 --2- 172.21.15.1:0/3067523480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d53950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f769d628640 1 --2- 172.21.15.1:0/3067523480 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 0x560c48d0ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f769d628640 1 -- 172.21.15.1:0/3067523480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 msgr2=0x560c48d53950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f769d628640 1 --2- 172.21.15.1:0/3067523480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d53950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f769d628640 1 -- 172.21.15.1:0/3067523480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c48ae0fd0 con 0x560c48d0bf90 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f769d628640 1 --2- 172.21.15.1:0/3067523480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d4b8f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f76880f85d0 tx=0x7f76880c1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ed10d308261e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f767affd640 1 -- 172.21.15.1:0/3067523480 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880edfc0 con 0x560c48d0bf90 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f767affd640 1 -- 172.21.15.1:0/3067523480 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7688109050 con 0x560c48d0bf90 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f767affd640 1 -- 172.21.15.1:0/3067523480 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7688004400 con 0x560c48d0bf90 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 -- 172.21.15.1:0/3067523480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 msgr2=0x560c48d4b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 --2- 172.21.15.1:0/3067523480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d4b8f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f76880f85d0 tx=0x7f76880c1000 comp rx=0 tx=0).stop 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 -- 172.21.15.1:0/3067523480 shutdown_connections 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 --2- 172.21.15.1:0/3067523480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d53950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 --2- 172.21.15.1:0/3067523480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d4b8f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 --2- 172.21.15.1:0/3067523480 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 0x560c48d0ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 -- 172.21.15.1:0/3067523480 >> 172.21.15.1:0/3067523480 conn(0x560c48d07620 msgr2=0x560c48d4b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:06.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 -- 172.21.15.1:0/3067523480 shutdown_connections 2024-09-15T21:56:06.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.332+0000 7f76a3149000 1 -- 172.21.15.1:0/3067523480 wait complete. 2024-09-15T21:56:06.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 -- start start 2024-09-15T21:56:06.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 Processor -- start 2024-09-15T21:56:06.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 0x560c48d52880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d52dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d53300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560c48b5e2a0 con 0x560c48d0bf90 2024-09-15T21:56:06.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560c48b58f80 con 0x560c48d11010 2024-09-15T21:56:06.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x560c48b180f0 con 0x560c48d0b670 2024-09-15T21:56:06.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 10 client.0 _ll_register_callbacks cb 0x7f76880f0640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T21:56:06.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d52dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769d628640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d52dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51604/0 (socket says 172.21.15.1:51604) 2024-09-15T21:56:06.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769d628640 1 -- 172.21.15.1:0/2913156950 learned_addr learned my addr 172.21.15.1:0/2913156950 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:06.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769de29640 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 0x560c48d52880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769e62a640 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d53300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769d628640 1 -- 172.21.15.1:0/2913156950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 msgr2=0x560c48d52880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769d628640 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 0x560c48d52880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769d628640 1 -- 172.21.15.1:0/2913156950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 msgr2=0x560c48d53300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769d628640 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d53300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769d628640 1 -- 172.21.15.1:0/2913156950 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c48bdc750 con 0x560c48d0bf90 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769e62a640 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d53300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769d628640 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d52dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f76880ec8a0 tx=0x7f7688009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f77dbf8ce375917 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f7678ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f7678ff9640 1 -- 172.21.15.1:0/2913156950 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880fc070 con 0x560c48d0bf90 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f7678ff9640 1 -- 172.21.15.1:0/2913156950 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f76880ebc70 con 0x560c48d0bf90 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 -- 172.21.15.1:0/2913156950 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7688109050 con 0x560c48d0bf90 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f7678ff9640 1 -- 172.21.15.1:0/2913156950 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f76880c1050 con 0x560c48d0bf90 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 10 client.4926 fetch_fsmap learned FSMap version 17 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 -- 172.21.15.1:0/2913156950 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x560c48ae7a30 con 0x560c48d0bf90 2024-09-15T21:56:06.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f7678ff9640 1 -- 172.21.15.1:0/2913156950 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7688109050 con 0x560c48d0bf90 2024-09-15T21:56:06.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f7678ff9640 1 -- 172.21.15.1:0/2913156950 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 17) ==== 2292+0+0 (secure 0 0 0) 0x7f76880f3070 con 0x560c48d0bf90 2024-09-15T21:56:06.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 10 client.4926 fetch_fsmap finished waiting for FSMap version 17 2024-09-15T21:56:06.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 10 client.4926 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T21:56:06.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 20 client.4926 populate_metadata read hostname 'smithi001' 2024-09-15T21:56:06.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.1:6834/3595905659,v1:172.21.15.1:6835/3595905659] conn(0x560c48d53cc0 0x560c48d540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 4 client.4926 mds_command: new command op to 4731 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T21:56:06.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 -- 172.21.15.1:0/2913156950 --> [v2:172.21.15.1:6834/3595905659,v1:172.21.15.1:6835/3595905659] -- command(tid 0: {"prefix": "status"}) -- 0x560c48b673a0 con 0x560c48d53cc0 2024-09-15T21:56:06.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769de29640 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.1:6834/3595905659,v1:172.21.15.1:6835/3595905659] conn(0x560c48d53cc0 0x560c48d540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f7678ff9640 10 client.4926 ms_handle_connect on v2:172.21.15.1:6834/3595905659 2024-09-15T21:56:06.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f769de29640 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.1:6834/3595905659,v1:172.21.15.1:6835/3595905659] conn(0x560c48d53cc0 0x560c48d540a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78cfb10b33a3d3fe server_cookie=d8d347f04ae64beb in_seq=0 out_seq=0 2024-09-15T21:56:06.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f7678ff9640 1 -- 172.21.15.1:0/2913156950 <== mds.0 v2:172.21.15.1:6834/3595905659 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x560c48b673a0 con 0x560c48d53cc0 2024-09-15T21:56:06.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f7678ff9640 10 client.4926 handle_command_reply: tid=0 2024-09-15T21:56:06.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 client.4926 shutdown 2024-09-15T21:56:06.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 -- 172.21.15.1:0/2913156950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 msgr2=0x560c48d52dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d52dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f76880ec8a0 tx=0x7f7688009190 comp rx=0 tx=0).stop 2024-09-15T21:56:06.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 -- 172.21.15.1:0/2913156950 shutdown_connections 2024-09-15T21:56:06.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.1:6834/3595905659,v1:172.21.15.1:6835/3595905659] conn(0x560c48d53cc0 0x560c48d540a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c48d11010 0x560c48d53300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c48d0bf90 0x560c48d52dc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 --2- 172.21.15.1:0/2913156950 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x560c48d0b670 0x560c48d52880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f7678ff9640 0 client.4926 ms_handle_reset on v2:172.21.15.1:6834/3595905659 2024-09-15T21:56:06.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 -- 172.21.15.1:0/2913156950 >> 172.21.15.1:0/2913156950 conn(0x560c48d07620 msgr2=0x560c48d4ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:06.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 -- 172.21.15.1:0/2913156950 shutdown_connections 2024-09-15T21:56:06.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 1 -- 172.21.15.1:0/2913156950 wait complete. 2024-09-15T21:56:06.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a3149000 20 client.4926 trim_cache size 0 max 16384 2024-09-15T21:56:06.350 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T21:56:06.350 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "a77d0aed-4b44-4b66-9239-aae9fcdd297c", 2024-09-15T21:56:06.350 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-15T21:56:06.350 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 4731, 2024-09-15T21:56:06.350 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-15T21:56:06.350 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-15T21:56:06.350 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-15T21:56:06.350 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 10.080748324, 2024-09-15T21:56:06.350 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 17, 2024-09-15T21:56:06.350 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 30, 2024-09-15T21:56:06.350 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 30, 2024-09-15T21:56:06.350 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 17.004308499 2024-09-15T21:56:06.350 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T21:56:06.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a008d640 1 -- 172.21.15.1:0/1395379955 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f767c0678c0 msgr2=0x7f767c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a008d640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f767c0678c0 0x7f767c069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7694007fd0 tx=0x7f7694009040 comp rx=0 tx=0).stop 2024-09-15T21:56:06.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a008d640 1 -- 172.21.15.1:0/1395379955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76980b5560 msgr2=0x7f7698149060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a008d640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76980b5560 0x7f7698149060 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f76880097c0 tx=0x7f7688019120 comp rx=0 tx=0).stop 2024-09-15T21:56:06.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a008d640 1 -- 172.21.15.1:0/1395379955 shutdown_connections 2024-09-15T21:56:06.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a008d640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7698148b80 0x7f76981495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a008d640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f76980b5560 0x7f7698149060 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a008d640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f767c0678c0 0x7f767c069d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a008d640 1 --2- 172.21.15.1:0/1395379955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76980afdc0 0x7f7698072fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.336+0000 7f76a008d640 1 -- 172.21.15.1:0/1395379955 >> 172.21.15.1:0/1395379955 conn(0x7f769806c730 msgr2=0x7f769813d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:06.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.340+0000 7f76a008d640 1 -- 172.21.15.1:0/1395379955 shutdown_connections 2024-09-15T21:56:06.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.340+0000 7f76a008d640 1 -- 172.21.15.1:0/1395379955 wait complete. 2024-09-15T21:56:06.360 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T21:56:06.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.464+0000 7f1f3745d640 1 Processor -- start 2024-09-15T21:56:06.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.464+0000 7f1f3745d640 1 -- start start 2024-09-15T21:56:06.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.464+0000 7f1f3745d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1f300af170 0x7f1f301443a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.464+0000 7f1f3745d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f301448e0 0x7f1f3014e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.464+0000 7f1f3745d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f30144d50 con 0x7f1f3009b540 2024-09-15T21:56:06.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.464+0000 7f1f3745d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f1f300ae380 con 0x7f1f300af170 2024-09-15T21:56:06.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.464+0000 7f1f3745d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1f300ae660 con 0x7f1f301448e0 2024-09-15T21:56:06.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.464+0000 7f1f349f8640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1f300af170 0x7f1f301443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f349f8640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1f300af170 0x7f1f301443a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51612/0 (socket says 172.21.15.1:51612) 2024-09-15T21:56:06.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f349f8640 1 -- 172.21.15.1:0/812580381 learned_addr learned my addr 172.21.15.1:0/812580381 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:06.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f359fa640 1 --2- 172.21.15.1:0/812580381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f301448e0 0x7f1f3014e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f349f8640 1 -- 172.21.15.1:0/812580381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f301448e0 msgr2=0x7f1f3014e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:06.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f349f8640 1 --2- 172.21.15.1:0/812580381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f301448e0 0x7f1f3014e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f349f8640 1 -- 172.21.15.1:0/812580381 >> v1:172.21.15.70:6789/0 conn(0x7f1f3009b540 legacy=0x7f1f300b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:06.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f349f8640 1 -- 172.21.15.1:0/812580381 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3009b920 con 0x7f1f300af170 2024-09-15T21:56:06.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f349f8640 1 --2- 172.21.15.1:0/812580381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f300af170 0x7f1f301443a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009870 tx=0x7f1f2401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e400f3b8e50198d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:06.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f2ffff640 1 -- 172.21.15.1:0/812580381 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240b0070 con 0x7f1f300af170 2024-09-15T21:56:06.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f2ffff640 1 -- 172.21.15.1:0/812580381 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f240a4e50 con 0x7f1f300af170 2024-09-15T21:56:06.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f2ffff640 1 -- 172.21.15.1:0/812580381 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240ab820 con 0x7f1f300af170 2024-09-15T21:56:06.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f3745d640 1 -- 172.21.15.1:0/812580381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f300af170 msgr2=0x7f1f301443a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f3745d640 1 --2- 172.21.15.1:0/812580381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f300af170 0x7f1f301443a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009870 tx=0x7f1f2401c440 comp rx=0 tx=0).stop 2024-09-15T21:56:06.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f3745d640 1 -- 172.21.15.1:0/812580381 shutdown_connections 2024-09-15T21:56:06.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f3745d640 1 --2- 172.21.15.1:0/812580381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f301448e0 0x7f1f3014e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f3745d640 1 --2- 172.21.15.1:0/812580381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f300af170 0x7f1f301443a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f3745d640 1 -- 172.21.15.1:0/812580381 >> 172.21.15.1:0/812580381 conn(0x7f1f300b5c40 msgr2=0x7f1f300b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:06.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f3745d640 1 -- 172.21.15.1:0/812580381 shutdown_connections 2024-09-15T21:56:06.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.468+0000 7f1f3745d640 1 -- 172.21.15.1:0/812580381 wait complete. 2024-09-15T21:56:06.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f3745d640 1 Processor -- start 2024-09-15T21:56:06.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f3745d640 1 -- start start 2024-09-15T21:56:06.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f3745d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f3009b540 0x7f1f30072450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f3745d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f300af170 0x7f1f301e3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f3745d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f301448e0 0x7f1f301e4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f3745d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1f300b4250 con 0x7f1f300af170 2024-09-15T21:56:06.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f3745d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1f300b6970 con 0x7f1f301448e0 2024-09-15T21:56:06.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f3745d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1f300b43d0 con 0x7f1f3009b540 2024-09-15T21:56:06.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f349f8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f300af170 0x7f1f301e3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f349f8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f300af170 0x7f1f301e3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51622/0 (socket says 172.21.15.1:51622) 2024-09-15T21:56:06.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f349f8640 1 -- 172.21.15.1:0/656336718 learned_addr learned my addr 172.21.15.1:0/656336718 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:06.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f359fa640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f301448e0 0x7f1f301e4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f351f9640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f3009b540 0x7f1f30072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f349f8640 1 -- 172.21.15.1:0/656336718 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f3009b540 msgr2=0x7f1f30072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f349f8640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f3009b540 0x7f1f30072450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f349f8640 1 -- 172.21.15.1:0/656336718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f301448e0 msgr2=0x7f1f301e4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f349f8640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f301448e0 0x7f1f301e4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f349f8640 1 -- 172.21.15.1:0/656336718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f300b1150 con 0x7f1f300af170 2024-09-15T21:56:06.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f359fa640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f301448e0 0x7f1f301e4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:06.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f349f8640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f300af170 0x7f1f301e3dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1f240ae040 tx=0x7f1f240191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:06.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f2dffb640 1 -- 172.21.15.1:0/656336718 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240b0040 con 0x7f1f300af170 2024-09-15T21:56:06.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f2dffb640 1 -- 172.21.15.1:0/656336718 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f240b9070 con 0x7f1f300af170 2024-09-15T21:56:06.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f3745d640 1 -- 172.21.15.1:0/656336718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f30072d80 con 0x7f1f300af170 2024-09-15T21:56:06.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f2dffb640 1 -- 172.21.15.1:0/656336718 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240b4440 con 0x7f1f300af170 2024-09-15T21:56:06.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f3745d640 1 -- 172.21.15.1:0/656336718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f301e38a0 con 0x7f1f300af170 2024-09-15T21:56:06.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f3745d640 1 -- 172.21.15.1:0/656336718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f301443a0 con 0x7f1f300af170 2024-09-15T21:56:06.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f2dffb640 1 -- 172.21.15.1:0/656336718 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f240b45e0 con 0x7f1f300af170 2024-09-15T21:56:06.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.472+0000 7f1f2dffb640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1f1c0678c0 0x7f1f1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:06.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.476+0000 7f1f351f9640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1f1c0678c0 0x7f1f1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:06.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.476+0000 7f1f2dffb640 1 -- 172.21.15.1:0/656336718 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f1f2411f820 con 0x7f1f300af170 2024-09-15T21:56:06.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.476+0000 7f1f351f9640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1f1c0678c0 0x7f1f1c069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1f280015b0 tx=0x7f1f28009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:06.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.480+0000 7f1f2dffb640 1 -- 172.21.15.1:0/656336718 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1f24016150 con 0x7f1f300af170 2024-09-15T21:56:06.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.672+0000 7f1f3745d640 1 -- 172.21.15.1:0/656336718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1f300ae160 con 0x7f1f300af170 2024-09-15T21:56:06.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.676+0000 7f1f2dffb640 1 -- 172.21.15.1:0/656336718 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f1f240f0350 con 0x7f1f300af170 2024-09-15T21:56:06.680 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T21:56:06.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.676+0000 7f1f3745d640 1 -- 172.21.15.1:0/656336718 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1f1c0678c0 msgr2=0x7f1f1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.676+0000 7f1f3745d640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1f1c0678c0 0x7f1f1c069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1f280015b0 tx=0x7f1f28009040 comp rx=0 tx=0).stop 2024-09-15T21:56:06.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.676+0000 7f1f3745d640 1 -- 172.21.15.1:0/656336718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f300af170 msgr2=0x7f1f301e3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:06.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.676+0000 7f1f3745d640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f300af170 0x7f1f301e3dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1f240ae040 tx=0x7f1f240191e0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.676+0000 7f1f3745d640 1 -- 172.21.15.1:0/656336718 shutdown_connections 2024-09-15T21:56:06.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.676+0000 7f1f3745d640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1f1c0678c0 0x7f1f1c069d80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.676+0000 7f1f3745d640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f301448e0 0x7f1f301e4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.676+0000 7f1f3745d640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1f300af170 0x7f1f301e3dc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.676+0000 7f1f3745d640 1 --2- 172.21.15.1:0/656336718 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f3009b540 0x7f1f30072450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:06.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.676+0000 7f1f3745d640 1 -- 172.21.15.1:0/656336718 >> 172.21.15.1:0/656336718 conn(0x7f1f300b5c40 msgr2=0x7f1f3009c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:06.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.676+0000 7f1f3745d640 1 -- 172.21.15.1:0/656336718 shutdown_connections 2024-09-15T21:56:06.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06.676+0000 7f1f3745d640 1 -- 172.21.15.1:0/656336718 wait complete. 2024-09-15T21:56:06.697 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T21:56:06.697 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T21:56:06.697 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2024-09-15T21:56:06.697 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T21:56:06.697 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T21:56:06.697 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T21:56:06.697 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T21:56:06.697 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T21:56:06.697 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T21:56:06.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:06.698 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2024-09-15T21:56:06.704 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T21:56:06.704 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T21:56:06.704 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T21:56:06.704 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T21:56:06.704 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2024-09-15T21:56:06.704 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T21:56:06.704 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T21:56:06.704 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2024-09-15T21:56:06.704 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2024-09-15T21:56:06.704 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T21:56:06.704 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2024-09-15T21:56:06.704 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2024-09-15T21:56:06.705 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T21:56:06.705 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2024-09-15T21:56:06.705 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2024-09-15T21:56:06.705 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T21:56:06.705 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42435sec preferred_lft 42435sec 2024-09-15T21:56:06.705 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-15T21:56:06.705 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T21:56:06.705 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T21:56:06.705 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2024-09-15T21:56:06.705 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2024-09-15T21:56:06.705 INFO:teuthology.orchestra.run.smithi001.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T21:56:06.705 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 02:42:4b:69:f7:bb brd ff:ff:ff:ff:ff:ff 2024-09-15T21:56:06.705 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T21:56:06.706 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T21:56:06.706 INFO:teuthology.orchestra.run.smithi001.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T21:56:06.706 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T21:56:06.706 INFO:teuthology.orchestra.run.smithi001.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T21:56:06.706 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T21:56:06.706 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T21:56:06.706 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T21:56:06.706 INFO:teuthology.orchestra.run.smithi001.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T21:56:06.706 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:56:06.706 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T21:56:06.706 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-15T21:56:06.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:06.707 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T21:56:06.759 INFO:teuthology.orchestra.run.smithi001.stdout:1 2024-09-15T21:56:06.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:06.761 DEBUG:teuthology.orchestra.run.smithi001:> route 2024-09-15T21:56:06.809 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2024-09-15T21:56:06.809 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T21:56:06.810 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T21:56:06.810 INFO:teuthology.orchestra.run.smithi001.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T21:56:06.810 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T21:56:06.810 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T21:56:06.810 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T21:56:06.810 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-15T21:56:06.810 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T21:56:06.810 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T21:56:06.810 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T21:56:06.810 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-15T21:56:06.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T21:56:06.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T21:56:06.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:06.934 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-15T21:56:06.939 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T21:56:06.939 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T21:56:06.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:06.939 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2024-09-15T21:56:06.998 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T21:56:06.998 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T21:56:06.998 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T21:56:07.045 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T21:56:07.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T21:56:07.045 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T21:56:07.092 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-09-15T21:56:07.150 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T21:56:07.197 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-09-15T21:56:07.197 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-09-15T21:56:07.197 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-09-15T21:56:07.197 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/run/lock 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-09-15T21:56:07.198 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/fs/nfsd 2024-09-15T21:56:07.199 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-09-15T21:56:07.199 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-09-15T21:56:07.199 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T21:56:07.199 INFO:teuthology.orchestra.run.smithi001.stdout:/run/rpc_pipefs 2024-09-15T21:56:07.199 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-09-15T21:56:07.199 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-09-15T21:56:07.199 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T21:56:07.199 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T21:56:07.199 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T21:56:07.199 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T21:56:07.199 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-09-15T21:56:07.199 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:56:07.199 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:56:07.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:07.200 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-09-15T21:56:07.249 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T21:56:07.249 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T21:56:07.293 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-09-15T21:56:07.308 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T21:56:07.356 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-09-15T21:56:07.357 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-09-15T21:56:07.357 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-09-15T21:56:07.357 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-09-15T21:56:07.357 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-09-15T21:56:07.357 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-09-15T21:56:07.357 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-09-15T21:56:07.357 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-09-15T21:56:07.357 INFO:teuthology.orchestra.run.smithi001.stdout:/run/lock 2024-09-15T21:56:07.357 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-09-15T21:56:07.357 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-09-15T21:56:07.357 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-09-15T21:56:07.358 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T21:56:07.358 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-09-15T21:56:07.358 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-09-15T21:56:07.358 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-09-15T21:56:07.358 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-09-15T21:56:07.358 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/fs/nfsd 2024-09-15T21:56:07.358 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-09-15T21:56:07.358 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-09-15T21:56:07.358 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T21:56:07.358 INFO:teuthology.orchestra.run.smithi001.stdout:/run/rpc_pipefs 2024-09-15T21:56:07.358 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-09-15T21:56:07.358 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-09-15T21:56:07.359 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T21:56:07.359 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T21:56:07.359 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T21:56:07.359 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T21:56:07.359 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-09-15T21:56:07.359 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:56:07.359 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:56:07.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:07.360 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-09-15T21:56:07.374 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:2024-09-15T21:56:07.368+0000 7fe1f853c580 -1 init, newargv = 0x560e7f005ff0 newargc=15 2024-09-15T21:56:07.374 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:ceph-fuse[36140]: starting ceph client 2024-09-15T21:56:07.379 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:ceph-fuse[36140]: starting fuse 2024-09-15T21:56:08.480 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-09-15T21:56:08.497 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T21:56:08.547 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-09-15T21:56:08.547 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-09-15T21:56:08.547 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-09-15T21:56:08.547 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-09-15T21:56:08.547 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-09-15T21:56:08.547 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-09-15T21:56:08.547 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/run/lock 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/fs/nfsd 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T21:56:08.548 INFO:teuthology.orchestra.run.smithi001.stdout:/run/rpc_pipefs 2024-09-15T21:56:08.549 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-09-15T21:56:08.549 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-09-15T21:56:08.549 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T21:56:08.549 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T21:56:08.549 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T21:56:08.549 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T21:56:08.549 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-09-15T21:56:08.549 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:56:08.549 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:56:08.549 INFO:teuthology.orchestra.run.smithi001.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T21:56:08.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:08.550 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-09-15T21:56:08.596 INFO:teuthology.orchestra.run.smithi001.stdout:45 2024-09-15T21:56:08.597 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-15T21:56:08.597 DEBUG:teuthology.orchestra.run.smithi001:> sudo stdin-killer -- python3 -c ' 2024-09-15T21:56:08.597 DEBUG:teuthology.orchestra.run.smithi001:> import glob 2024-09-15T21:56:08.597 DEBUG:teuthology.orchestra.run.smithi001:> import re 2024-09-15T21:56:08.597 DEBUG:teuthology.orchestra.run.smithi001:> import os 2024-09-15T21:56:08.597 DEBUG:teuthology.orchestra.run.smithi001:> import subprocess 2024-09-15T21:56:08.597 DEBUG:teuthology.orchestra.run.smithi001:> 2024-09-15T21:56:08.597 DEBUG:teuthology.orchestra.run.smithi001:> def _find_admin_socket(client_name): 2024-09-15T21:56:08.598 DEBUG:teuthology.orchestra.run.smithi001:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T21:56:08.598 DEBUG:teuthology.orchestra.run.smithi001:> files = glob.glob(asok_path) 2024-09-15T21:56:08.598 DEBUG:teuthology.orchestra.run.smithi001:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T21:56:08.598 DEBUG:teuthology.orchestra.run.smithi001:> 2024-09-15T21:56:08.598 DEBUG:teuthology.orchestra.run.smithi001:> # Given a non-glob path, it better be there 2024-09-15T21:56:08.598 DEBUG:teuthology.orchestra.run.smithi001:> if "*" not in asok_path: 2024-09-15T21:56:08.598 DEBUG:teuthology.orchestra.run.smithi001:> assert(len(files) == 1) 2024-09-15T21:56:08.598 DEBUG:teuthology.orchestra.run.smithi001:> return files[0] 2024-09-15T21:56:08.598 DEBUG:teuthology.orchestra.run.smithi001:> 2024-09-15T21:56:08.598 DEBUG:teuthology.orchestra.run.smithi001:> for f in files: 2024-09-15T21:56:08.598 DEBUG:teuthology.orchestra.run.smithi001:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T21:56:08.598 DEBUG:teuthology.orchestra.run.smithi001:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T21:56:08.599 DEBUG:teuthology.orchestra.run.smithi001:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T21:56:08.599 DEBUG:teuthology.orchestra.run.smithi001:> contents = proc_f.read() 2024-09-15T21:56:08.599 DEBUG:teuthology.orchestra.run.smithi001:> if mountpoint in contents: 2024-09-15T21:56:08.599 DEBUG:teuthology.orchestra.run.smithi001:> return f 2024-09-15T21:56:08.599 DEBUG:teuthology.orchestra.run.smithi001:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T21:56:08.599 DEBUG:teuthology.orchestra.run.smithi001:> 2024-09-15T21:56:08.599 DEBUG:teuthology.orchestra.run.smithi001:> print(_find_admin_socket("client.0")) 2024-09-15T21:56:08.599 DEBUG:teuthology.orchestra.run.smithi001:> ' 2024-09-15T21:56:08.726 INFO:teuthology.orchestra.run.smithi001.stdout:/var/run/ceph/ceph-client.0.36140.asok 2024-09-15T21:56:08.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T21:56:08.739 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36140.asok 2024-09-15T21:56:08.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:08.739 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36140.asok status 2024-09-15T21:56:08.891 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T21:56:08.892 INFO:teuthology.orchestra.run.smithi001.stdout: "metadata": { 2024-09-15T21:56:08.892 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T21:56:08.892 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T21:56:08.892 INFO:teuthology.orchestra.run.smithi001.stdout: "entity_id": "0", 2024-09-15T21:56:08.892 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": "smithi001", 2024-09-15T21:56:08.892 INFO:teuthology.orchestra.run.smithi001.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T21:56:08.892 INFO:teuthology.orchestra.run.smithi001.stdout: "pid": "36140", 2024-09-15T21:56:08.892 INFO:teuthology.orchestra.run.smithi001.stdout: "root": "/" 2024-09-15T21:56:08.892 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:56:08.892 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_count": 0, 2024-09-15T21:56:08.892 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_pinned_count": 0, 2024-09-15T21:56:08.893 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 4941, 2024-09-15T21:56:08.893 INFO:teuthology.orchestra.run.smithi001.stdout: "inst": { 2024-09-15T21:56:08.893 INFO:teuthology.orchestra.run.smithi001.stdout: "name": { 2024-09-15T21:56:08.893 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "client", 2024-09-15T21:56:08.893 INFO:teuthology.orchestra.run.smithi001.stdout: "num": 4941 2024-09-15T21:56:08.893 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:56:08.893 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2024-09-15T21:56:08.893 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-15T21:56:08.893 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "192.168.0.1:0", 2024-09-15T21:56:08.893 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 503127963 2024-09-15T21:56:08.893 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-15T21:56:08.894 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:56:08.894 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2024-09-15T21:56:08.894 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-15T21:56:08.894 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "192.168.0.1:0", 2024-09-15T21:56:08.894 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 503127963 2024-09-15T21:56:08.894 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-15T21:56:08.894 INFO:teuthology.orchestra.run.smithi001.stdout: "inst_str": "client.4941 192.168.0.1:0/503127963", 2024-09-15T21:56:08.894 INFO:teuthology.orchestra.run.smithi001.stdout: "addr_str": "192.168.0.1:0/503127963", 2024-09-15T21:56:08.894 INFO:teuthology.orchestra.run.smithi001.stdout: "inode_count": 1, 2024-09-15T21:56:08.894 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_epoch": 17, 2024-09-15T21:56:08.894 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch": 30, 2024-09-15T21:56:08.894 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch_barrier": 0, 2024-09-15T21:56:08.895 INFO:teuthology.orchestra.run.smithi001.stdout: "blocklisted": false, 2024-09-15T21:56:08.895 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs" 2024-09-15T21:56:08.895 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T21:56:08.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:08.906 DEBUG:teuthology.orchestra.run.smithi001:> stat --file-system '--printf=%T 2024-09-15T21:56:08.906 DEBUG:teuthology.orchestra.run.smithi001:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T21:56:08.912 INFO:teuthology.orchestra.run.smithi001.stdout:fuseblk 2024-09-15T21:56:08.913 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T21:56:08.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:08.913 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T21:56:08.968 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-09-15T21:56:09.016 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.epZvo0vNG7 2024-09-15T21:56:09.016 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:56:09.017 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/tmp/tmp.epZvo0vNG7 2024-09-15T21:56:09.064 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'mkdir -p dir1/dir2/dir3') 2024-09-15T21:56:09.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T21:56:09.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T21:56:09.197 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'chmod 755 /tmp/test-cephfscmctsh8r') 2024-09-15T21:56:09.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T21:56:09.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T21:56:09.255 INFO:tasks.cephfs.test_cephfs_shell:Running script "/tmp/test-cephfscmctsh8r" 2024-09-15T21:56:09.255 DEBUG:teuthology.orchestra.run.smithi001:> cephfs-shell -b /tmp/test-cephfscmctsh8r 2024-09-15T21:56:09.482 INFO:teuthology.orchestra.run.smithi001.stderr:Unrecognized command 2024-09-15T21:56:09.506 DEBUG:teuthology.orchestra.run:got remote process result: 127 2024-09-15T21:56:09.506 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T21:56:09.506 DEBUG:teuthology.orchestra.run.smithi001:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T21:56:09.577 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T21:56:09.641 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T21:56:09.641 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T21:56:09.641 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:56:09.641 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T21:56:09.647 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T21:56:09.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f614a6dd640 1 Processor -- start 2024-09-15T21:56:09.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f614a6dd640 1 -- start start 2024-09-15T21:56:09.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f614a6dd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f61440b5760 0x7f61440b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:09.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f614a6dd640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61440b66d0 con 0x7f61440b9070 2024-09-15T21:56:09.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f614a6dd640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61441484d0 con 0x7f61440b62f0 2024-09-15T21:56:09.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f614a6dd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f61440b48e0 con 0x7f61440b5760 2024-09-15T21:56:09.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f61437fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f61440b9070 0x7f61440b5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51766/0 (socket says 172.21.15.1:51766) 2024-09-15T21:56:09.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f61437fe640 1 -- 172.21.15.1:0/1925689263 learned_addr learned my addr 172.21.15.1:0/1925689263 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:09.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6148c7a640 1 --2- 172.21.15.1:0/1925689263 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f61440b5760 0x7f61440b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:09.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253169722 0 0) 0x7f61440b66d0 con 0x7f61440b9070 2024-09-15T21:56:09.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f612c003530 con 0x7f61440b9070 2024-09-15T21:56:09.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2142463744 0 0) 0x7f612c003530 con 0x7f61440b9070 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f61440b5760 msgr2=0x7f61440b94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 --2- 172.21.15.1:0/1925689263 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f61440b5760 0x7f61440b94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 >> v1:172.21.15.70:6789/0 conn(0x7f61440b62f0 legacy=0x7f6144147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6144141d90 con 0x7f61440b9070 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f61380016a0 con 0x7f61440b9070 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 >> v1:172.21.15.1:6789/0 conn(0x7f61440b9070 legacy=0x7f61440b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 --2- 172.21.15.1:0/1925689263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f612c0039f0 0x7f612c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 --2- 172.21.15.1:0/1925689263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f612c0043a0 0x7f612c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 --2- 172.21.15.1:0/1925689263 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f61440b5760 0x7f612c005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f61440b48e0 con 0x7f612c0043a0 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f612c00ba80 con 0x7f612c0039f0 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f612c00bc80 con 0x7f61440b5760 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f61437fe640 1 --2- 172.21.15.1:0/1925689263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f612c0043a0 0x7f612c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:09.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f6143fff640 1 --2- 172.21.15.1:0/1925689263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f612c0039f0 0x7f612c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:09.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f61437fe640 1 -- 172.21.15.1:0/1925689263 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f61440b5760 msgr2=0x7f612c005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:09.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f61437fe640 1 --2- 172.21.15.1:0/1925689263 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f61440b5760 0x7f612c005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:09.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f61437fe640 1 -- 172.21.15.1:0/1925689263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f612c0039f0 msgr2=0x7f612c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:09.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f61437fe640 1 --2- 172.21.15.1:0/1925689263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f612c0039f0 0x7f612c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:09.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.816+0000 7f61437fe640 1 -- 172.21.15.1:0/1925689263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612c003530 con 0x7f612c0043a0 2024-09-15T21:56:09.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f61437fe640 1 --2- 172.21.15.1:0/1925689263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f612c0043a0 0x7f612c004870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f613800c210 tx=0x7f613801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccac39794b4b7b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:09.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138007cf0 con 0x7f612c0043a0 2024-09-15T21:56:09.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61380a9070 con 0x7f612c0043a0 2024-09-15T21:56:09.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f6142ffd640 1 -- 172.21.15.1:0/1925689263 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138005d20 con 0x7f612c0043a0 2024-09-15T21:56:09.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 -- 172.21.15.1:0/1925689263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f612c0043a0 msgr2=0x7f612c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:09.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 --2- 172.21.15.1:0/1925689263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f612c0043a0 0x7f612c004870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f613800c210 tx=0x7f613801cc00 comp rx=0 tx=0).stop 2024-09-15T21:56:09.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f6148c7a640 1 -- 172.21.15.1:0/1925689263 reap_dead start 2024-09-15T21:56:09.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 -- 172.21.15.1:0/1925689263 shutdown_connections 2024-09-15T21:56:09.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 -- 172.21.15.1:0/1925689263 >> 172.21.15.1:0/1925689263 conn(0x7f61440b9ea0 msgr2=0x7f61440ba2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:09.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 -- 172.21.15.1:0/1925689263 shutdown_connections 2024-09-15T21:56:09.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 -- 172.21.15.1:0/1925689263 wait complete. 2024-09-15T21:56:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 Processor -- start 2024-09-15T21:56:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 -- start start 2024-09-15T21:56:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f612c0043a0 0x7f614413db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6144133e00 0x7f61441347d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6144134280 0x7f6144134d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6144153cb0 con 0x7f6144134280 2024-09-15T21:56:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6144153b30 con 0x7f612c0043a0 2024-09-15T21:56:09.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.820+0000 7f614a6dd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f6144153e30 con 0x7f6144133e00 2024-09-15T21:56:09.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6148c7a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6144134280 0x7f6144134d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:09.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6148c7a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6144134280 0x7f6144134d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34652/0 (socket says 172.21.15.1:34652) 2024-09-15T21:56:09.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6148c7a640 1 -- 172.21.15.1:0/2500711348 learned_addr learned my addr 172.21.15.1:0/2500711348 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:09.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6143fff640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f612c0043a0 0x7f614413db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:09.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f61437fe640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6144133e00 0x7f61441347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:09.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6148c7a640 1 -- 172.21.15.1:0/2500711348 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6144133e00 msgr2=0x7f61441347d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:09.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6148c7a640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6144133e00 0x7f61441347d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:09.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6148c7a640 1 -- 172.21.15.1:0/2500711348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f612c0043a0 msgr2=0x7f614413db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:09.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6148c7a640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f612c0043a0 0x7f614413db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:09.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6148c7a640 1 -- 172.21.15.1:0/2500711348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614413e980 con 0x7f6144134280 2024-09-15T21:56:09.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6148c7a640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6144134280 0x7f6144134d10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f614406ccb0 tx=0x7f613c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:09.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6140ff9640 1 -- 172.21.15.1:0/2500711348 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c018020 con 0x7f6144134280 2024-09-15T21:56:09.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6140ff9640 1 -- 172.21.15.1:0/2500711348 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f613c00bc80 con 0x7f6144134280 2024-09-15T21:56:09.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6140ff9640 1 -- 172.21.15.1:0/2500711348 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c014640 con 0x7f6144134280 2024-09-15T21:56:09.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f614a6dd640 1 -- 172.21.15.1:0/2500711348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6144133600 con 0x7f6144134280 2024-09-15T21:56:09.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f614a6dd640 1 -- 172.21.15.1:0/2500711348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f614413ee10 con 0x7f6144134280 2024-09-15T21:56:09.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f614a6dd640 1 -- 172.21.15.1:0/2500711348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61440b5050 con 0x7f6144134280 2024-09-15T21:56:09.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6140ff9640 1 -- 172.21.15.1:0/2500711348 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f613c01b020 con 0x7f6144134280 2024-09-15T21:56:09.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6140ff9640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f61300678c0 0x7f6130069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:09.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6140ff9640 1 -- 172.21.15.1:0/2500711348 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f613c0863c0 con 0x7f6144134280 2024-09-15T21:56:09.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6143fff640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f61300678c0 0x7f6130069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:09.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.824+0000 7f6143fff640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f61300678c0 0x7f6130069d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6134005400 tx=0x7f6134009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:09.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:09.828+0000 7f6140ff9640 1 -- 172.21.15.1:0/2500711348 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f613c022030 con 0x7f6144134280 2024-09-15T21:56:10.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.008+0000 7f614a6dd640 1 -- 172.21.15.1:0/2500711348 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f61440b7640 con 0x7f6144134280 2024-09-15T21:56:10.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.008+0000 7f6140ff9640 1 -- 172.21.15.1:0/2500711348 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) ==== 80+0+0 (secure 0 0 0) 0x7f613c056ef0 con 0x7f6144134280 2024-09-15T21:56:10.014 INFO:teuthology.orchestra.run.smithi001.stderr:listed 0 entries 2024-09-15T21:56:10.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.012+0000 7f614a6dd640 1 -- 172.21.15.1:0/2500711348 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f61300678c0 msgr2=0x7f6130069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.012+0000 7f614a6dd640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f61300678c0 0x7f6130069d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6134005400 tx=0x7f6134009040 comp rx=0 tx=0).stop 2024-09-15T21:56:10.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.012+0000 7f614a6dd640 1 -- 172.21.15.1:0/2500711348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6144134280 msgr2=0x7f6144134d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.012+0000 7f614a6dd640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6144134280 0x7f6144134d10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f614406ccb0 tx=0x7f613c00b480 comp rx=0 tx=0).stop 2024-09-15T21:56:10.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.012+0000 7f614a6dd640 1 -- 172.21.15.1:0/2500711348 shutdown_connections 2024-09-15T21:56:10.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.012+0000 7f614a6dd640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6144134280 0x7f6144134d10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.012+0000 7f614a6dd640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6144133e00 0x7f61441347d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.012+0000 7f614a6dd640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f61300678c0 0x7f6130069d80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.012+0000 7f614a6dd640 1 --2- 172.21.15.1:0/2500711348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f612c0043a0 0x7f614413db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.012+0000 7f614a6dd640 1 -- 172.21.15.1:0/2500711348 >> 172.21.15.1:0/2500711348 conn(0x7f61440b9ea0 msgr2=0x7f6144146df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:10.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.012+0000 7f614a6dd640 1 -- 172.21.15.1:0/2500711348 shutdown_connections 2024-09-15T21:56:10.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.012+0000 7f614a6dd640 1 -- 172.21.15.1:0/2500711348 wait complete. 2024-09-15T21:56:10.033 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi001.front.sepia.ceph.com... 2024-09-15T21:56:10.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:10.034 DEBUG:teuthology.orchestra.run.smithi001:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T21:56:10.045 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:ceph-fuse[36140]: fuse finished with error 0 and tester_r 0 2024-09-15T21:56:10.047 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T21:56:10.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:10.047 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T21:56:10.166 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:56:10.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd235039640 1 Processor -- start 2024-09-15T21:56:10.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd235039640 1 -- start start 2024-09-15T21:56:10.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd235039640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2300b6120 0x7fd23014b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd235039640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2300b6500 con 0x7fd230141ac0 2024-09-15T21:56:10.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd235039640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd23014bc60 con 0x7fd2301480c0 2024-09-15T21:56:10.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd235039640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd230147ba0 con 0x7fd2300b6120 2024-09-15T21:56:10.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22f59e640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd230141ac0 0x7fd2301521d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51772/0 (socket says 172.21.15.1:51772) 2024-09-15T21:56:10.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22f59e640 1 -- 172.21.15.1:0/3761406743 learned_addr learned my addr 172.21.15.1:0/3761406743 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:10.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22ed9d640 1 --2- 172.21.15.1:0/3761406743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2300b6120 0x7fd23014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2089896124 0 0) 0x7fd2300b6500 con 0x7fd230141ac0 2024-09-15T21:56:10.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd218003530 con 0x7fd230141ac0 2024-09-15T21:56:10.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 626685992 0 0) 0x7fd218003530 con 0x7fd230141ac0 2024-09-15T21:56:10.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2300b6120 msgr2=0x7fd23014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:10.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 --2- 172.21.15.1:0/3761406743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2300b6120 0x7fd23014b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 >> v1:172.21.15.70:6789/0 conn(0x7fd2301480c0 legacy=0x7fd2301413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2300b76c0 con 0x7fd230141ac0 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7fd228001a00 con 0x7fd230141ac0 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 >> v1:172.21.15.1:6789/0 conn(0x7fd230141ac0 legacy=0x7fd2301521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 --2- 172.21.15.1:0/3761406743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2180039f0 0x7fd218003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 --2- 172.21.15.1:0/3761406743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd218004810 0x7fd218004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 --2- 172.21.15.1:0/3761406743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2300b6120 0x7fd218005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd230147ba0 con 0x7fd2180039f0 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd21800bb00 con 0x7fd218004810 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd21800bd00 con 0x7fd2300b6120 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.292+0000 7fd22ed9d640 1 --2- 172.21.15.1:0/3761406743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2180039f0 0x7fd218003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd22f59e640 1 --2- 172.21.15.1:0/3761406743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2300b6120 0x7fd218005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd22e59c640 1 --2- 172.21.15.1:0/3761406743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd218004810 0x7fd218004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd22ed9d640 1 -- 172.21.15.1:0/3761406743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2300b6120 msgr2=0x7fd218005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:10.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd22ed9d640 1 --2- 172.21.15.1:0/3761406743 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd2300b6120 0x7fd218005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd22ed9d640 1 -- 172.21.15.1:0/3761406743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd218004810 msgr2=0x7fd218004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:10.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd22ed9d640 1 --2- 172.21.15.1:0/3761406743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd218004810 0x7fd218004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd22ed9d640 1 -- 172.21.15.1:0/3761406743 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd218003530 con 0x7fd2180039f0 2024-09-15T21:56:10.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd22e59c640 1 --2- 172.21.15.1:0/3761406743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd218004810 0x7fd218004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:10.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd22ed9d640 1 --2- 172.21.15.1:0/3761406743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2180039f0 0x7fd218003e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd220009ac0 tx=0x7fd22001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2919d9279b98a960 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:10.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220009690 con 0x7fd2180039f0 2024-09-15T21:56:10.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2200b0400 con 0x7fd2180039f0 2024-09-15T21:56:10.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd22dd9b640 1 -- 172.21.15.1:0/3761406743 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2200b07d0 con 0x7fd2180039f0 2024-09-15T21:56:10.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd235039640 1 -- 172.21.15.1:0/3761406743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2180039f0 msgr2=0x7fd218003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd235039640 1 --2- 172.21.15.1:0/3761406743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2180039f0 0x7fd218003e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd220009ac0 tx=0x7fd22001ca50 comp rx=0 tx=0).stop 2024-09-15T21:56:10.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd22f59e640 1 -- 172.21.15.1:0/3761406743 reap_dead start 2024-09-15T21:56:10.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd235039640 1 -- 172.21.15.1:0/3761406743 shutdown_connections 2024-09-15T21:56:10.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd235039640 1 -- 172.21.15.1:0/3761406743 >> 172.21.15.1:0/3761406743 conn(0x7fd2300bd2f0 msgr2=0x7fd2300bd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:10.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd235039640 1 -- 172.21.15.1:0/3761406743 shutdown_connections 2024-09-15T21:56:10.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.296+0000 7fd235039640 1 -- 172.21.15.1:0/3761406743 wait complete. 2024-09-15T21:56:10.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd235039640 1 Processor -- start 2024-09-15T21:56:10.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd235039640 1 -- start start 2024-09-15T21:56:10.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd235039640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2180039f0 0x7fd230152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd235039640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2301e3840 0x7fd23013dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd235039640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd23013e100 0x7fd23013d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd235039640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd230153c80 con 0x7fd2180039f0 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd235039640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd230153b00 con 0x7fd2301e3840 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd235039640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd230153e00 con 0x7fd23013e100 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd22ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2180039f0 0x7fd230152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd22ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2180039f0 0x7fd230152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34676/0 (socket says 172.21.15.1:34676) 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd22ed9d640 1 -- 172.21.15.1:0/558574712 learned_addr learned my addr 172.21.15.1:0/558574712 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd22e59c640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2301e3840 0x7fd23013dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd22f59e640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd23013e100 0x7fd23013d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd22ed9d640 1 -- 172.21.15.1:0/558574712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd23013e100 msgr2=0x7fd23013d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd22ed9d640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd23013e100 0x7fd23013d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd22ed9d640 1 -- 172.21.15.1:0/558574712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2301e3840 msgr2=0x7fd23013dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd22ed9d640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2301e3840 0x7fd23013dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd22ed9d640 1 -- 172.21.15.1:0/558574712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd230151fd0 con 0x7fd2180039f0 2024-09-15T21:56:10.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd22f59e640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd23013e100 0x7fd23013d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:10.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd22ed9d640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2180039f0 0x7fd230152750 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd220009ac0 tx=0x7fd2200197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:10.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd2177fe640 1 -- 172.21.15.1:0/558574712 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2200b0870 con 0x7fd2180039f0 2024-09-15T21:56:10.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd2177fe640 1 -- 172.21.15.1:0/558574712 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2200b0a30 con 0x7fd2180039f0 2024-09-15T21:56:10.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd2177fe640 1 -- 172.21.15.1:0/558574712 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2200b0e20 con 0x7fd2180039f0 2024-09-15T21:56:10.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd235039640 1 -- 172.21.15.1:0/558574712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2301e3cd0 con 0x7fd2180039f0 2024-09-15T21:56:10.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd235039640 1 -- 172.21.15.1:0/558574712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2301e4290 con 0x7fd2180039f0 2024-09-15T21:56:10.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd235039640 1 -- 172.21.15.1:0/558574712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2301413b0 con 0x7fd2180039f0 2024-09-15T21:56:10.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd2177fe640 1 -- 172.21.15.1:0/558574712 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2200c3440 con 0x7fd2180039f0 2024-09-15T21:56:10.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.300+0000 7fd2177fe640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd21c0678f0 0x7fd21c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.304+0000 7fd2177fe640 1 -- 172.21.15.1:0/558574712 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7fd22011fa80 con 0x7fd2180039f0 2024-09-15T21:56:10.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.304+0000 7fd22e59c640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd21c0678f0 0x7fd21c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.304+0000 7fd22e59c640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd21c0678f0 0x7fd21c069db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd224000c10 tx=0x7fd224009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:10.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.308+0000 7fd2177fe640 1 -- 172.21.15.1:0/558574712 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2200b6070 con 0x7fd2180039f0 2024-09-15T21:56:10.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.508+0000 7fd235039640 1 -- 172.21.15.1:0/558574712 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2300691c0 con 0x7fd2180039f0 2024-09-15T21:56:10.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.508+0000 7fd2177fe640 1 -- 172.21.15.1:0/558574712 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3570 (secure 0 0 0) 0x7fd2200ac030 con 0x7fd2180039f0 2024-09-15T21:56:10.515 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:10.515 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"btime":"2024-09-15T21:55:59:270348+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/3285517009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3285517009},{"type":"v1","addr":"172.21.15.70:6833","nonce":3285517009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:55.607624+0000","modified":"2024-09-15T21:55:58.650952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4731":{"gid":4731,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3595905659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3595905659},{"type":"v1","addr":"172.21.15.1:6835","nonce":3595905659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4731,"qdb_cluster":[4731]},"id":2}]} 2024-09-15T21:56:10.515 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 17 2024-09-15T21:56:10.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.512+0000 7fd235039640 1 -- 172.21.15.1:0/558574712 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd21c0678f0 msgr2=0x7fd21c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.512+0000 7fd235039640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd21c0678f0 0x7fd21c069db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd224000c10 tx=0x7fd224009040 comp rx=0 tx=0).stop 2024-09-15T21:56:10.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.512+0000 7fd235039640 1 -- 172.21.15.1:0/558574712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2180039f0 msgr2=0x7fd230152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.512+0000 7fd235039640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2180039f0 0x7fd230152750 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd220009ac0 tx=0x7fd2200197f0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.512+0000 7fd235039640 1 -- 172.21.15.1:0/558574712 shutdown_connections 2024-09-15T21:56:10.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.512+0000 7fd235039640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd23013e100 0x7fd23013d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.512+0000 7fd235039640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd21c0678f0 0x7fd21c069db0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.512+0000 7fd235039640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2301e3840 0x7fd23013dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.512+0000 7fd235039640 1 --2- 172.21.15.1:0/558574712 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd2180039f0 0x7fd230152750 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.512+0000 7fd235039640 1 -- 172.21.15.1:0/558574712 >> 172.21.15.1:0/558574712 conn(0x7fd2300bd2f0 msgr2=0x7fd2300bbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:10.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.512+0000 7fd235039640 1 -- 172.21.15.1:0/558574712 shutdown_connections 2024-09-15T21:56:10.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.512+0000 7fd235039640 1 -- 172.21.15.1:0/558574712 wait complete. 2024-09-15T21:56:10.534 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:56:10.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa06b0fc640 1 Processor -- start 2024-09-15T21:56:10.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa06b0fc640 1 -- start start 2024-09-15T21:56:10.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa06b0fc640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa0640b5220 0x7fa06409aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa06b0fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa0640b5600 0x7fa06409ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa06b0fc640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0640b6a50 con 0x7fa064148f20 2024-09-15T21:56:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa06b0fc640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fa06409b800 con 0x7fa0640b5600 2024-09-15T21:56:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa06b0fc640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fa0640b4dd0 con 0x7fa0640b5220 2024-09-15T21:56:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa063fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa0640b5600 0x7fa06409ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa063fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa0640b5600 0x7fa06409ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34686/0 (socket says 172.21.15.1:34686) 2024-09-15T21:56:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa063fff640 1 -- 172.21.15.1:0/4249075076 learned_addr learned my addr 172.21.15.1:0/4249075076 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa068e98640 1 --2- 172.21.15.1:0/4249075076 >> v2:172.21.15.70:3300/0 conn(0x7fa0640b5220 0x7fa06409aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa063fff640 1 -- 172.21.15.1:0/4249075076 >> v2:172.21.15.70:3300/0 conn(0x7fa0640b5220 msgr2=0x7fa06409aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa063fff640 1 --2- 172.21.15.1:0/4249075076 >> v2:172.21.15.70:3300/0 conn(0x7fa0640b5220 0x7fa06409aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa063fff640 1 -- 172.21.15.1:0/4249075076 >> v1:172.21.15.1:6789/0 conn(0x7fa064148f20 legacy=0x7fa064149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa063fff640 1 -- 172.21.15.1:0/4249075076 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06409af90 con 0x7fa0640b5600 2024-09-15T21:56:10.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.656+0000 7fa0637fe640 1 -- 172.21.15.1:0/4249075076 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1868023672 0 0) 0x7fa0640b6a50 con 0x7fa064148f20 2024-09-15T21:56:10.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa063fff640 1 --2- 172.21.15.1:0/4249075076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0640b5600 0x7fa06409ee10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa0640b0400 tx=0x7fa05801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f13f77d5377c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:10.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa0637fe640 1 -- 172.21.15.1:0/4249075076 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0580b1070 con 0x7fa0640b5600 2024-09-15T21:56:10.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa0637fe640 1 -- 172.21.15.1:0/4249075076 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0580ac630 con 0x7fa0640b5600 2024-09-15T21:56:10.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa0637fe640 1 -- 172.21.15.1:0/4249075076 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0580a8050 con 0x7fa0640b5600 2024-09-15T21:56:10.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa06b0fc640 1 -- 172.21.15.1:0/4249075076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0640b5600 msgr2=0x7fa06409ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa06b0fc640 1 --2- 172.21.15.1:0/4249075076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0640b5600 0x7fa06409ee10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa0640b0400 tx=0x7fa05801c3d0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa06b0fc640 1 -- 172.21.15.1:0/4249075076 shutdown_connections 2024-09-15T21:56:10.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa06b0fc640 1 --2- 172.21.15.1:0/4249075076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0640b5600 0x7fa06409ee10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa06b0fc640 1 --2- 172.21.15.1:0/4249075076 >> v2:172.21.15.70:3300/0 conn(0x7fa0640b5220 0x7fa06409aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa06b0fc640 1 -- 172.21.15.1:0/4249075076 >> 172.21.15.1:0/4249075076 conn(0x7fa0640b5c40 msgr2=0x7fa0640b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:10.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa06b0fc640 1 -- 172.21.15.1:0/4249075076 shutdown_connections 2024-09-15T21:56:10.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa06b0fc640 1 -- 172.21.15.1:0/4249075076 wait complete. 2024-09-15T21:56:10.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa06b0fc640 1 Processor -- start 2024-09-15T21:56:10.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.660+0000 7fa06b0fc640 1 -- start start 2024-09-15T21:56:10.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa06b0fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0640b5220 0x7fa064147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa06b0fc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0640b5600 0x7fa06413c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa06b0fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa064148f20 0x7fa064135e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa06b0fc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa064152700 con 0x7fa0640b5220 2024-09-15T21:56:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa06b0fc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa064152880 con 0x7fa064148f20 2024-09-15T21:56:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa06b0fc640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa064152a00 con 0x7fa0640b5600 2024-09-15T21:56:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa068e98640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0640b5220 0x7fa064147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa068e98640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0640b5220 0x7fa064147a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34690/0 (socket says 172.21.15.1:34690) 2024-09-15T21:56:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa068e98640 1 -- 172.21.15.1:0/3216469805 learned_addr learned my addr 172.21.15.1:0/3216469805 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa069699640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa064148f20 0x7fa064135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa063fff640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0640b5600 0x7fa06413c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa068e98640 1 -- 172.21.15.1:0/3216469805 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0640b5600 msgr2=0x7fa06413c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa068e98640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0640b5600 0x7fa06413c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa068e98640 1 -- 172.21.15.1:0/3216469805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa064148f20 msgr2=0x7fa064135e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa068e98640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa064148f20 0x7fa064135e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa068e98640 1 -- 172.21.15.1:0/3216469805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0640b16f0 con 0x7fa0640b5220 2024-09-15T21:56:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa069699640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa064148f20 0x7fa064135e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa068e98640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0640b5220 0x7fa064147a50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa054007e40 tx=0x7fa05400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa0617fa640 1 -- 172.21.15.1:0/3216469805 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054014620 con 0x7fa0640b5220 2024-09-15T21:56:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa0617fa640 1 -- 172.21.15.1:0/3216469805 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa054019070 con 0x7fa0640b5220 2024-09-15T21:56:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa06b0fc640 1 -- 172.21.15.1:0/3216469805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0640b3310 con 0x7fa0640b5220 2024-09-15T21:56:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa0617fa640 1 -- 172.21.15.1:0/3216469805 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054014a00 con 0x7fa0640b5220 2024-09-15T21:56:10.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa06b0fc640 1 -- 172.21.15.1:0/3216469805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0640b0830 con 0x7fa0640b5220 2024-09-15T21:56:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa06b0fc640 1 -- 172.21.15.1:0/3216469805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0640b0660 con 0x7fa0640b5220 2024-09-15T21:56:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa0617fa640 1 -- 172.21.15.1:0/3216469805 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa054014ba0 con 0x7fa0640b5220 2024-09-15T21:56:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa0617fa640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa0500678c0 0x7fa050069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa0617fa640 1 -- 172.21.15.1:0/3216469805 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7fa054086480 con 0x7fa0640b5220 2024-09-15T21:56:10.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa063fff640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa0500678c0 0x7fa050069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:10.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.664+0000 7fa063fff640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa0500678c0 0x7fa050069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa0580ae000 tx=0x7fa058008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:10.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.668+0000 7fa0617fa640 1 -- 172.21.15.1:0/3216469805 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa054057050 con 0x7fa0640b5220 2024-09-15T21:56:10.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.868+0000 7fa06b0fc640 1 -- 172.21.15.1:0/3216469805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa06409aa50 con 0x7fa0640b5220 2024-09-15T21:56:10.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.868+0000 7fa0617fa640 1 -- 172.21.15.1:0/3216469805 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3570 (secure 0 0 0) 0x7fa054056950 con 0x7fa0640b5220 2024-09-15T21:56:10.874 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:10.874 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"btime":"2024-09-15T21:55:59:270348+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/3285517009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3285517009},{"type":"v1","addr":"172.21.15.70:6833","nonce":3285517009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:55.607624+0000","modified":"2024-09-15T21:55:58.650952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4731":{"gid":4731,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3595905659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3595905659},{"type":"v1","addr":"172.21.15.1:6835","nonce":3595905659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4731,"qdb_cluster":[4731]},"id":2}]} 2024-09-15T21:56:10.875 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 17 2024-09-15T21:56:10.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.872+0000 7fa06b0fc640 1 -- 172.21.15.1:0/3216469805 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa0500678c0 msgr2=0x7fa050069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.872+0000 7fa06b0fc640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa0500678c0 0x7fa050069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa0580ae000 tx=0x7fa058008040 comp rx=0 tx=0).stop 2024-09-15T21:56:10.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.872+0000 7fa06b0fc640 1 -- 172.21.15.1:0/3216469805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0640b5220 msgr2=0x7fa064147a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:10.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.872+0000 7fa06b0fc640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0640b5220 0x7fa064147a50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa054007e40 tx=0x7fa05400e4b0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.872+0000 7fa06b0fc640 1 -- 172.21.15.1:0/3216469805 shutdown_connections 2024-09-15T21:56:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.872+0000 7fa06b0fc640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa0500678c0 0x7fa050069d80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.872+0000 7fa06b0fc640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa064148f20 0x7fa064135e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.872+0000 7fa06b0fc640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa0640b5600 0x7fa06413c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.872+0000 7fa06b0fc640 1 --2- 172.21.15.1:0/3216469805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa0640b5220 0x7fa064147a50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.872+0000 7fa06b0fc640 1 -- 172.21.15.1:0/3216469805 >> 172.21.15.1:0/3216469805 conn(0x7fa0640b5c40 msgr2=0x7fa06406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.872+0000 7fa06b0fc640 1 -- 172.21.15.1:0/3216469805 shutdown_connections 2024-09-15T21:56:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:10.872+0000 7fa06b0fc640 1 -- 172.21.15.1:0/3216469805 wait complete. 2024-09-15T21:56:10.891 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:56:11.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f1481cce640 1 Processor -- start 2024-09-15T21:56:11.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f1481cce640 1 -- start start 2024-09-15T21:56:11.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f1481cce640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f147c09acb0 0x7f147c0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f1481cce640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f147c09b340 0x7f147c0afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f1481cce640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f147c1416b0 0x7f147c141b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f1481cce640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f147c0b5220 con 0x7f147c09b340 2024-09-15T21:56:11.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f1481cce640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f147c0aef60 con 0x7f147c09acb0 2024-09-15T21:56:11.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f1481cce640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f147c09b090 con 0x7f147c1416b0 2024-09-15T21:56:11.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f147affd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f147c09b340 0x7f147c0afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f147affd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f147c09b340 0x7f147c0afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34700/0 (socket says 172.21.15.1:34700) 2024-09-15T21:56:11.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f147affd640 1 -- 172.21.15.1:0/1772319657 learned_addr learned my addr 172.21.15.1:0/1772319657 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:11.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f147b7fe640 1 --2- 172.21.15.1:0/1772319657 >> v2:172.21.15.70:3300/0 conn(0x7f147c09acb0 0x7f147c0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f147bfff640 1 --2- 172.21.15.1:0/1772319657 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f147c1416b0 0x7f147c141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f147affd640 1 -- 172.21.15.1:0/1772319657 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f147c1416b0 msgr2=0x7f147c141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:11.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f147affd640 1 --2- 172.21.15.1:0/1772319657 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f147c1416b0 0x7f147c141b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f147affd640 1 -- 172.21.15.1:0/1772319657 >> v2:172.21.15.70:3300/0 conn(0x7f147c09acb0 msgr2=0x7f147c0af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:11.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f147affd640 1 --2- 172.21.15.1:0/1772319657 >> v2:172.21.15.70:3300/0 conn(0x7f147c09acb0 0x7f147c0af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.000+0000 7f147affd640 1 -- 172.21.15.1:0/1772319657 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c0b5470 con 0x7f147c09b340 2024-09-15T21:56:11.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f147affd640 1 --2- 172.21.15.1:0/1772319657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f147c09b340 0x7f147c0afd30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f147c0b3800 tx=0x7f146c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a79b199ed118e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:11.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f147a7fc640 1 -- 172.21.15.1:0/1772319657 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c0a7070 con 0x7f147c09b340 2024-09-15T21:56:11.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f147a7fc640 1 -- 172.21.15.1:0/1772319657 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c0b0070 con 0x7f147c09b340 2024-09-15T21:56:11.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f147a7fc640 1 -- 172.21.15.1:0/1772319657 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c0ab890 con 0x7f147c09b340 2024-09-15T21:56:11.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 -- 172.21.15.1:0/1772319657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f147c09b340 msgr2=0x7f147c0afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 --2- 172.21.15.1:0/1772319657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f147c09b340 0x7f147c0afd30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f147c0b3800 tx=0x7f146c01c490 comp rx=0 tx=0).stop 2024-09-15T21:56:11.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 -- 172.21.15.1:0/1772319657 shutdown_connections 2024-09-15T21:56:11.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 --2- 172.21.15.1:0/1772319657 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f147c1416b0 0x7f147c141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 --2- 172.21.15.1:0/1772319657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f147c09b340 0x7f147c0afd30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 --2- 172.21.15.1:0/1772319657 >> v2:172.21.15.70:3300/0 conn(0x7f147c09acb0 0x7f147c0af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 -- 172.21.15.1:0/1772319657 >> 172.21.15.1:0/1772319657 conn(0x7f147c0b5c40 msgr2=0x7f147c0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:11.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 -- 172.21.15.1:0/1772319657 shutdown_connections 2024-09-15T21:56:11.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 -- 172.21.15.1:0/1772319657 wait complete. 2024-09-15T21:56:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 Processor -- start 2024-09-15T21:56:11.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 -- start start 2024-09-15T21:56:11.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f147c09acb0 0x7f147c072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f147c1416b0 0x7f147c070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f147c1481e0 0x7f147c071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f147c14b6a0 con 0x7f147c09acb0 2024-09-15T21:56:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f147c0aebe0 con 0x7f147c1481e0 2024-09-15T21:56:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f1481cce640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f147c14b820 con 0x7f147c1416b0 2024-09-15T21:56:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f147b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f147c09acb0 0x7f147c072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f147b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f147c09acb0 0x7f147c072cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34708/0 (socket says 172.21.15.1:34708) 2024-09-15T21:56:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f147b7fe640 1 -- 172.21.15.1:0/3185851279 learned_addr learned my addr 172.21.15.1:0/3185851279 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f147b7fe640 1 -- 172.21.15.1:0/3185851279 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f147c1416b0 msgr2=0x7f147c070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f147b7fe640 1 --2- 172.21.15.1:0/3185851279 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f147c1416b0 0x7f147c070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f147b7fe640 1 -- 172.21.15.1:0/3185851279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f147c1481e0 msgr2=0x7f147c071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f147bfff640 1 --2- 172.21.15.1:0/3185851279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f147c1481e0 0x7f147c071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f147b7fe640 1 --2- 172.21.15.1:0/3185851279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f147c1481e0 0x7f147c071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.004+0000 7f147b7fe640 1 -- 172.21.15.1:0/3185851279 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c070360 con 0x7f147c09acb0 2024-09-15T21:56:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.008+0000 7f147b7fe640 1 --2- 172.21.15.1:0/3185851279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f147c09acb0 0x7f147c072cc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f147000d830 tx=0x7f147000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.008+0000 7f1463fff640 1 -- 172.21.15.1:0/3185851279 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147000b6c0 con 0x7f147c09acb0 2024-09-15T21:56:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.008+0000 7f1463fff640 1 -- 172.21.15.1:0/3185851279 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1470019070 con 0x7f147c09acb0 2024-09-15T21:56:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.008+0000 7f1481cce640 1 -- 172.21.15.1:0/3185851279 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147c072260 con 0x7f147c09acb0 2024-09-15T21:56:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.008+0000 7f1463fff640 1 -- 172.21.15.1:0/3185851279 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147000ba60 con 0x7f147c09acb0 2024-09-15T21:56:11.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.008+0000 7f1481cce640 1 -- 172.21.15.1:0/3185851279 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f147c1486d0 con 0x7f147c09acb0 2024-09-15T21:56:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.008+0000 7f1481cce640 1 -- 172.21.15.1:0/3185851279 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f147c14bbe0 con 0x7f147c09acb0 2024-09-15T21:56:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.008+0000 7f1463fff640 1 -- 172.21.15.1:0/3185851279 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f147001e460 con 0x7f147c09acb0 2024-09-15T21:56:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.008+0000 7f1463fff640 1 --2- 172.21.15.1:0/3185851279 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f14680678f0 0x7f1468069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.008+0000 7f1463fff640 1 -- 172.21.15.1:0/3185851279 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f1470086250 con 0x7f147c09acb0 2024-09-15T21:56:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.008+0000 7f147affd640 1 --2- 172.21.15.1:0/3185851279 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f14680678f0 0x7f1468069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.008+0000 7f147affd640 1 --2- 172.21.15.1:0/3185851279 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f14680678f0 0x7f1468069db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f146c0af000 tx=0x7f146c004740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:11.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.012+0000 7f1463fff640 1 -- 172.21.15.1:0/3185851279 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1470056e20 con 0x7f147c09acb0 2024-09-15T21:56:11.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.176+0000 7f1481cce640 1 -- 172.21.15.1:0/3185851279 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f147c0b7e40 con 0x7f147c09acb0 2024-09-15T21:56:11.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.180+0000 7f1463fff640 1 -- 172.21.15.1:0/3185851279 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16657 (secure 0 0 0) 0x7f1470056720 con 0x7f147c09acb0 2024-09-15T21:56:11.184 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:11.185 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":30,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:57.260341+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:53.499944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:54.604026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:56:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.180+0000 7f1481cce640 1 -- 172.21.15.1:0/3185851279 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f14680678f0 msgr2=0x7f1468069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.180+0000 7f1481cce640 1 --2- 172.21.15.1:0/3185851279 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f14680678f0 0x7f1468069db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f146c0af000 tx=0x7f146c004740 comp rx=0 tx=0).stop 2024-09-15T21:56:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.180+0000 7f1481cce640 1 -- 172.21.15.1:0/3185851279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f147c09acb0 msgr2=0x7f147c072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.180+0000 7f1481cce640 1 --2- 172.21.15.1:0/3185851279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f147c09acb0 0x7f147c072cc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f147000d830 tx=0x7f147000dcf0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.180+0000 7f1481cce640 1 -- 172.21.15.1:0/3185851279 shutdown_connections 2024-09-15T21:56:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.180+0000 7f1481cce640 1 --2- 172.21.15.1:0/3185851279 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f14680678f0 0x7f1468069db0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.180+0000 7f1481cce640 1 --2- 172.21.15.1:0/3185851279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f147c1481e0 0x7f147c071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.180+0000 7f1481cce640 1 --2- 172.21.15.1:0/3185851279 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f147c1416b0 0x7f147c070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.180+0000 7f1481cce640 1 --2- 172.21.15.1:0/3185851279 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f147c09acb0 0x7f147c072cc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.180+0000 7f1481cce640 1 -- 172.21.15.1:0/3185851279 >> 172.21.15.1:0/3185851279 conn(0x7f147c0b5c40 msgr2=0x7f147c149610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.180+0000 7f1481cce640 1 -- 172.21.15.1:0/3185851279 shutdown_connections 2024-09-15T21:56:11.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.180+0000 7f1481cce640 1 -- 172.21.15.1:0/3185851279 wait complete. 2024-09-15T21:56:11.202 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T21:56:11.202 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:56:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.316+0000 7fce55b4c640 1 Processor -- start 2024-09-15T21:56:11.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.316+0000 7fce55b4c640 1 -- start start 2024-09-15T21:56:11.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.316+0000 7fce55b4c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fce50068370 0x7fce500b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.316+0000 7fce55b4c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce5014b460 0x7fce50141990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.316+0000 7fce55b4c640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce50068750 con 0x7fce50141500 2024-09-15T21:56:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.316+0000 7fce55b4c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fce50141ed0 con 0x7fce50068370 2024-09-15T21:56:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.316+0000 7fce55b4c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fce500b4ee0 con 0x7fce5014b460 2024-09-15T21:56:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.316+0000 7fce47fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fce50141500 0x7fce5014ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51786/0 (socket says 172.21.15.1:51786) 2024-09-15T21:56:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.316+0000 7fce47fff640 1 -- 172.21.15.1:0/1570477232 learned_addr learned my addr 172.21.15.1:0/1570477232 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce4f7fe640 1 --2- 172.21.15.1:0/1570477232 >> v2:172.21.15.70:3300/0 conn(0x7fce50068370 0x7fce500b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce4ffff640 1 --2- 172.21.15.1:0/1570477232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce5014b460 0x7fce50141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce4f7fe640 1 -- 172.21.15.1:0/1570477232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce5014b460 msgr2=0x7fce50141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce4f7fe640 1 --2- 172.21.15.1:0/1570477232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce5014b460 0x7fce50141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce4f7fe640 1 -- 172.21.15.1:0/1570477232 >> v1:172.21.15.1:6789/0 conn(0x7fce50141500 legacy=0x7fce5014ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce4f7fe640 1 -- 172.21.15.1:0/1570477232 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce500b51c0 con 0x7fce50068370 2024-09-15T21:56:11.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce4ffff640 1 --2- 172.21.15.1:0/1570477232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce5014b460 0x7fce50141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T21:56:11.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce4f7fe640 1 --2- 172.21.15.1:0/1570477232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce50068370 0x7fce500b62e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fce400097c0 tx=0x7fce4001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7788e7139c00ab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:11.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce4effd640 1 -- 172.21.15.1:0/1570477232 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce400b1070 con 0x7fce50068370 2024-09-15T21:56:11.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce4effd640 1 -- 172.21.15.1:0/1570477232 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce400ac600 con 0x7fce50068370 2024-09-15T21:56:11.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce4effd640 1 -- 172.21.15.1:0/1570477232 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce400ac9d0 con 0x7fce50068370 2024-09-15T21:56:11.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce55b4c640 1 -- 172.21.15.1:0/1570477232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce50068370 msgr2=0x7fce500b62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce55b4c640 1 --2- 172.21.15.1:0/1570477232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce50068370 0x7fce500b62e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fce400097c0 tx=0x7fce4001c410 comp rx=0 tx=0).stop 2024-09-15T21:56:11.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce55b4c640 1 -- 172.21.15.1:0/1570477232 shutdown_connections 2024-09-15T21:56:11.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce55b4c640 1 --2- 172.21.15.1:0/1570477232 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce5014b460 0x7fce50141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce55b4c640 1 --2- 172.21.15.1:0/1570477232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce50068370 0x7fce500b62e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce55b4c640 1 -- 172.21.15.1:0/1570477232 >> 172.21.15.1:0/1570477232 conn(0x7fce500bda70 msgr2=0x7fce50067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:11.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce55b4c640 1 -- 172.21.15.1:0/1570477232 shutdown_connections 2024-09-15T21:56:11.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.320+0000 7fce55b4c640 1 -- 172.21.15.1:0/1570477232 wait complete. 2024-09-15T21:56:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce55b4c640 1 Processor -- start 2024-09-15T21:56:11.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce55b4c640 1 -- start start 2024-09-15T21:56:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce55b4c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce50068370 0x7fce5013ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce55b4c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50141500 0x7fce5014c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce55b4c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce5014b460 0x7fce501430a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce55b4c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fce50154a80 con 0x7fce50141500 2024-09-15T21:56:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce55b4c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fce50154900 con 0x7fce50068370 2024-09-15T21:56:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce55b4c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fce50154c00 con 0x7fce5014b460 2024-09-15T21:56:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce47fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50141500 0x7fce5014c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce47fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50141500 0x7fce5014c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34712/0 (socket says 172.21.15.1:34712) 2024-09-15T21:56:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce47fff640 1 -- 172.21.15.1:0/658954156 learned_addr learned my addr 172.21.15.1:0/658954156 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce4f7fe640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce50068370 0x7fce5013ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce4ffff640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce5014b460 0x7fce501430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce47fff640 1 -- 172.21.15.1:0/658954156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce5014b460 msgr2=0x7fce501430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce47fff640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce5014b460 0x7fce501430a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce47fff640 1 -- 172.21.15.1:0/658954156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce50068370 msgr2=0x7fce5013ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce47fff640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce50068370 0x7fce5013ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce47fff640 1 -- 172.21.15.1:0/658954156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5014e4b0 con 0x7fce50141500 2024-09-15T21:56:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce47fff640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50141500 0x7fce5014c3f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fce3800c370 tx=0x7fce3800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce4cff9640 1 -- 172.21.15.1:0/658954156 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38017070 con 0x7fce50141500 2024-09-15T21:56:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce4cff9640 1 -- 172.21.15.1:0/658954156 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce38005cf0 con 0x7fce50141500 2024-09-15T21:56:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce4cff9640 1 -- 172.21.15.1:0/658954156 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce380072f0 con 0x7fce50141500 2024-09-15T21:56:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce55b4c640 1 -- 172.21.15.1:0/658954156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5014d300 con 0x7fce50141500 2024-09-15T21:56:11.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce55b4c640 1 -- 172.21.15.1:0/658954156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5014c930 con 0x7fce50141500 2024-09-15T21:56:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.324+0000 7fce55b4c640 1 -- 172.21.15.1:0/658954156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce500b62e0 con 0x7fce50141500 2024-09-15T21:56:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.328+0000 7fce4cff9640 1 -- 172.21.15.1:0/658954156 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fce3801a070 con 0x7fce50141500 2024-09-15T21:56:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.328+0000 7fce4cff9640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fce300678c0 0x7fce30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.328+0000 7fce4cff9640 1 -- 172.21.15.1:0/658954156 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7fce38084f80 con 0x7fce50141500 2024-09-15T21:56:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.328+0000 7fce4f7fe640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fce300678c0 0x7fce30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.328+0000 7fce4f7fe640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fce300678c0 0x7fce30069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce400ae000 tx=0x7fce400a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:11.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.332+0000 7fce4cff9640 1 -- 172.21.15.1:0/658954156 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fce38055b50 con 0x7fce50141500 2024-09-15T21:56:11.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.520+0000 7fce55b4c640 1 -- 172.21.15.1:0/658954156 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce50146c20 con 0x7fce50141500 2024-09-15T21:56:11.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.520+0000 7fce4cff9640 1 -- 172.21.15.1:0/658954156 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3570 (secure 0 0 0) 0x7fce38055450 con 0x7fce50141500 2024-09-15T21:56:11.527 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:11.528 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"btime":"2024-09-15T21:55:59:270348+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/3285517009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3285517009},{"type":"v1","addr":"172.21.15.70:6833","nonce":3285517009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:55.607624+0000","modified":"2024-09-15T21:55:58.650952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4731":{"gid":4731,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3595905659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3595905659},{"type":"v1","addr":"172.21.15.1:6835","nonce":3595905659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4731,"qdb_cluster":[4731]},"id":2}]} 2024-09-15T21:56:11.528 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 17 2024-09-15T21:56:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.524+0000 7fce55b4c640 1 -- 172.21.15.1:0/658954156 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fce300678c0 msgr2=0x7fce30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.524+0000 7fce55b4c640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fce300678c0 0x7fce30069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fce400ae000 tx=0x7fce400a7000 comp rx=0 tx=0).stop 2024-09-15T21:56:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.524+0000 7fce55b4c640 1 -- 172.21.15.1:0/658954156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50141500 msgr2=0x7fce5014c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.524+0000 7fce55b4c640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50141500 0x7fce5014c3f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fce3800c370 tx=0x7fce3800c830 comp rx=0 tx=0).stop 2024-09-15T21:56:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.524+0000 7fce55b4c640 1 -- 172.21.15.1:0/658954156 shutdown_connections 2024-09-15T21:56:11.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.524+0000 7fce55b4c640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fce5014b460 0x7fce501430a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.524+0000 7fce55b4c640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce50141500 0x7fce5014c3f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.524+0000 7fce55b4c640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fce300678c0 0x7fce30069d80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.524+0000 7fce55b4c640 1 --2- 172.21.15.1:0/658954156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce50068370 0x7fce5013ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.524+0000 7fce55b4c640 1 -- 172.21.15.1:0/658954156 >> 172.21.15.1:0/658954156 conn(0x7fce500bda70 msgr2=0x7fce500bb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:11.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.524+0000 7fce55b4c640 1 -- 172.21.15.1:0/658954156 shutdown_connections 2024-09-15T21:56:11.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.524+0000 7fce55b4c640 1 -- 172.21.15.1:0/658954156 wait complete. 2024-09-15T21:56:11.545 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:56:11.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.656+0000 7ff91f412640 1 Processor -- start 2024-09-15T21:56:11.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.656+0000 7ff91f412640 1 -- start start 2024-09-15T21:56:11.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91f412640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff918068370 0x7ff9180b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91f412640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff91814b460 0x7ff918141990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91f412640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff918068750 con 0x7ff918141500 2024-09-15T21:56:11.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91f412640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7ff918141ed0 con 0x7ff91814b460 2024-09-15T21:56:11.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91f412640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7ff9180b4ee0 con 0x7ff918068370 2024-09-15T21:56:11.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91d9af640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff91814b460 0x7ff918141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91c9ad640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff918141500 0x7ff91814ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51790/0 (socket says 172.21.15.1:51790) 2024-09-15T21:56:11.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91c9ad640 1 -- 172.21.15.1:0/2888864286 learned_addr learned my addr 172.21.15.1:0/2888864286 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:11.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91d1ae640 1 --2- 172.21.15.1:0/2888864286 >> v2:172.21.15.70:3300/0 conn(0x7ff918068370 0x7ff9180b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91d9af640 1 -- 172.21.15.1:0/2888864286 >> v2:172.21.15.70:3300/0 conn(0x7ff918068370 msgr2=0x7ff9180b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:11.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91d9af640 1 --2- 172.21.15.1:0/2888864286 >> v2:172.21.15.70:3300/0 conn(0x7ff918068370 0x7ff9180b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91d9af640 1 -- 172.21.15.1:0/2888864286 >> v1:172.21.15.1:6789/0 conn(0x7ff918141500 legacy=0x7ff91814ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91d9af640 1 -- 172.21.15.1:0/2888864286 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9180b51c0 con 0x7ff91814b460 2024-09-15T21:56:11.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff917fff640 1 -- 172.21.15.1:0/2888864286 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446336156 0 0) 0x7ff918068750 con 0x7ff918141500 2024-09-15T21:56:11.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff91d9af640 1 --2- 172.21.15.1:0/2888864286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff91814b460 0x7ff918141990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff918068a60 tx=0x7ff90801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb2c4a6c64eac5d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:11.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff917fff640 1 -- 172.21.15.1:0/2888864286 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9080b2070 con 0x7ff91814b460 2024-09-15T21:56:11.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff917fff640 1 -- 172.21.15.1:0/2888864286 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9080ad680 con 0x7ff91814b460 2024-09-15T21:56:11.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.660+0000 7ff917fff640 1 -- 172.21.15.1:0/2888864286 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9080ada50 con 0x7ff91814b460 2024-09-15T21:56:11.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 -- 172.21.15.1:0/2888864286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff91814b460 msgr2=0x7ff918141990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 --2- 172.21.15.1:0/2888864286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff91814b460 0x7ff918141990 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff918068a60 tx=0x7ff90801c3f0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 -- 172.21.15.1:0/2888864286 shutdown_connections 2024-09-15T21:56:11.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 --2- 172.21.15.1:0/2888864286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff91814b460 0x7ff918141990 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 --2- 172.21.15.1:0/2888864286 >> v2:172.21.15.70:3300/0 conn(0x7ff918068370 0x7ff9180b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 -- 172.21.15.1:0/2888864286 >> 172.21.15.1:0/2888864286 conn(0x7ff9180bda70 msgr2=0x7ff918067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:11.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 -- 172.21.15.1:0/2888864286 shutdown_connections 2024-09-15T21:56:11.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 -- 172.21.15.1:0/2888864286 wait complete. 2024-09-15T21:56:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 Processor -- start 2024-09-15T21:56:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 -- start start 2024-09-15T21:56:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff918068370 0x7ff9181366b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff918141500 0x7ff9181e3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff91814b460 0x7ff918133490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff918154a80 con 0x7ff918141500 2024-09-15T21:56:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff918154900 con 0x7ff91814b460 2024-09-15T21:56:11.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff918154c00 con 0x7ff918068370 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91c9ad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff918141500 0x7ff9181e3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91c9ad640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff918141500 0x7ff9181e3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34718/0 (socket says 172.21.15.1:34718) 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91c9ad640 1 -- 172.21.15.1:0/3244996973 learned_addr learned my addr 172.21.15.1:0/3244996973 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91d1ae640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff918068370 0x7ff9181366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91d9af640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff91814b460 0x7ff918133490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91c9ad640 1 -- 172.21.15.1:0/3244996973 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff918068370 msgr2=0x7ff9181366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91c9ad640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff918068370 0x7ff9181366b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91c9ad640 1 -- 172.21.15.1:0/3244996973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff91814b460 msgr2=0x7ff918133490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91c9ad640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff91814b460 0x7ff918133490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91c9ad640 1 -- 172.21.15.1:0/3244996973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9181434b0 con 0x7ff918141500 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91d9af640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff91814b460 0x7ff918133490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91c9ad640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff918141500 0x7ff9181e3270 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00c520 tx=0x7ff90c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff915ffb640 1 -- 172.21.15.1:0/3244996973 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c018070 con 0x7ff918141500 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff915ffb640 1 -- 172.21.15.1:0/3244996973 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff90c0074e0 con 0x7ff918141500 2024-09-15T21:56:11.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 -- 172.21.15.1:0/3244996973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91813d150 con 0x7ff918141500 2024-09-15T21:56:11.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff915ffb640 1 -- 172.21.15.1:0/3244996973 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0049f0 con 0x7ff918141500 2024-09-15T21:56:11.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 -- 172.21.15.1:0/3244996973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9181e37b0 con 0x7ff918141500 2024-09-15T21:56:11.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.664+0000 7ff91f412640 1 -- 172.21.15.1:0/3244996973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9180b62e0 con 0x7ff918141500 2024-09-15T21:56:11.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.668+0000 7ff915ffb640 1 -- 172.21.15.1:0/3244996973 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff90c01b070 con 0x7ff918141500 2024-09-15T21:56:11.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.668+0000 7ff915ffb640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff9040678c0 0x7ff904069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.668+0000 7ff915ffb640 1 -- 172.21.15.1:0/3244996973 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7ff90c085030 con 0x7ff918141500 2024-09-15T21:56:11.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.668+0000 7ff91d1ae640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff9040678c0 0x7ff904069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.668+0000 7ff91d1ae640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff9040678c0 0x7ff904069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff910003b90 tx=0x7ff9100098d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:11.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.672+0000 7ff915ffb640 1 -- 172.21.15.1:0/3244996973 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff90c055510 con 0x7ff918141500 2024-09-15T21:56:11.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.860+0000 7ff91f412640 1 -- 172.21.15.1:0/3244996973 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff918148fb0 con 0x7ff918141500 2024-09-15T21:56:11.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.860+0000 7ff915ffb640 1 -- 172.21.15.1:0/3244996973 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3570 (secure 0 0 0) 0x7ff90c059810 con 0x7ff918141500 2024-09-15T21:56:11.867 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:11.867 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"btime":"2024-09-15T21:55:59:270348+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/3285517009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3285517009},{"type":"v1","addr":"172.21.15.70:6833","nonce":3285517009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T21:55:55.607624+0000","modified":"2024-09-15T21:55:58.650952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4731},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4731":{"gid":4731,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.1:6835/3595905659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":3595905659},{"type":"v1","addr":"172.21.15.1:6835","nonce":3595905659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4731,"qdb_cluster":[4731]},"id":2}]} 2024-09-15T21:56:11.867 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 17 2024-09-15T21:56:11.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.864+0000 7ff91f412640 1 -- 172.21.15.1:0/3244996973 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff9040678c0 msgr2=0x7ff904069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.864+0000 7ff91f412640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff9040678c0 0x7ff904069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff910003b90 tx=0x7ff9100098d0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.864+0000 7ff91f412640 1 -- 172.21.15.1:0/3244996973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff918141500 msgr2=0x7ff9181e3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.864+0000 7ff91f412640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff918141500 0x7ff9181e3270 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00c520 tx=0x7ff90c00c9e0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.864+0000 7ff91f412640 1 -- 172.21.15.1:0/3244996973 shutdown_connections 2024-09-15T21:56:11.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.864+0000 7ff91f412640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff9040678c0 0x7ff904069d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.864+0000 7ff91f412640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff91814b460 0x7ff918133490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.864+0000 7ff91f412640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff918141500 0x7ff9181e3270 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.864+0000 7ff91f412640 1 --2- 172.21.15.1:0/3244996973 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff918068370 0x7ff9181366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.864+0000 7ff91f412640 1 -- 172.21.15.1:0/3244996973 >> 172.21.15.1:0/3244996973 conn(0x7ff9180bda70 msgr2=0x7ff9181396f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:11.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.864+0000 7ff91f412640 1 -- 172.21.15.1:0/3244996973 shutdown_connections 2024-09-15T21:56:11.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.864+0000 7ff91f412640 1 -- 172.21.15.1:0/3244996973 wait complete. 2024-09-15T21:56:11.885 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:56:11.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.988+0000 7f890e015640 1 Processor -- start 2024-09-15T21:56:11.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.988+0000 7f890e015640 1 -- start start 2024-09-15T21:56:11.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f890e015640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f890809b540 0x7f89080b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:11.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f890e015640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89080af7d0 con 0x7f89080af170 2024-09-15T21:56:11.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f890e015640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89080b58c0 con 0x7f89080b4080 2024-09-15T21:56:11.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f890e015640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f89080af550 con 0x7f890809b540 2024-09-15T21:56:11.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89077fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f89080af170 0x7f890809aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51802/0 (socket says 172.21.15.1:51802) 2024-09-15T21:56:11.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89077fe640 1 -- 172.21.15.1:0/1785804753 learned_addr learned my addr 172.21.15.1:0/1785804753 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:11.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f8906ffd640 1 --2- 172.21.15.1:0/1785804753 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f890809b540 0x7f89080b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:11.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1589588016 0 0) 0x7f89080af7d0 con 0x7f89080af170 2024-09-15T21:56:11.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88f4003530 con 0x7f89080af170 2024-09-15T21:56:11.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2768944125 0 0) 0x7f88f4003530 con 0x7f89080af170 2024-09-15T21:56:11.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f890809b540 msgr2=0x7f89080b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:11.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 --2- 172.21.15.1:0/1785804753 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f890809b540 0x7f89080b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:11.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 >> v1:172.21.15.70:6789/0 conn(0x7f89080b4080 legacy=0x7f89081443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:11.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890809f1e0 con 0x7f89080af170 2024-09-15T21:56:11.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f8900001a00 con 0x7f89080af170 2024-09-15T21:56:11.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 >> v1:172.21.15.1:6789/0 conn(0x7f89080af170 legacy=0x7f890809aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 --2- 172.21.15.1:0/1785804753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88f40039f0 0x7f88f4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 --2- 172.21.15.1:0/1785804753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88f4004810 0x7f88f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 --2- 172.21.15.1:0/1785804753 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f890809b540 0x7f88f40052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f89080af550 con 0x7f88f40039f0 2024-09-15T21:56:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f88f400bbc0 con 0x7f88f4004810 2024-09-15T21:56:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f88f400bdc0 con 0x7f890809b540 2024-09-15T21:56:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89077fe640 1 --2- 172.21.15.1:0/1785804753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88f40039f0 0x7f88f4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f8907fff640 1 --2- 172.21.15.1:0/1785804753 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f890809b540 0x7f88f40052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f8906ffd640 1 --2- 172.21.15.1:0/1785804753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88f4004810 0x7f88f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89077fe640 1 -- 172.21.15.1:0/1785804753 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f890809b540 msgr2=0x7f88f40052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89077fe640 1 --2- 172.21.15.1:0/1785804753 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f890809b540 0x7f88f40052a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89077fe640 1 -- 172.21.15.1:0/1785804753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88f4004810 msgr2=0x7f88f4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:12.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89077fe640 1 --2- 172.21.15.1:0/1785804753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88f4004810 0x7f88f4004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.992+0000 7f89077fe640 1 -- 172.21.15.1:0/1785804753 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f4003530 con 0x7f88f40039f0 2024-09-15T21:56:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f89077fe640 1 --2- 172.21.15.1:0/1785804753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88f40039f0 0x7f88f4003e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f890000a840 tx=0x7f890001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0895cce9235e596 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890000a460 con 0x7f88f40039f0 2024-09-15T21:56:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89000ad650 con 0x7f88f40039f0 2024-09-15T21:56:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f89067fc640 1 -- 172.21.15.1:0/1785804753 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89000ada40 con 0x7f88f40039f0 2024-09-15T21:56:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 -- 172.21.15.1:0/1785804753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88f40039f0 msgr2=0x7f88f4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 --2- 172.21.15.1:0/1785804753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f88f40039f0 0x7f88f4003e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f890000a840 tx=0x7f890001d360 comp rx=0 tx=0).stop 2024-09-15T21:56:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f8907fff640 1 -- 172.21.15.1:0/1785804753 reap_dead start 2024-09-15T21:56:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 -- 172.21.15.1:0/1785804753 shutdown_connections 2024-09-15T21:56:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 -- 172.21.15.1:0/1785804753 >> 172.21.15.1:0/1785804753 conn(0x7f89080b5c40 msgr2=0x7f89080b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:12.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 -- 172.21.15.1:0/1785804753 shutdown_connections 2024-09-15T21:56:12.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 -- 172.21.15.1:0/1785804753 wait complete. 2024-09-15T21:56:12.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 Processor -- start 2024-09-15T21:56:12.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 -- start start 2024-09-15T21:56:12.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f88f40039f0 0x7f8908145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89081e2310 0x7f89081e2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8908141300 0x7f89081417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f89080aead0 con 0x7f8908141300 2024-09-15T21:56:12.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f890809b160 con 0x7f89081e2310 2024-09-15T21:56:12.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f89080ae380 con 0x7f88f40039f0 2024-09-15T21:56:12.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f8907fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8908141300 0x7f89081417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f8907fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8908141300 0x7f89081417b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34734/0 (socket says 172.21.15.1:34734) 2024-09-15T21:56:12.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f8907fff640 1 -- 172.21.15.1:0/2458441345 learned_addr learned my addr 172.21.15.1:0/2458441345 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:12.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f89077fe640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f88f40039f0 0x7f8908145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f8906ffd640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89081e2310 0x7f89081e2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f8907fff640 1 -- 172.21.15.1:0/2458441345 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f88f40039f0 msgr2=0x7f8908145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f8907fff640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f88f40039f0 0x7f8908145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f8907fff640 1 -- 172.21.15.1:0/2458441345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89081e2310 msgr2=0x7f89081e2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f8907fff640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89081e2310 0x7f89081e2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f8907fff640 1 -- 172.21.15.1:0/2458441345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89081e2cd0 con 0x7f8908141300 2024-09-15T21:56:12.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f8906ffd640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89081e2310 0x7f89081e2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:12.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f8907fff640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8908141300 0x7f89081417b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f89080b4460 tx=0x7f88f800d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:12.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f88fffff640 1 -- 172.21.15.1:0/2458441345 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f8018070 con 0x7f8908141300 2024-09-15T21:56:12.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f88fffff640 1 -- 172.21.15.1:0/2458441345 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f8003600 con 0x7f8908141300 2024-09-15T21:56:12.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 -- 172.21.15.1:0/2458441345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8908146440 con 0x7f8908141300 2024-09-15T21:56:12.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f88fffff640 1 -- 172.21.15.1:0/2458441345 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f80039d0 con 0x7f8908141300 2024-09-15T21:56:12.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:11.996+0000 7f890e015640 1 -- 172.21.15.1:0/2458441345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89080b3040 con 0x7f8908141300 2024-09-15T21:56:12.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.000+0000 7f890e015640 1 -- 172.21.15.1:0/2458441345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8908146260 con 0x7f8908141300 2024-09-15T21:56:12.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.000+0000 7f88fffff640 1 -- 172.21.15.1:0/2458441345 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88f8003b70 con 0x7f8908141300 2024-09-15T21:56:12.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.000+0000 7f88fffff640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f88e80678f0 0x7f88e8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.000+0000 7f88fffff640 1 -- 172.21.15.1:0/2458441345 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f88f80851d0 con 0x7f8908141300 2024-09-15T21:56:12.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.000+0000 7f89077fe640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f88e80678f0 0x7f88e8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.000+0000 7f89077fe640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f88e80678f0 0x7f88e8069db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f89000ad000 tx=0x7f8908073eb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:12.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.004+0000 7f88fffff640 1 -- 172.21.15.1:0/2458441345 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8908146260 con 0x7f8908141300 2024-09-15T21:56:12.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.164+0000 7f890e015640 1 -- 172.21.15.1:0/2458441345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f890809aa50 con 0x7f8908141300 2024-09-15T21:56:12.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.168+0000 7f88fffff640 1 -- 172.21.15.1:0/2458441345 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16657 (secure 0 0 0) 0x7f89081e2cd0 con 0x7f8908141300 2024-09-15T21:56:12.174 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:12.174 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":30,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:55:57.260341+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T21:55:53.499944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T21:55:54.604026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:56:12.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.172+0000 7f890e015640 1 -- 172.21.15.1:0/2458441345 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f88e80678f0 msgr2=0x7f88e8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.172+0000 7f890e015640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f88e80678f0 0x7f88e8069db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f89000ad000 tx=0x7f8908073eb0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.172+0000 7f890e015640 1 -- 172.21.15.1:0/2458441345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8908141300 msgr2=0x7f89081417b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.172+0000 7f890e015640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8908141300 0x7f89081417b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f89080b4460 tx=0x7f88f800d890 comp rx=0 tx=0).stop 2024-09-15T21:56:12.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.172+0000 7f890e015640 1 -- 172.21.15.1:0/2458441345 shutdown_connections 2024-09-15T21:56:12.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.172+0000 7f890e015640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8908141300 0x7f89081417b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.172+0000 7f890e015640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f88e80678f0 0x7f88e8069db0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.172+0000 7f890e015640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89081e2310 0x7f89081e2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.172+0000 7f890e015640 1 --2- 172.21.15.1:0/2458441345 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f88f40039f0 0x7f8908145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.172+0000 7f890e015640 1 -- 172.21.15.1:0/2458441345 >> 172.21.15.1:0/2458441345 conn(0x7f89080b5c40 msgr2=0x7f8908142fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:12.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.172+0000 7f890e015640 1 -- 172.21.15.1:0/2458441345 shutdown_connections 2024-09-15T21:56:12.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.172+0000 7f890e015640 1 -- 172.21.15.1:0/2458441345 wait complete. 2024-09-15T21:56:12.192 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T21:56:12.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.304+0000 7f349f04c640 1 Processor -- start 2024-09-15T21:56:12.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.304+0000 7f349f04c640 1 -- start start 2024-09-15T21:56:12.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349f04c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f34980b62f0 0x7f3498147d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349f04c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34980b9070 0x7f34980b9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349f04c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3498148240 con 0x7f34980b5050 2024-09-15T21:56:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349f04c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f34980b48e0 con 0x7f34980b62f0 2024-09-15T21:56:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349f04c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f34980b4bc0 con 0x7f34980b9070 2024-09-15T21:56:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349cde8640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f34980b62f0 0x7f3498147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349cde8640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f34980b62f0 0x7f3498147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34746/0 (socket says 172.21.15.1:34746) 2024-09-15T21:56:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349cde8640 1 -- 172.21.15.1:0/3734000346 learned_addr learned my addr 172.21.15.1:0/3734000346 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f3497fff640 1 --2- 172.21.15.1:0/3734000346 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34980b9070 0x7f34980b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349cde8640 1 -- 172.21.15.1:0/3734000346 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34980b9070 msgr2=0x7f34980b9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349cde8640 1 --2- 172.21.15.1:0/3734000346 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34980b9070 0x7f34980b9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349cde8640 1 -- 172.21.15.1:0/3734000346 >> v1:172.21.15.70:6789/0 conn(0x7f34980b5050 legacy=0x7f34980b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349cde8640 1 -- 172.21.15.1:0/3734000346 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34980b66d0 con 0x7f34980b62f0 2024-09-15T21:56:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f3497fff640 1 --2- 172.21.15.1:0/3734000346 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34980b9070 0x7f34980b9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:12.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349cde8640 1 --2- 172.21.15.1:0/3734000346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34980b62f0 0x7f3498147d00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3488009870 tx=0x7f348801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c44661bcc394f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:12.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f34977fe640 1 -- 172.21.15.1:0/3734000346 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34880b0070 con 0x7f34980b62f0 2024-09-15T21:56:12.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f34977fe640 1 -- 172.21.15.1:0/3734000346 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34880ab600 con 0x7f34980b62f0 2024-09-15T21:56:12.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f34977fe640 1 -- 172.21.15.1:0/3734000346 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34880ab9d0 con 0x7f34980b62f0 2024-09-15T21:56:12.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349f04c640 1 -- 172.21.15.1:0/3734000346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34980b62f0 msgr2=0x7f3498147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349f04c640 1 --2- 172.21.15.1:0/3734000346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34980b62f0 0x7f3498147d00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3488009870 tx=0x7f348801c490 comp rx=0 tx=0).stop 2024-09-15T21:56:12.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349f04c640 1 -- 172.21.15.1:0/3734000346 shutdown_connections 2024-09-15T21:56:12.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349f04c640 1 --2- 172.21.15.1:0/3734000346 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34980b9070 0x7f34980b9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349f04c640 1 --2- 172.21.15.1:0/3734000346 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34980b62f0 0x7f3498147d00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349f04c640 1 -- 172.21.15.1:0/3734000346 >> 172.21.15.1:0/3734000346 conn(0x7f34980b9ea0 msgr2=0x7f34980ba2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:12.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349f04c640 1 -- 172.21.15.1:0/3734000346 shutdown_connections 2024-09-15T21:56:12.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.308+0000 7f349f04c640 1 -- 172.21.15.1:0/3734000346 wait complete. 2024-09-15T21:56:12.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349f04c640 1 Processor -- start 2024-09-15T21:56:12.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349f04c640 1 -- start start 2024-09-15T21:56:12.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349f04c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34980b5050 0x7f34981e0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349f04c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34980b62f0 0x7f3498139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349f04c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34980b9070 0x7f3498144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349f04c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3498154aa0 con 0x7f34980b5050 2024-09-15T21:56:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349f04c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3498154920 con 0x7f34980b9070 2024-09-15T21:56:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349f04c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3498154c20 con 0x7f34980b62f0 2024-09-15T21:56:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349cde8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34980b5050 0x7f34981e0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349cde8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34980b5050 0x7f34981e0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34758/0 (socket says 172.21.15.1:34758) 2024-09-15T21:56:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349cde8640 1 -- 172.21.15.1:0/2537500432 learned_addr learned my addr 172.21.15.1:0/2537500432 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f3497fff640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34980b62f0 0x7f3498139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349d5e9640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34980b9070 0x7f3498144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349cde8640 1 -- 172.21.15.1:0/2537500432 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34980b62f0 msgr2=0x7f3498139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349cde8640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34980b62f0 0x7f3498139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349cde8640 1 -- 172.21.15.1:0/2537500432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34980b9070 msgr2=0x7f3498144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349cde8640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34980b9070 0x7f3498144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349cde8640 1 -- 172.21.15.1:0/2537500432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3498143a60 con 0x7f34980b5050 2024-09-15T21:56:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349cde8640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34980b5050 0x7f34981e0480 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f34880ae040 tx=0x7f3488019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f34957fa640 1 -- 172.21.15.1:0/2537500432 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34880b0040 con 0x7f34980b5050 2024-09-15T21:56:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f34957fa640 1 -- 172.21.15.1:0/2537500432 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34880b9070 con 0x7f34980b5050 2024-09-15T21:56:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349f04c640 1 -- 172.21.15.1:0/2537500432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3498144730 con 0x7f34980b5050 2024-09-15T21:56:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f34957fa640 1 -- 172.21.15.1:0/2537500432 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34880b48a0 con 0x7f34980b5050 2024-09-15T21:56:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349f04c640 1 -- 172.21.15.1:0/2537500432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349813ac90 con 0x7f34980b5050 2024-09-15T21:56:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f349f04c640 1 -- 172.21.15.1:0/2537500432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3498147d00 con 0x7f34980b5050 2024-09-15T21:56:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.312+0000 7f34957fa640 1 -- 172.21.15.1:0/2537500432 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f34880ab4c0 con 0x7f34980b5050 2024-09-15T21:56:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.316+0000 7f34957fa640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f34840678c0 0x7f3484069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.316+0000 7f34957fa640 1 -- 172.21.15.1:0/2537500432 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f348811fa30 con 0x7f34980b5050 2024-09-15T21:56:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.316+0000 7f3497fff640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f34840678c0 0x7f3484069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.316+0000 7f3497fff640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f34840678c0 0x7f3484069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f348c006fd0 tx=0x7f348c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:12.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.320+0000 7f34957fa640 1 -- 172.21.15.1:0/2537500432 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3488016110 con 0x7f34980b5050 2024-09-15T21:56:12.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.516+0000 7f349f04c640 1 -- 172.21.15.1:0/2537500432 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f34980b7640 con 0x7f34980b5050 2024-09-15T21:56:12.523 INFO:tasks.ceph.mon.a.smithi001.stderr:2024-09-15T21:56:12.516+0000 7fe8b5b94640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T21:56:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.520+0000 7f34957fa640 1 -- 172.21.15.1:0/2537500432 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f34880f0680 con 0x7f34980b5050 2024-09-15T21:56:12.526 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T21:56:12.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.524+0000 7f349f04c640 1 -- 172.21.15.1:0/2537500432 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f34840678c0 msgr2=0x7f3484069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.524+0000 7f349f04c640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f34840678c0 0x7f3484069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f348c006fd0 tx=0x7f348c008040 comp rx=0 tx=0).stop 2024-09-15T21:56:12.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.524+0000 7f349f04c640 1 -- 172.21.15.1:0/2537500432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34980b5050 msgr2=0x7f34981e0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.524+0000 7f349f04c640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34980b5050 0x7f34981e0480 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f34880ae040 tx=0x7f3488019230 comp rx=0 tx=0).stop 2024-09-15T21:56:12.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.524+0000 7f349f04c640 1 -- 172.21.15.1:0/2537500432 shutdown_connections 2024-09-15T21:56:12.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.524+0000 7f349f04c640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f34840678c0 0x7f3484069d80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.524+0000 7f349f04c640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34980b9070 0x7f3498144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.524+0000 7f349f04c640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f34980b62f0 0x7f3498139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.524+0000 7f349f04c640 1 --2- 172.21.15.1:0/2537500432 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34980b5050 0x7f34981e0480 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.524+0000 7f349f04c640 1 -- 172.21.15.1:0/2537500432 >> 172.21.15.1:0/2537500432 conn(0x7f34980b9ea0 msgr2=0x7f3498074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:12.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.524+0000 7f349f04c640 1 -- 172.21.15.1:0/2537500432 shutdown_connections 2024-09-15T21:56:12.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.524+0000 7f349f04c640 1 -- 172.21.15.1:0/2537500432 wait complete. 2024-09-15T21:56:12.535 INFO:tasks.ceph.mds.a.smithi001.stderr: -2478> 2024-09-15T21:56:00.193+0000 7f19a1922640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T21:56:12.550 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T21:56:12.570 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2024-09-15T21:56:12.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.664+0000 7f8d9eac6640 1 Processor -- start 2024-09-15T21:56:12.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.664+0000 7f8d9eac6640 1 -- start start 2024-09-15T21:56:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.664+0000 7f8d9eac6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8d9806dbc0 0x7f8d980b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.664+0000 7f8d9eac6640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d9806dfa0 con 0x7f8d980af2a0 2024-09-15T21:56:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.664+0000 7f8d9eac6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d980b55d0 con 0x7f8d98144b40 2024-09-15T21:56:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.664+0000 7f8d9eac6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f8d980b00e0 con 0x7f8d9806dbc0 2024-09-15T21:56:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d97fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8d980af2a0 0x7f8d98144430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51808/0 (socket says 172.21.15.1:51808) 2024-09-15T21:56:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d97fff640 1 -- 172.21.15.1:0/4279075135 learned_addr learned my addr 172.21.15.1:0/4279075135 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d9c862640 1 --2- 172.21.15.1:0/4279075135 >> v2:172.21.15.70:3300/0 conn(0x7f8d9806dbc0 0x7f8d980b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819342049 0 0) 0x7f8d9806dfa0 con 0x7f8d980af2a0 2024-09-15T21:56:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d88003530 con 0x7f8d980af2a0 2024-09-15T21:56:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1888053113 0 0) 0x7f8d88003530 con 0x7f8d980af2a0 2024-09-15T21:56:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 >> v2:172.21.15.70:3300/0 conn(0x7f8d9806dbc0 msgr2=0x7f8d980b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 --2- 172.21.15.1:0/4279075135 >> v2:172.21.15.70:3300/0 conn(0x7f8d9806dbc0 0x7f8d980b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 >> v1:172.21.15.70:6789/0 conn(0x7f8d98144b40 legacy=0x7f8d9814e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d980aeb30 con 0x7f8d980af2a0 2024-09-15T21:56:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f8d84001680 con 0x7f8d980af2a0 2024-09-15T21:56:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 >> v1:172.21.15.1:6789/0 conn(0x7f8d980af2a0 legacy=0x7f8d98144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 --2- 172.21.15.1:0/4279075135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d880039c0 0x7f8d88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 --2- 172.21.15.1:0/4279075135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d88004810 0x7f8d88004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 --2- 172.21.15.1:0/4279075135 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8d880051d0 0x7f8d8800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8d980b00e0 con 0x7f8d880039c0 2024-09-15T21:56:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8800c170 con 0x7f8d88004810 2024-09-15T21:56:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8d8800c370 con 0x7f8d880051d0 2024-09-15T21:56:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d9c862640 1 --2- 172.21.15.1:0/4279075135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d880039c0 0x7f8d88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d9d063640 1 --2- 172.21.15.1:0/4279075135 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8d880051d0 0x7f8d8800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d97fff640 1 --2- 172.21.15.1:0/4279075135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d88004810 0x7f8d88004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d9c862640 1 -- 172.21.15.1:0/4279075135 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8d880051d0 msgr2=0x7f8d8800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d9c862640 1 --2- 172.21.15.1:0/4279075135 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8d880051d0 0x7f8d8800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d9c862640 1 -- 172.21.15.1:0/4279075135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d88004810 msgr2=0x7f8d88004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d9c862640 1 --2- 172.21.15.1:0/4279075135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d88004810 0x7f8d88004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d9d063640 1 -- 172.21.15.1:0/4279075135 reap_dead start 2024-09-15T21:56:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d9c862640 1 -- 172.21.15.1:0/4279075135 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d88003530 con 0x7f8d880039c0 2024-09-15T21:56:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d9c862640 1 --2- 172.21.15.1:0/4279075135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d880039c0 0x7f8d88003de0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009ac0 tx=0x7f8d8c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23eddb8a1a19bc0b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c009690 con 0x7f8d880039c0 2024-09-15T21:56:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d8c0a6430 con 0x7f8d880039c0 2024-09-15T21:56:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.668+0000 7f8d977fe640 1 -- 172.21.15.1:0/4279075135 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c0a6800 con 0x7f8d880039c0 2024-09-15T21:56:12.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 -- 172.21.15.1:0/4279075135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d880039c0 msgr2=0x7f8d88003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 --2- 172.21.15.1:0/4279075135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d880039c0 0x7f8d88003de0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009ac0 tx=0x7f8d8c01ca50 comp rx=0 tx=0).stop 2024-09-15T21:56:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 -- 172.21.15.1:0/4279075135 shutdown_connections 2024-09-15T21:56:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 --2- 172.21.15.1:0/4279075135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d880039c0 0x7f8d88003de0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 -- 172.21.15.1:0/4279075135 >> 172.21.15.1:0/4279075135 conn(0x7f8d9806c730 msgr2=0x7f8d980b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 -- 172.21.15.1:0/4279075135 shutdown_connections 2024-09-15T21:56:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 -- 172.21.15.1:0/4279075135 wait complete. 2024-09-15T21:56:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 Processor -- start 2024-09-15T21:56:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 -- start start 2024-09-15T21:56:12.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d880039c0 0x7f8d980b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8d9813efe0 0x7f8d981dc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d981e05b0 0x7f8d981dc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8d980af6b0 con 0x7f8d981e05b0 2024-09-15T21:56:12.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9809e640 con 0x7f8d880039c0 2024-09-15T21:56:12.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8d98144840 con 0x7f8d9813efe0 2024-09-15T21:56:12.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9d063640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d981e05b0 0x7f8d981dc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9d063640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d981e05b0 0x7f8d981dc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34794/0 (socket says 172.21.15.1:34794) 2024-09-15T21:56:12.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9d063640 1 -- 172.21.15.1:0/3842262827 learned_addr learned my addr 172.21.15.1:0/3842262827 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:12.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9c862640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d880039c0 0x7f8d980b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9d063640 1 -- 172.21.15.1:0/3842262827 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8d9813efe0 msgr2=0x7f8d981dc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9d063640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8d9813efe0 0x7f8d981dc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9d063640 1 -- 172.21.15.1:0/3842262827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d880039c0 msgr2=0x7f8d980b2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9d063640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d880039c0 0x7f8d980b2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9d063640 1 -- 172.21.15.1:0/3842262827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9813f4f0 con 0x7f8d981e05b0 2024-09-15T21:56:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9c862640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d880039c0 0x7f8d980b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9d063640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d981e05b0 0x7f8d981dc900 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8d980ae500 tx=0x7f8d9000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d957fa640 1 -- 172.21.15.1:0/3842262827 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90003980 con 0x7f8d981e05b0 2024-09-15T21:56:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d957fa640 1 -- 172.21.15.1:0/3842262827 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d90018070 con 0x7f8d981e05b0 2024-09-15T21:56:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d957fa640 1 -- 172.21.15.1:0/3842262827 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90003d80 con 0x7f8d981e05b0 2024-09-15T21:56:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 -- 172.21.15.1:0/3842262827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d981dfb30 con 0x7f8d981e05b0 2024-09-15T21:56:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 -- 172.21.15.1:0/3842262827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d980b2080 con 0x7f8d981e05b0 2024-09-15T21:56:12.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.672+0000 7f8d9eac6640 1 -- 172.21.15.1:0/3842262827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d98147ae0 con 0x7f8d981e05b0 2024-09-15T21:56:12.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.676+0000 7f8d957fa640 1 -- 172.21.15.1:0/3842262827 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8d900050d0 con 0x7f8d981e05b0 2024-09-15T21:56:12.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.676+0000 7f8d957fa640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f8d7c0678c0 0x7f8d7c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:12.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.676+0000 7f8d957fa640 1 -- 172.21.15.1:0/3842262827 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5795+0+0 (secure 0 0 0) 0x7f8d90085a20 con 0x7f8d981e05b0 2024-09-15T21:56:12.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.676+0000 7f8d9c862640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f8d7c0678c0 0x7f8d7c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:12.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.676+0000 7f8d9c862640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f8d7c0678c0 0x7f8d7c069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0ad000 tx=0x7f8d8c0a9040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:12.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.680+0000 7f8d957fa640 1 -- 172.21.15.1:0/3842262827 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8d981dfb30 con 0x7f8d981e05b0 2024-09-15T21:56:12.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:12.880+0000 7f8d9eac6640 1 -- 172.21.15.1:0/3842262827 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8d98073d50 con 0x7f8d981e05b0 2024-09-15T21:56:13.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.524+0000 7f8d957fa640 1 -- 172.21.15.1:0/3842262827 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f8d900564f0 con 0x7f8d981e05b0 2024-09-15T21:56:13.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.528+0000 7f8d9eac6640 1 -- 172.21.15.1:0/3842262827 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f8d7c0678c0 msgr2=0x7f8d7c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:13.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.528+0000 7f8d9eac6640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f8d7c0678c0 0x7f8d7c069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0ad000 tx=0x7f8d8c0a9040 comp rx=0 tx=0).stop 2024-09-15T21:56:13.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.528+0000 7f8d9eac6640 1 -- 172.21.15.1:0/3842262827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d981e05b0 msgr2=0x7f8d981dc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:13.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.528+0000 7f8d9eac6640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d981e05b0 0x7f8d981dc900 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8d980ae500 tx=0x7f8d9000ec10 comp rx=0 tx=0).stop 2024-09-15T21:56:13.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.528+0000 7f8d9eac6640 1 -- 172.21.15.1:0/3842262827 shutdown_connections 2024-09-15T21:56:13.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.528+0000 7f8d9eac6640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8d981e05b0 0x7f8d981dc900 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:13.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.528+0000 7f8d9eac6640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8d9813efe0 0x7f8d981dc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:13.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.528+0000 7f8d9eac6640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f8d7c0678c0 0x7f8d7c069d80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:13.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.528+0000 7f8d9eac6640 1 --2- 172.21.15.1:0/3842262827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d880039c0 0x7f8d980b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:13.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.528+0000 7f8d9eac6640 1 -- 172.21.15.1:0/3842262827 >> 172.21.15.1:0/3842262827 conn(0x7f8d9806c730 msgr2=0x7f8d9809cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:13.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.528+0000 7f8d9eac6640 1 -- 172.21.15.1:0/3842262827 shutdown_connections 2024-09-15T21:56:13.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.528+0000 7f8d9eac6640 1 -- 172.21.15.1:0/3842262827 wait complete. 2024-09-15T21:56:13.557 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T21:56:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.728+0000 7f4bd7cee640 1 Processor -- start 2024-09-15T21:56:13.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.728+0000 7f4bd7cee640 1 -- start start 2024-09-15T21:56:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd7cee640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4bd0148120 0x7f4bd0144c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd7cee640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bd01451c0 0x7f4bd0072bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd7cee640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd0148a00 con 0x7f4bd0147d40 2024-09-15T21:56:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd7cee640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd00b6a30 con 0x7f4bd0148120 2024-09-15T21:56:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd7cee640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd0148720 con 0x7f4bd01451c0 2024-09-15T21:56:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd5289640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4bd0148120 0x7f4bd0144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd5289640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4bd0148120 0x7f4bd0144c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34798/0 (socket says 172.21.15.1:34798) 2024-09-15T21:56:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd5289640 1 -- 172.21.15.1:0/226039298 learned_addr learned my addr 172.21.15.1:0/226039298 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd628b640 1 --2- 172.21.15.1:0/226039298 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bd01451c0 0x7f4bd0072bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd5289640 1 -- 172.21.15.1:0/226039298 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bd01451c0 msgr2=0x7f4bd0072bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:13.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd5289640 1 --2- 172.21.15.1:0/226039298 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bd01451c0 0x7f4bd0072bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd5289640 1 -- 172.21.15.1:0/226039298 >> v1:172.21.15.70:6789/0 conn(0x7f4bd0147d40 legacy=0x7f4bd00b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:13.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd5289640 1 -- 172.21.15.1:0/226039298 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd00730f0 con 0x7f4bd0148120 2024-09-15T21:56:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd5289640 1 --2- 172.21.15.1:0/226039298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bd0148120 0x7f4bd0144c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009870 tx=0x7f4bc001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd13e3907576fe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd4a88640 1 -- 172.21.15.1:0/226039298 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00b0070 con 0x7f4bd0148120 2024-09-15T21:56:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd4a88640 1 -- 172.21.15.1:0/226039298 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc00ab600 con 0x7f4bd0148120 2024-09-15T21:56:13.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd4a88640 1 -- 172.21.15.1:0/226039298 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00ab9d0 con 0x7f4bd0148120 2024-09-15T21:56:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd7cee640 1 -- 172.21.15.1:0/226039298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bd0148120 msgr2=0x7f4bd0144c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd7cee640 1 --2- 172.21.15.1:0/226039298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bd0148120 0x7f4bd0144c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009870 tx=0x7f4bc001c400 comp rx=0 tx=0).stop 2024-09-15T21:56:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd7cee640 1 -- 172.21.15.1:0/226039298 shutdown_connections 2024-09-15T21:56:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd7cee640 1 --2- 172.21.15.1:0/226039298 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bd01451c0 0x7f4bd0072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd7cee640 1 --2- 172.21.15.1:0/226039298 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bd0148120 0x7f4bd0144c80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd7cee640 1 -- 172.21.15.1:0/226039298 >> 172.21.15.1:0/226039298 conn(0x7f4bd009d160 msgr2=0x7f4bd009d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd7cee640 1 -- 172.21.15.1:0/226039298 shutdown_connections 2024-09-15T21:56:13.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.732+0000 7f4bd7cee640 1 -- 172.21.15.1:0/226039298 wait complete. 2024-09-15T21:56:13.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd7cee640 1 Processor -- start 2024-09-15T21:56:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd7cee640 1 -- start start 2024-09-15T21:56:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd7cee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bd01451c0 0x7f4bd00b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd7cee640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bd0147d40 0x7f4bd0141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd7cee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bd0148120 0x7f4bd0141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd7cee640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd0154f40 con 0x7f4bd01451c0 2024-09-15T21:56:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd7cee640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd0154dc0 con 0x7f4bd0148120 2024-09-15T21:56:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd7cee640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd01550c0 con 0x7f4bd0147d40 2024-09-15T21:56:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd5a8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bd01451c0 0x7f4bd00b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd5a8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bd01451c0 0x7f4bd00b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34804/0 (socket says 172.21.15.1:34804) 2024-09-15T21:56:13.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd5a8a640 1 -- 172.21.15.1:0/2178350925 learned_addr learned my addr 172.21.15.1:0/2178350925 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd628b640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bd0148120 0x7f4bd0141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd5289640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bd0147d40 0x7f4bd0141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd5a8a640 1 -- 172.21.15.1:0/2178350925 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bd0147d40 msgr2=0x7f4bd0141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd5a8a640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bd0147d40 0x7f4bd0141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd5a8a640 1 -- 172.21.15.1:0/2178350925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bd0148120 msgr2=0x7f4bd0141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd5a8a640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bd0148120 0x7f4bd0141ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd5a8a640 1 -- 172.21.15.1:0/2178350925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd014aec0 con 0x7f4bd01451c0 2024-09-15T21:56:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd5a8a640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bd01451c0 0x7f4bd00b4b20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00c450 tx=0x7f4bcc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bc67fc640 1 -- 172.21.15.1:0/2178350925 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc012830 con 0x7f4bd01451c0 2024-09-15T21:56:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bc67fc640 1 -- 172.21.15.1:0/2178350925 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bcc017070 con 0x7f4bd01451c0 2024-09-15T21:56:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bc67fc640 1 -- 172.21.15.1:0/2178350925 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc012c30 con 0x7f4bd01451c0 2024-09-15T21:56:13.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd7cee640 1 -- 172.21.15.1:0/2178350925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd00a0f50 con 0x7f4bd01451c0 2024-09-15T21:56:13.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd7cee640 1 -- 172.21.15.1:0/2178350925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd014b130 con 0x7f4bd01451c0 2024-09-15T21:56:13.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.736+0000 7f4bd7cee640 1 -- 172.21.15.1:0/2178350925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd0072bb0 con 0x7f4bd01451c0 2024-09-15T21:56:13.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.740+0000 7f4bc67fc640 1 -- 172.21.15.1:0/2178350925 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4bcc01c460 con 0x7f4bd01451c0 2024-09-15T21:56:13.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.740+0000 7f4bc67fc640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4bb40678f0 0x7f4bb4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:13.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.740+0000 7f4bc67fc640 1 -- 172.21.15.1:0/2178350925 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5795+0+0 (secure 0 0 0) 0x7f4bcc085a80 con 0x7f4bd01451c0 2024-09-15T21:56:13.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.740+0000 7f4bd5289640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4bb40678f0 0x7f4bb4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:13.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.740+0000 7f4bd5289640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4bb40678f0 0x7f4bb4069db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00ad000 tx=0x7f4bc0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:13.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.744+0000 7f4bc67fc640 1 -- 172.21.15.1:0/2178350925 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4bcc087e20 con 0x7f4bd01451c0 2024-09-15T21:56:13.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:13.904+0000 7f4bd7cee640 1 -- 172.21.15.1:0/2178350925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4bd0145b80 con 0x7f4bd01451c0 2024-09-15T21:56:14.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.532+0000 7f4bc67fc640 1 -- 172.21.15.1:0/2178350925 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) ==== 181+0+0 (secure 0 0 0) 0x7f4bcc056550 con 0x7f4bd01451c0 2024-09-15T21:56:14.539 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2024-09-15T21:56:14.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.536+0000 7f4bd7cee640 1 -- 172.21.15.1:0/2178350925 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4bb40678f0 msgr2=0x7f4bb4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:14.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.536+0000 7f4bd7cee640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4bb40678f0 0x7f4bb4069db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00ad000 tx=0x7f4bc0008040 comp rx=0 tx=0).stop 2024-09-15T21:56:14.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.536+0000 7f4bd7cee640 1 -- 172.21.15.1:0/2178350925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bd01451c0 msgr2=0x7f4bd00b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:14.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.536+0000 7f4bd7cee640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bd01451c0 0x7f4bd00b4b20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00c450 tx=0x7f4bcc00c910 comp rx=0 tx=0).stop 2024-09-15T21:56:14.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.536+0000 7f4bd7cee640 1 -- 172.21.15.1:0/2178350925 shutdown_connections 2024-09-15T21:56:14.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.536+0000 7f4bd7cee640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4bb40678f0 0x7f4bb4069db0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:14.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.536+0000 7f4bd7cee640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bd0148120 0x7f4bd0141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:14.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.536+0000 7f4bd7cee640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4bd0147d40 0x7f4bd0141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:14.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.536+0000 7f4bd7cee640 1 --2- 172.21.15.1:0/2178350925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4bd01451c0 0x7f4bd00b4b20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:14.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.536+0000 7f4bd7cee640 1 -- 172.21.15.1:0/2178350925 >> 172.21.15.1:0/2178350925 conn(0x7f4bd009d160 msgr2=0x7f4bd01440a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:14.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.536+0000 7f4bd7cee640 1 -- 172.21.15.1:0/2178350925 shutdown_connections 2024-09-15T21:56:14.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.540+0000 7f4bd7cee640 1 -- 172.21.15.1:0/2178350925 wait complete. 2024-09-15T21:56:14.565 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T21:56:14.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.684+0000 7f25703f8640 1 Processor -- start 2024-09-15T21:56:14.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.684+0000 7f25703f8640 1 -- start start 2024-09-15T21:56:14.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.684+0000 7f25703f8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2568071cb0 0x7f2568073d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:14.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f25703f8640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2568147880 0x7f2568152180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:14.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f25703f8640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2568073230 con 0x7f256806bcc0 2024-09-15T21:56:14.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f25703f8640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f2568145330 con 0x7f2568147880 2024-09-15T21:56:14.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f25703f8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f2568147cd0 con 0x7f2568071cb0 2024-09-15T21:56:14.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f256e995640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2568147880 0x7f2568152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:14.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f256d993640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f256806bcc0 0x7f25680b60b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51822/0 (socket says 172.21.15.1:51822) 2024-09-15T21:56:14.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f256d993640 1 -- 172.21.15.1:0/2839697722 learned_addr learned my addr 172.21.15.1:0/2839697722 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:14.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f256e194640 1 --2- 172.21.15.1:0/2839697722 >> v2:172.21.15.70:3300/0 conn(0x7f2568071cb0 0x7f2568073d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:14.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f256e995640 1 -- 172.21.15.1:0/2839697722 >> v2:172.21.15.70:3300/0 conn(0x7f2568071cb0 msgr2=0x7f2568073d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:14.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f256e995640 1 --2- 172.21.15.1:0/2839697722 >> v2:172.21.15.70:3300/0 conn(0x7f2568071cb0 0x7f2568073d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:14.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f256e995640 1 -- 172.21.15.1:0/2839697722 >> v1:172.21.15.1:6789/0 conn(0x7f256806bcc0 legacy=0x7f25680b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:14.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f256d192640 1 -- 172.21.15.1:0/2839697722 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2266198074 0 0) 0x7f2568073230 con 0x7f256806bcc0 2024-09-15T21:56:14.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f256e995640 1 -- 172.21.15.1:0/2839697722 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256806cb70 con 0x7f2568147880 2024-09-15T21:56:14.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f256e995640 1 --2- 172.21.15.1:0/2839697722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2568147880 0x7f2568152180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f25680b7e80 tx=0x7f256001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21340b81baef3d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:14.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f256d192640 1 -- 172.21.15.1:0/2839697722 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25600b2070 con 0x7f2568147880 2024-09-15T21:56:14.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f256d192640 1 -- 172.21.15.1:0/2839697722 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25600a5850 con 0x7f2568147880 2024-09-15T21:56:14.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f256d192640 1 -- 172.21.15.1:0/2839697722 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25600a5c20 con 0x7f2568147880 2024-09-15T21:56:14.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f25703f8640 1 -- 172.21.15.1:0/2839697722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2568147880 msgr2=0x7f2568152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:14.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f25703f8640 1 --2- 172.21.15.1:0/2839697722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2568147880 0x7f2568152180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f25680b7e80 tx=0x7f256001c8a0 comp rx=0 tx=0).stop 2024-09-15T21:56:14.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f25703f8640 1 -- 172.21.15.1:0/2839697722 shutdown_connections 2024-09-15T21:56:14.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f25703f8640 1 --2- 172.21.15.1:0/2839697722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2568147880 0x7f2568152180 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:14.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f25703f8640 1 --2- 172.21.15.1:0/2839697722 >> v2:172.21.15.70:3300/0 conn(0x7f2568071cb0 0x7f2568073d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:14.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f25703f8640 1 -- 172.21.15.1:0/2839697722 >> 172.21.15.1:0/2839697722 conn(0x7f25680ba370 msgr2=0x7f25680ba780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:14.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f25703f8640 1 -- 172.21.15.1:0/2839697722 shutdown_connections 2024-09-15T21:56:14.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.688+0000 7f25703f8640 1 -- 172.21.15.1:0/2839697722 wait complete. 2024-09-15T21:56:14.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f25703f8640 1 Processor -- start 2024-09-15T21:56:14.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f25703f8640 1 -- start start 2024-09-15T21:56:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f25703f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f256806bcc0 0x7f25680b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f25703f8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2568071cb0 0x7f25680ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f25703f8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2568147880 0x7f25680ade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f25703f8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f25680b6940 con 0x7f2568147880 2024-09-15T21:56:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f25703f8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f25680b67c0 con 0x7f256806bcc0 2024-09-15T21:56:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f25703f8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f25680b6ae0 con 0x7f2568071cb0 2024-09-15T21:56:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f256e995640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2568147880 0x7f25680ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f256e995640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2568147880 0x7f25680ade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34830/0 (socket says 172.21.15.1:34830) 2024-09-15T21:56:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f256e995640 1 -- 172.21.15.1:0/4035282076 learned_addr learned my addr 172.21.15.1:0/4035282076 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:14.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f256e194640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f256806bcc0 0x7f25680b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f256d993640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2568071cb0 0x7f25680ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f256e995640 1 -- 172.21.15.1:0/4035282076 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2568071cb0 msgr2=0x7f25680ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f256e995640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2568071cb0 0x7f25680ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f256e995640 1 -- 172.21.15.1:0/4035282076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f256806bcc0 msgr2=0x7f25680b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f256e995640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f256806bcc0 0x7f25680b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f256e995640 1 -- 172.21.15.1:0/4035282076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256814abb0 con 0x7f2568147880 2024-09-15T21:56:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f256e194640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f256806bcc0 0x7f25680b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f256e995640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2568147880 0x7f25680ade10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f25600194b0 tx=0x7f2560019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f255effd640 1 -- 172.21.15.1:0/4035282076 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25600b2050 con 0x7f2568147880 2024-09-15T21:56:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f255effd640 1 -- 172.21.15.1:0/4035282076 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25600b3040 con 0x7f2568147880 2024-09-15T21:56:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f25703f8640 1 -- 172.21.15.1:0/4035282076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256814b9d0 con 0x7f2568147880 2024-09-15T21:56:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f255effd640 1 -- 172.21.15.1:0/4035282076 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25600ad850 con 0x7f2568147880 2024-09-15T21:56:14.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f25703f8640 1 -- 172.21.15.1:0/4035282076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256814ae50 con 0x7f2568147880 2024-09-15T21:56:14.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f25703f8640 1 -- 172.21.15.1:0/4035282076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2568073d80 con 0x7f2568147880 2024-09-15T21:56:14.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.692+0000 7f255effd640 1 -- 172.21.15.1:0/4035282076 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f25600c0020 con 0x7f2568147880 2024-09-15T21:56:14.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.696+0000 7f255effd640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f254c0678c0 0x7f254c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:14.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.696+0000 7f255effd640 1 -- 172.21.15.1:0/4035282076 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5357+0+0 (secure 0 0 0) 0x7f2560120570 con 0x7f2568147880 2024-09-15T21:56:14.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.696+0000 7f256e194640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f254c0678c0 0x7f254c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:14.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.696+0000 7f256e194640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f254c0678c0 0x7f254c069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2564009840 tx=0x7f2564008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:14.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.700+0000 7f255effd640 1 -- 172.21.15.1:0/4035282076 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2560016520 con 0x7f2568147880 2024-09-15T21:56:14.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:14.860+0000 7f25703f8640 1 -- 172.21.15.1:0/4035282076 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2568072ee0 con 0x7f2568147880 2024-09-15T21:56:15.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.540+0000 7f255effd640 1 -- 172.21.15.1:0/4035282076 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) ==== 169+0+0 (secure 0 0 0) 0x7f25600f1340 con 0x7f2568147880 2024-09-15T21:56:15.546 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2024-09-15T21:56:15.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.552+0000 7f25703f8640 1 -- 172.21.15.1:0/4035282076 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f254c0678c0 msgr2=0x7f254c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:15.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.552+0000 7f25703f8640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f254c0678c0 0x7f254c069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2564009840 tx=0x7f2564008040 comp rx=0 tx=0).stop 2024-09-15T21:56:15.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.552+0000 7f25703f8640 1 -- 172.21.15.1:0/4035282076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2568147880 msgr2=0x7f25680ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:15.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.552+0000 7f25703f8640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2568147880 0x7f25680ade10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f25600194b0 tx=0x7f2560019640 comp rx=0 tx=0).stop 2024-09-15T21:56:15.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.552+0000 7f25703f8640 1 -- 172.21.15.1:0/4035282076 shutdown_connections 2024-09-15T21:56:15.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.552+0000 7f25703f8640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2568147880 0x7f25680ade10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.552+0000 7f25703f8640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2568071cb0 0x7f25680ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.552+0000 7f25703f8640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f254c0678c0 0x7f254c069d80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.552+0000 7f25703f8640 1 --2- 172.21.15.1:0/4035282076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f256806bcc0 0x7f25680b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.552+0000 7f25703f8640 1 -- 172.21.15.1:0/4035282076 >> 172.21.15.1:0/4035282076 conn(0x7f25680ba370 msgr2=0x7f25680b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:15.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.552+0000 7f25703f8640 1 -- 172.21.15.1:0/4035282076 shutdown_connections 2024-09-15T21:56:15.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.552+0000 7f25703f8640 1 -- 172.21.15.1:0/4035282076 wait complete. 2024-09-15T21:56:15.579 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T21:56:15.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.704+0000 7f8b31c01640 1 Processor -- start 2024-09-15T21:56:15.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.704+0000 7f8b31c01640 1 -- start start 2024-09-15T21:56:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b31c01640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8b2c144b40 0x7f8b2c0b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b31c01640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b2c0af2a0 0x7f8b2c14e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b31c01640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b2c06dfa0 con 0x7f8b2c06dbc0 2024-09-15T21:56:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b31c01640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f8b2c0b00e0 con 0x7f8b2c144b40 2024-09-15T21:56:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b31c01640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8b2c09e640 con 0x7f8b2c0af2a0 2024-09-15T21:56:15.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2b7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8b2c06dbc0 0x7f8b2c144430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51834/0 (socket says 172.21.15.1:51834) 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2b7fe640 1 -- 172.21.15.1:0/3595820041 learned_addr learned my addr 172.21.15.1:0/3595820041 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b22ffd640 1 --2- 172.21.15.1:0/3595820041 >> v2:172.21.15.70:3300/0 conn(0x7f8b2c144b40 0x7f8b2c0b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2bfff640 1 --2- 172.21.15.1:0/3595820041 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b2c0af2a0 0x7f8b2c14e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132966603 0 0) 0x7f8b2c06dfa0 con 0x7f8b2c06dbc0 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b18003530 con 0x7f8b2c06dbc0 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3734962811 0 0) 0x7f8b18003530 con 0x7f8b2c06dbc0 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b2c0af2a0 msgr2=0x7f8b2c14e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 --2- 172.21.15.1:0/3595820041 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b2c0af2a0 0x7f8b2c14e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 >> v2:172.21.15.70:3300/0 conn(0x7f8b2c144b40 msgr2=0x7f8b2c0b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 --2- 172.21.15.1:0/3595820041 >> v2:172.21.15.70:3300/0 conn(0x7f8b2c144b40 0x7f8b2c0b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2c0b55d0 con 0x7f8b2c06dbc0 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f8b1c001680 con 0x7f8b2c06dbc0 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 >> v1:172.21.15.1:6789/0 conn(0x7f8b2c06dbc0 legacy=0x7f8b2c144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:15.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 --2- 172.21.15.1:0/3595820041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b180039c0 0x7f8b18003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 --2- 172.21.15.1:0/3595820041 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b2c0af2a0 0x7f8b18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 --2- 172.21.15.1:0/3595820041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b18004d50 0x7f8b180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c0b00e0 con 0x7f8b180039c0 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c09e640 con 0x7f8b18004d50 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1800ba00 con 0x7f8b2c0af2a0 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2b7fe640 1 --2- 172.21.15.1:0/3595820041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b180039c0 0x7f8b18003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2bfff640 1 --2- 172.21.15.1:0/3595820041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b18004d50 0x7f8b180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2b7fe640 1 -- 172.21.15.1:0/3595820041 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b2c0af2a0 msgr2=0x7f8b18004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b22ffd640 1 --2- 172.21.15.1:0/3595820041 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b2c0af2a0 0x7f8b18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2b7fe640 1 --2- 172.21.15.1:0/3595820041 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b2c0af2a0 0x7f8b18004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2b7fe640 1 -- 172.21.15.1:0/3595820041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b18004d50 msgr2=0x7f8b180051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2b7fe640 1 --2- 172.21.15.1:0/3595820041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b18004d50 0x7f8b180051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2b7fe640 1 -- 172.21.15.1:0/3595820041 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b18003530 con 0x7f8b180039c0 2024-09-15T21:56:15.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.708+0000 7f8b2bfff640 1 --2- 172.21.15.1:0/3595820041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b18004d50 0x7f8b180051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:15.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b2b7fe640 1 --2- 172.21.15.1:0/3595820041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b180039c0 0x7f8b18003de0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c001060 tx=0x7f8b1c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c85b4fcaa6c69e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c007d80 con 0x7f8b180039c0 2024-09-15T21:56:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1c0a9020 con 0x7f8b180039c0 2024-09-15T21:56:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b2affd640 1 -- 172.21.15.1:0/3595820041 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c005b00 con 0x7f8b180039c0 2024-09-15T21:56:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 -- 172.21.15.1:0/3595820041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b180039c0 msgr2=0x7f8b18003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 --2- 172.21.15.1:0/3595820041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b180039c0 0x7f8b18003de0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c001060 tx=0x7f8b1c01cca0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b2bfff640 1 -- 172.21.15.1:0/3595820041 reap_dead start 2024-09-15T21:56:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 -- 172.21.15.1:0/3595820041 shutdown_connections 2024-09-15T21:56:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 -- 172.21.15.1:0/3595820041 >> 172.21.15.1:0/3595820041 conn(0x7f8b2c06c730 msgr2=0x7f8b2c0b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 -- 172.21.15.1:0/3595820041 shutdown_connections 2024-09-15T21:56:15.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 -- 172.21.15.1:0/3595820041 wait complete. 2024-09-15T21:56:15.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 Processor -- start 2024-09-15T21:56:15.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 -- start start 2024-09-15T21:56:15.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b180039c0 0x7f8b2c13c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c13c6f0 0x7f8b2c1e1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b2c1e1ca0 0x7f8b2c1ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c0af680 con 0x7f8b2c13c6f0 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c09be30 con 0x7f8b180039c0 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f8b2c072510 con 0x7f8b2c1e1ca0 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b22ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c13c6f0 0x7f8b2c1e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b22ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c13c6f0 0x7f8b2c1e1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34848/0 (socket says 172.21.15.1:34848) 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b22ffd640 1 -- 172.21.15.1:0/3415186229 learned_addr learned my addr 172.21.15.1:0/3415186229 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b2b7fe640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b180039c0 0x7f8b2c13c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b22ffd640 1 -- 172.21.15.1:0/3415186229 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b2c1e1ca0 msgr2=0x7f8b2c1ddf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b2bfff640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b2c1e1ca0 0x7f8b2c1ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b22ffd640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b2c1e1ca0 0x7f8b2c1ddf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b22ffd640 1 -- 172.21.15.1:0/3415186229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b180039c0 msgr2=0x7f8b2c13c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:15.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b22ffd640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b180039c0 0x7f8b2c13c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b22ffd640 1 -- 172.21.15.1:0/3415186229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2c072a60 con 0x7f8b2c13c6f0 2024-09-15T21:56:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b2b7fe640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b180039c0 0x7f8b2c13c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b22ffd640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c13c6f0 0x7f8b2c1e1760 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8b140108d0 tx=0x7f8b14010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b28ff9640 1 -- 172.21.15.1:0/3415186229 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400f040 con 0x7f8b2c13c6f0 2024-09-15T21:56:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b28ff9640 1 -- 172.21.15.1:0/3415186229 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1400eb00 con 0x7f8b2c13c6f0 2024-09-15T21:56:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 -- 172.21.15.1:0/3415186229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2c148040 con 0x7f8b2c13c6f0 2024-09-15T21:56:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b28ff9640 1 -- 172.21.15.1:0/3415186229 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1401c400 con 0x7f8b2c13c6f0 2024-09-15T21:56:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.712+0000 7f8b31c01640 1 -- 172.21.15.1:0/3415186229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b2c072780 con 0x7f8b2c13c6f0 2024-09-15T21:56:15.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.716+0000 7f8b31c01640 1 -- 172.21.15.1:0/3415186229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b2c147090 con 0x7f8b2c13c6f0 2024-09-15T21:56:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.716+0000 7f8b28ff9640 1 -- 172.21.15.1:0/3415186229 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8b140143f0 con 0x7f8b2c13c6f0 2024-09-15T21:56:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.716+0000 7f8b28ff9640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f8b0c0678c0 0x7f8b0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.716+0000 7f8b28ff9640 1 -- 172.21.15.1:0/3415186229 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f8b14085fe0 con 0x7f8b2c13c6f0 2024-09-15T21:56:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.716+0000 7f8b2b7fe640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f8b0c0678c0 0x7f8b0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:15.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.716+0000 7f8b2b7fe640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f8b0c0678c0 0x7f8b0c069d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0aa000 tx=0x7f8b1c001a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:15.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.720+0000 7f8b28ff9640 1 -- 172.21.15.1:0/3415186229 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8b14018030 con 0x7f8b2c13c6f0 2024-09-15T21:56:15.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.888+0000 7f8b31c01640 1 -- 172.21.15.1:0/3415186229 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f8b2c0b4b50 con 0x7f8b2c13c6f0 2024-09-15T21:56:15.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.892+0000 7f8b28ff9640 1 -- 172.21.15.1:0/3415186229 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f8b14056e30 con 0x7f8b2c13c6f0 2024-09-15T21:56:15.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.896+0000 7f8b31c01640 1 -- 172.21.15.1:0/3415186229 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f8b0c0678c0 msgr2=0x7f8b0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:15.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.896+0000 7f8b31c01640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f8b0c0678c0 0x7f8b0c069d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0aa000 tx=0x7f8b1c001a50 comp rx=0 tx=0).stop 2024-09-15T21:56:15.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.896+0000 7f8b31c01640 1 -- 172.21.15.1:0/3415186229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c13c6f0 msgr2=0x7f8b2c1e1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:15.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.896+0000 7f8b31c01640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c13c6f0 0x7f8b2c1e1760 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8b140108d0 tx=0x7f8b14010d90 comp rx=0 tx=0).stop 2024-09-15T21:56:15.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.896+0000 7f8b31c01640 1 -- 172.21.15.1:0/3415186229 shutdown_connections 2024-09-15T21:56:15.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.896+0000 7f8b31c01640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8b2c1e1ca0 0x7f8b2c1ddf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.896+0000 7f8b31c01640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b2c13c6f0 0x7f8b2c1e1760 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.896+0000 7f8b31c01640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f8b0c0678c0 0x7f8b0c069d80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.896+0000 7f8b31c01640 1 --2- 172.21.15.1:0/3415186229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b180039c0 0x7f8b2c13c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:15.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.896+0000 7f8b31c01640 1 -- 172.21.15.1:0/3415186229 >> 172.21.15.1:0/3415186229 conn(0x7f8b2c06c730 msgr2=0x7f8b2c09c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:15.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.896+0000 7f8b31c01640 1 -- 172.21.15.1:0/3415186229 shutdown_connections 2024-09-15T21:56:15.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:15.896+0000 7f8b31c01640 1 -- 172.21.15.1:0/3415186229 wait complete. 2024-09-15T21:56:15.919 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args' 2024-09-15T21:56:16.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.040+0000 7efec94a2640 1 Processor -- start 2024-09-15T21:56:16.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.040+0000 7efec94a2640 1 -- start start 2024-09-15T21:56:16.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec94a2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efec40ae3a0 0x7efec409eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:16.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec94a2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efec40af160 0x7efec414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:16.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec94a2640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec40b00f0 con 0x7efec40b4c50 2024-09-15T21:56:16.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec94a2640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7efec40afe10 con 0x7efec40ae3a0 2024-09-15T21:56:16.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec94a2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7efec40b50e0 con 0x7efec40af160 2024-09-15T21:56:16.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec2ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efec40ae3a0 0x7efec409eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:16.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec27fc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7efec40b4c50 0x7efec4147ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:51842/0 (socket says 172.21.15.1:51842) 2024-09-15T21:56:16.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec27fc640 1 -- 172.21.15.1:0/1580307805 learned_addr learned my addr 172.21.15.1:0/1580307805 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:16.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec37fe640 1 --2- 172.21.15.1:0/1580307805 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efec40af160 0x7efec414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:16.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec2ffd640 1 -- 172.21.15.1:0/1580307805 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efec40af160 msgr2=0x7efec414eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:16.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec2ffd640 1 --2- 172.21.15.1:0/1580307805 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efec40af160 0x7efec414eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:16.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec2ffd640 1 -- 172.21.15.1:0/1580307805 >> v1:172.21.15.1:6789/0 conn(0x7efec40b4c50 legacy=0x7efec4147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:16.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec2ffd640 1 -- 172.21.15.1:0/1580307805 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec40b53c0 con 0x7efec40ae3a0 2024-09-15T21:56:16.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec1ffb640 1 -- 172.21.15.1:0/1580307805 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 612015417 0 0) 0x7efec40b00f0 con 0x7efec40b4c50 2024-09-15T21:56:16.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec37fe640 1 --2- 172.21.15.1:0/1580307805 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efec40af160 0x7efec414eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:16.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec2ffd640 1 --2- 172.21.15.1:0/1580307805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efec40ae3a0 0x7efec409eb50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efebc00bfa0 tx=0x7efebc01eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0011fb5f3900e56 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:16.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec1ffb640 1 -- 172.21.15.1:0/1580307805 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc00b2d0 con 0x7efec40ae3a0 2024-09-15T21:56:16.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec1ffb640 1 -- 172.21.15.1:0/1580307805 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efebc0a78a0 con 0x7efec40ae3a0 2024-09-15T21:56:16.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec1ffb640 1 -- 172.21.15.1:0/1580307805 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc0a7c70 con 0x7efec40ae3a0 2024-09-15T21:56:16.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec94a2640 1 -- 172.21.15.1:0/1580307805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efec40ae3a0 msgr2=0x7efec409eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:16.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec94a2640 1 --2- 172.21.15.1:0/1580307805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efec40ae3a0 0x7efec409eb50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efebc00bfa0 tx=0x7efebc01eab0 comp rx=0 tx=0).stop 2024-09-15T21:56:16.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec94a2640 1 -- 172.21.15.1:0/1580307805 shutdown_connections 2024-09-15T21:56:16.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec94a2640 1 --2- 172.21.15.1:0/1580307805 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efec40af160 0x7efec414eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:16.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec94a2640 1 --2- 172.21.15.1:0/1580307805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efec40ae3a0 0x7efec409eb50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:16.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec94a2640 1 -- 172.21.15.1:0/1580307805 >> 172.21.15.1:0/1580307805 conn(0x7efec40b5c40 msgr2=0x7efec40b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:16.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec94a2640 1 -- 172.21.15.1:0/1580307805 shutdown_connections 2024-09-15T21:56:16.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.044+0000 7efec94a2640 1 -- 172.21.15.1:0/1580307805 wait complete. 2024-09-15T21:56:16.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec94a2640 1 Processor -- start 2024-09-15T21:56:16.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec94a2640 1 -- start start 2024-09-15T21:56:16.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec94a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efec40ae3a0 0x7efec4142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:16.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec94a2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efec40af160 0x7efec4071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:16.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec94a2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efec41e3c70 0x7efec40b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:16.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec94a2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efec40b46e0 con 0x7efec40ae3a0 2024-09-15T21:56:16.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec94a2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efec40b4560 con 0x7efec40af160 2024-09-15T21:56:16.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec94a2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7efec40b4860 con 0x7efec41e3c70 2024-09-15T21:56:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efec40ae3a0 0x7efec4142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efec40ae3a0 0x7efec4142790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34856/0 (socket says 172.21.15.1:34856) 2024-09-15T21:56:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec2ffd640 1 -- 172.21.15.1:0/3550091339 learned_addr learned my addr 172.21.15.1:0/3550091339 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec27fc640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efec40af160 0x7efec4071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec37fe640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efec41e3c70 0x7efec40b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec2ffd640 1 -- 172.21.15.1:0/3550091339 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efec41e3c70 msgr2=0x7efec40b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec2ffd640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efec41e3c70 0x7efec40b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec2ffd640 1 -- 172.21.15.1:0/3550091339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efec40af160 msgr2=0x7efec4071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec2ffd640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efec40af160 0x7efec4071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec2ffd640 1 -- 172.21.15.1:0/3550091339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec4071960 con 0x7efec40ae3a0 2024-09-15T21:56:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec27fc640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efec40af160 0x7efec4071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec2ffd640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efec40ae3a0 0x7efec4142790 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efebc01c6e0 tx=0x7efebc01b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:16.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efeab7fe640 1 -- 172.21.15.1:0/3550091339 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc009750 con 0x7efec40ae3a0 2024-09-15T21:56:16.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efeab7fe640 1 -- 172.21.15.1:0/3550091339 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efebc009950 con 0x7efec40ae3a0 2024-09-15T21:56:16.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efeab7fe640 1 -- 172.21.15.1:0/3550091339 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc009d40 con 0x7efec40ae3a0 2024-09-15T21:56:16.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec94a2640 1 -- 172.21.15.1:0/3550091339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec4142ee0 con 0x7efec40ae3a0 2024-09-15T21:56:16.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec94a2640 1 -- 172.21.15.1:0/3550091339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec41e4550 con 0x7efec40ae3a0 2024-09-15T21:56:16.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.048+0000 7efec94a2640 1 -- 172.21.15.1:0/3550091339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec40b30f0 con 0x7efec40ae3a0 2024-09-15T21:56:16.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.052+0000 7efeab7fe640 1 -- 172.21.15.1:0/3550091339 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efebc0c0020 con 0x7efec40ae3a0 2024-09-15T21:56:16.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.052+0000 7efeab7fe640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efeb00678c0 0x7efeb0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:16.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.052+0000 7efeab7fe640 1 -- 172.21.15.1:0/3550091339 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7efebc120280 con 0x7efec40ae3a0 2024-09-15T21:56:16.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.052+0000 7efec27fc640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efeb00678c0 0x7efeb0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:16.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.052+0000 7efec27fc640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efeb00678c0 0x7efeb0069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efec4070df0 tx=0x7efeb8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:16.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.056+0000 7efeab7fe640 1 -- 172.21.15.1:0/3550091339 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efebc0c7020 con 0x7efec40ae3a0 2024-09-15T21:56:16.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.276+0000 7efec94a2640 1 -- 172.21.15.1:0/3550091339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]} v 0) -- 0x7efec409eb50 con 0x7efec40ae3a0 2024-09-15T21:56:16.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.544+0000 7efeab7fe640 1 -- 172.21.15.1:0/3550091339 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_cephfs_shell.TestCD.test_cd_with_args"]}]=0 v75) ==== 134+0+0 (secure 0 0 0) 0x7efebc018760 con 0x7efec40ae3a0 2024-09-15T21:56:16.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.544+0000 7efec94a2640 1 -- 172.21.15.1:0/3550091339 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efeb00678c0 msgr2=0x7efeb0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:16.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.544+0000 7efec94a2640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efeb00678c0 0x7efeb0069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efec4070df0 tx=0x7efeb8009040 comp rx=0 tx=0).stop 2024-09-15T21:56:16.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.544+0000 7efec94a2640 1 -- 172.21.15.1:0/3550091339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efec40ae3a0 msgr2=0x7efec4142790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:16.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.544+0000 7efec94a2640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efec40ae3a0 0x7efec4142790 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efebc01c6e0 tx=0x7efebc01b850 comp rx=0 tx=0).stop 2024-09-15T21:56:16.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.544+0000 7efec94a2640 1 -- 172.21.15.1:0/3550091339 shutdown_connections 2024-09-15T21:56:16.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.544+0000 7efec94a2640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efec41e3c70 0x7efec40b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:16.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.544+0000 7efec94a2640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7efeb00678c0 0x7efeb0069d80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:16.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.544+0000 7efec94a2640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efec40af160 0x7efec4071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:16.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.544+0000 7efec94a2640 1 --2- 172.21.15.1:0/3550091339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efec40ae3a0 0x7efec4142790 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:16.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.544+0000 7efec94a2640 1 -- 172.21.15.1:0/3550091339 >> 172.21.15.1:0/3550091339 conn(0x7efec40b5c40 msgr2=0x7efec40b8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:16.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.544+0000 7efec94a2640 1 -- 172.21.15.1:0/3550091339 shutdown_connections 2024-09-15T21:56:16.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:16.544+0000 7efec94a2640 1 -- 172.21.15.1:0/3550091339 wait complete. 2024-09-15T21:56:16.574 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed ... ERROR 2024-09-15T21:56:16.575 INFO:tasks.cephfs_test_runner: 2024-09-15T21:56:16.575 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-15T21:56:16.575 INFO:tasks.cephfs_test_runner:ERROR: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-09-15T21:56:16.575 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed 2024-09-15T21:56:16.575 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-15T21:56:16.575 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-15T21:56:16.575 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_cephfs_shell.py", line 602, in test_cd_with_args 2024-09-15T21:56:16.575 INFO:tasks.cephfs_test_runner: output = self.get_cephfs_shell_script_output(script) 2024-09-15T21:56:16.575 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_cephfs_shell.py", line 161, in get_cephfs_shell_script_output 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner: return ensure_str(self.run_cephfs_shell_script( 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_cephfs_shell.py", line 153, in run_cephfs_shell_script 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner: return mount_x.client_remote.run(args=args, stdout=stdout, 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi001 with status 127: 'cephfs-shell -b /tmp/test-cephfscmctsh8r' 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner: 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-15T21:56:16.576 INFO:tasks.cephfs_test_runner:Ran 1 test in 36.963s 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner: 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner: 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner:ERROR: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner:Test that when cd is issued with an argument, CWD is changed 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_cephfs_shell.py", line 602, in test_cd_with_args 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner: output = self.get_cephfs_shell_script_output(script) 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_cephfs_shell.py", line 161, in get_cephfs_shell_script_output 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner: return ensure_str(self.run_cephfs_shell_script( 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_cephfs_shell.py", line 153, in run_cephfs_shell_script 2024-09-15T21:56:16.577 INFO:tasks.cephfs_test_runner: return mount_x.client_remote.run(args=args, stdout=stdout, 2024-09-15T21:56:16.578 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-15T21:56:16.578 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-15T21:56:16.578 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-15T21:56:16.578 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-15T21:56:16.578 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-15T21:56:16.578 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-15T21:56:16.578 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-15T21:56:16.578 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-15T21:56:16.578 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi001 with status 127: 'cephfs-shell -b /tmp/test-cephfscmctsh8r' 2024-09-15T21:56:16.578 INFO:tasks.cephfs_test_runner: 2024-09-15T21:56:16.578 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-09-15T21:56:16.791 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=55e007dd73b1492d862e48035300d27c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD) 2024-09-15T21:56:16.792 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-15T21:56:16.801 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-15T21:56:16.824 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-15T21:56:16.825 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-15T21:56:16.825 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T21:56:16.838 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339564k,nr_inodes=4084891,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17690 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275300k,nr_inodes=818825,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275304k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-09-15T21:56:16.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:16.839 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-15T21:56:16.886 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T21:56:16.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:16.888 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T21:56:16.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T21:56:16.950 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-15T21:56:17.118 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-15T21:56:17.127 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T21:56:17.127 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:56:17.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47e0e0c640 1 Processor -- start 2024-09-15T21:56:17.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47e0e0c640 1 -- start start 2024-09-15T21:56:17.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47e0e0c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f47dc0b5600 0x7f47dc09ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47e0e0c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f47dc148f20 0x7f47dc149390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47e0e0c640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47dc1498d0 con 0x7f47dc0b5220 2024-09-15T21:56:17.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47e0e0c640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f47dc09b800 con 0x7f47dc148f20 2024-09-15T21:56:17.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47e0e0c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f47dc0b4dd0 con 0x7f47dc0b5600 2024-09-15T21:56:17.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47da59c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f47dc0b5220 0x7f47dc09aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58282/0 (socket says 172.21.15.1:58282) 2024-09-15T21:56:17.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47da59c640 1 -- 172.21.15.1:0/3300346449 learned_addr learned my addr 172.21.15.1:0/3300346449 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:17.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47dad9d640 1 --2- 172.21.15.1:0/3300346449 >> v2:172.21.15.1:3300/0 conn(0x7f47dc148f20 0x7f47dc149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47d3fff640 1 --2- 172.21.15.1:0/3300346449 >> v2:172.21.15.70:3300/0 conn(0x7f47dc0b5600 0x7f47dc09ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47d9d9b640 1 -- 172.21.15.1:0/3300346449 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112981838 0 0) 0x7f47dc1498d0 con 0x7f47dc0b5220 2024-09-15T21:56:17.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47d9d9b640 1 -- 172.21.15.1:0/3300346449 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47c8003530 con 0x7f47dc0b5220 2024-09-15T21:56:17.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47dad9d640 1 -- 172.21.15.1:0/3300346449 >> v2:172.21.15.70:3300/0 conn(0x7f47dc0b5600 msgr2=0x7f47dc09ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:17.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47dad9d640 1 --2- 172.21.15.1:0/3300346449 >> v2:172.21.15.70:3300/0 conn(0x7f47dc0b5600 0x7f47dc09ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47dad9d640 1 -- 172.21.15.1:0/3300346449 >> v1:172.21.15.1:6789/0 conn(0x7f47dc0b5220 legacy=0x7f47dc09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.252+0000 7f47dad9d640 1 -- 172.21.15.1:0/3300346449 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47dc0b6a50 con 0x7f47dc148f20 2024-09-15T21:56:17.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47dad9d640 1 --2- 172.21.15.1:0/3300346449 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47dc148f20 0x7f47dc149390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f47dc06e530 tx=0x7f47d401c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b16079a9a42e13e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:17.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47d9d9b640 1 -- 172.21.15.1:0/3300346449 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d40b2070 con 0x7f47dc148f20 2024-09-15T21:56:17.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47d9d9b640 1 -- 172.21.15.1:0/3300346449 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d40a58a0 con 0x7f47dc148f20 2024-09-15T21:56:17.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47d9d9b640 1 -- 172.21.15.1:0/3300346449 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d40a5c50 con 0x7f47dc148f20 2024-09-15T21:56:17.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3300346449 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47dc148f20 msgr2=0x7f47dc149390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 --2- 172.21.15.1:0/3300346449 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47dc148f20 0x7f47dc149390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f47dc06e530 tx=0x7f47d401c7e0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3300346449 shutdown_connections 2024-09-15T21:56:17.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 --2- 172.21.15.1:0/3300346449 >> v2:172.21.15.70:3300/0 conn(0x7f47dc0b5600 0x7f47dc09ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 --2- 172.21.15.1:0/3300346449 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47dc148f20 0x7f47dc149390 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3300346449 >> 172.21.15.1:0/3300346449 conn(0x7f47dc0b5c40 msgr2=0x7f47dc0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:17.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3300346449 shutdown_connections 2024-09-15T21:56:17.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3300346449 wait complete. 2024-09-15T21:56:17.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 Processor -- start 2024-09-15T21:56:17.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 -- start start 2024-09-15T21:56:17.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47dc0b5220 0x7f47dc1e3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47dc0b5600 0x7f47dc1e3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47dc148f20 0x7f47dc1372d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f47dc152700 con 0x7f47dc148f20 2024-09-15T21:56:17.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f47dc152880 con 0x7f47dc0b5600 2024-09-15T21:56:17.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f47dc152a00 con 0x7f47dc0b5220 2024-09-15T21:56:17.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47dad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47dc148f20 0x7f47dc1372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47dad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47dc148f20 0x7f47dc1372d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38738/0 (socket says 172.21.15.1:38738) 2024-09-15T21:56:17.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47dad9d640 1 -- 172.21.15.1:0/3045661955 learned_addr learned my addr 172.21.15.1:0/3045661955 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:17.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47d3fff640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47dc0b5600 0x7f47dc1e3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47da59c640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47dc0b5220 0x7f47dc1e3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47dad9d640 1 -- 172.21.15.1:0/3045661955 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47dc0b5220 msgr2=0x7f47dc1e3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47dad9d640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47dc0b5220 0x7f47dc1e3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47dad9d640 1 -- 172.21.15.1:0/3045661955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47dc0b5600 msgr2=0x7f47dc1e3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47dad9d640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47dc0b5600 0x7f47dc1e3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47dad9d640 1 -- 172.21.15.1:0/3045661955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47dc0af7c0 con 0x7f47dc148f20 2024-09-15T21:56:17.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47dad9d640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47dc148f20 0x7f47dc1372d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f47d40193f0 tx=0x7f47d4019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:17.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47d2ffd640 1 -- 172.21.15.1:0/3045661955 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d40b2050 con 0x7f47dc148f20 2024-09-15T21:56:17.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47d2ffd640 1 -- 172.21.15.1:0/3045661955 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d40be070 con 0x7f47dc148f20 2024-09-15T21:56:17.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3045661955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47dc0ae290 con 0x7f47dc148f20 2024-09-15T21:56:17.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47d2ffd640 1 -- 172.21.15.1:0/3045661955 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d40ada70 con 0x7f47dc148f20 2024-09-15T21:56:17.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.256+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3045661955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47dc138df0 con 0x7f47dc148f20 2024-09-15T21:56:17.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.260+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3045661955 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47dc09ee10 con 0x7f47dc148f20 2024-09-15T21:56:17.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.260+0000 7f47d2ffd640 1 -- 172.21.15.1:0/3045661955 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47d40a5720 con 0x7f47dc148f20 2024-09-15T21:56:17.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.260+0000 7f47d2ffd640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f47bc0678c0 0x7f47bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.260+0000 7f47d2ffd640 1 -- 172.21.15.1:0/3045661955 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f47d4120aa0 con 0x7f47dc148f20 2024-09-15T21:56:17.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.260+0000 7f47da59c640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f47bc0678c0 0x7f47bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.260+0000 7f47da59c640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f47bc0678c0 0x7f47bc069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47cc005890 tx=0x7f47cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:17.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.264+0000 7f47d2ffd640 1 -- 172.21.15.1:0/3045661955 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f47d4016520 con 0x7f47dc148f20 2024-09-15T21:56:17.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.424+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3045661955 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47dc1e36b0 con 0x7f47bc0678c0 2024-09-15T21:56:17.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.428+0000 7f47d2ffd640 1 -- 172.21.15.1:0/3045661955 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13474 (secure 0 0 0) 0x7f47dc1e36b0 con 0x7f47bc0678c0 2024-09-15T21:56:17.433 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:17.433 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:56:17.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.428+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3045661955 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f47bc0678c0 msgr2=0x7f47bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.428+0000 7f47e0e0c640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f47bc0678c0 0x7f47bc069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47cc005890 tx=0x7f47cc009040 comp rx=0 tx=0).stop 2024-09-15T21:56:17.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.428+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3045661955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47dc148f20 msgr2=0x7f47dc1372d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.428+0000 7f47e0e0c640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47dc148f20 0x7f47dc1372d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f47d40193f0 tx=0x7f47d4019580 comp rx=0 tx=0).stop 2024-09-15T21:56:17.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.428+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3045661955 shutdown_connections 2024-09-15T21:56:17.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.428+0000 7f47e0e0c640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f47dc148f20 0x7f47dc1372d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.428+0000 7f47e0e0c640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f47bc0678c0 0x7f47bc069d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.428+0000 7f47e0e0c640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47dc0b5600 0x7f47dc1e3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.428+0000 7f47e0e0c640 1 --2- 172.21.15.1:0/3045661955 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f47dc0b5220 0x7f47dc1e3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.428+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3045661955 >> 172.21.15.1:0/3045661955 conn(0x7f47dc0b5c40 msgr2=0x7f47dc074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:17.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.428+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3045661955 shutdown_connections 2024-09-15T21:56:17.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.428+0000 7f47e0e0c640 1 -- 172.21.15.1:0/3045661955 wait complete. 2024-09-15T21:56:17.452 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-09-15T21:56:17.095030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261712,"kb_used_data":3884,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754713008,"statfs":{"total":773094113280,"available":772826120192,"internally_reserved":0,"allocated":3977216,"data_stored":2253476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10895,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002083"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295729+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:57.295729+0000","last_peered":"2024-09-15T21:55:57.295729+0000","last_clean":"2024-09-15T21:55:57.295729+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:57.295729+0000","last_undegraded":"2024-09-15T21:55:57.295729+0000","last_fullsized":"2024-09-15T21:55:57.295729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":348160,"data_stored":132522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":348160,"data_stored":132578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":356352,"data_stored":137909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":356352,"data_stored":137909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":364544,"data_stored":142025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36260,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335580,"statfs":{"total":96636764160,"available":96599633920,"internally_reserved":0,"allocated":933888,"data_stored":722274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":925696,"data_stored":716283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35684,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336156,"statfs":{"total":96636764160,"available":96600223744,"internally_reserved":0,"allocated":344064,"data_stored":131976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:56:17.452 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:56:17.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb9819d1640 1 Processor -- start 2024-09-15T21:56:17.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb9819d1640 1 -- start start 2024-09-15T21:56:17.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb9819d1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb97c0b5220 0x7fb97c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb9819d1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb97c148f20 0x7fb97c149370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb9819d1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb97c09f520 con 0x7fb97c0b5600 2024-09-15T21:56:17.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb9819d1640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fb97c09b800 con 0x7fb97c0b5220 2024-09-15T21:56:17.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb9819d1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fb97c0b4dd0 con 0x7fb97c148f20 2024-09-15T21:56:17.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb97affd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb97c0b5220 0x7fb97c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb97affd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb97c0b5220 0x7fb97c09aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38742/0 (socket says 172.21.15.1:38742) 2024-09-15T21:56:17.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb97affd640 1 -- 172.21.15.1:0/3019929045 learned_addr learned my addr 172.21.15.1:0/3019929045 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:17.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb97b7fe640 1 --2- 172.21.15.1:0/3019929045 >> v2:172.21.15.70:3300/0 conn(0x7fb97c148f20 0x7fb97c149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb97affd640 1 -- 172.21.15.1:0/3019929045 >> v2:172.21.15.70:3300/0 conn(0x7fb97c148f20 msgr2=0x7fb97c149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:17.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb97affd640 1 --2- 172.21.15.1:0/3019929045 >> v2:172.21.15.70:3300/0 conn(0x7fb97c148f20 0x7fb97c149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb97affd640 1 -- 172.21.15.1:0/3019929045 >> v1:172.21.15.70:6789/0 conn(0x7fb97c0b5600 legacy=0x7fb97c09ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:17.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb97affd640 1 -- 172.21.15.1:0/3019929045 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97c0b6a50 con 0x7fb97c0b5220 2024-09-15T21:56:17.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.568+0000 7fb97b7fe640 1 --2- 172.21.15.1:0/3019929045 >> v2:172.21.15.70:3300/0 conn(0x7fb97c148f20 0x7fb97c149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:56:17.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb97affd640 1 --2- 172.21.15.1:0/3019929045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97c0b5220 0x7fb97c09aa50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0ba1e0 tx=0x7fb96c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82aae152b6b4aaec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:17.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb979ffb640 1 -- 172.21.15.1:0/3019929045 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c0b1070 con 0x7fb97c0b5220 2024-09-15T21:56:17.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb979ffb640 1 -- 172.21.15.1:0/3019929045 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb96c0a8050 con 0x7fb97c0b5220 2024-09-15T21:56:17.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb979ffb640 1 -- 172.21.15.1:0/3019929045 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c0ac860 con 0x7fb97c0b5220 2024-09-15T21:56:17.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 -- 172.21.15.1:0/3019929045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97c0b5220 msgr2=0x7fb97c09aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 --2- 172.21.15.1:0/3019929045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97c0b5220 0x7fb97c09aa50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0ba1e0 tx=0x7fb96c01c3c0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 -- 172.21.15.1:0/3019929045 shutdown_connections 2024-09-15T21:56:17.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 --2- 172.21.15.1:0/3019929045 >> v2:172.21.15.70:3300/0 conn(0x7fb97c148f20 0x7fb97c149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 --2- 172.21.15.1:0/3019929045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97c0b5220 0x7fb97c09aa50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 -- 172.21.15.1:0/3019929045 >> 172.21.15.1:0/3019929045 conn(0x7fb97c0b5c40 msgr2=0x7fb97c0b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:17.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 -- 172.21.15.1:0/3019929045 shutdown_connections 2024-09-15T21:56:17.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 -- 172.21.15.1:0/3019929045 wait complete. 2024-09-15T21:56:17.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 Processor -- start 2024-09-15T21:56:17.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 -- start start 2024-09-15T21:56:17.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb97c0b5220 0x7fb97c1437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97c0b5600 0x7fb97c072220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb97c148f20 0x7fb97c146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c152700 con 0x7fb97c0b5600 2024-09-15T21:56:17.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c09b520 con 0x7fb97c148f20 2024-09-15T21:56:17.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb97c152880 con 0x7fb97c0b5220 2024-09-15T21:56:17.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb97a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97c0b5600 0x7fb97c072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb97a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97c0b5600 0x7fb97c072220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38754/0 (socket says 172.21.15.1:38754) 2024-09-15T21:56:17.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb97a7fc640 1 -- 172.21.15.1:0/4052556678 learned_addr learned my addr 172.21.15.1:0/4052556678 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:17.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb97affd640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb97c0b5220 0x7fb97c1437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb97b7fe640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb97c148f20 0x7fb97c146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb97a7fc640 1 -- 172.21.15.1:0/4052556678 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb97c0b5220 msgr2=0x7fb97c1437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb97a7fc640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb97c0b5220 0x7fb97c1437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb97a7fc640 1 -- 172.21.15.1:0/4052556678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb97c148f20 msgr2=0x7fb97c146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb97a7fc640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb97c148f20 0x7fb97c146600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb97a7fc640 1 -- 172.21.15.1:0/4052556678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97c073120 con 0x7fb97c0b5600 2024-09-15T21:56:17.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb97a7fc640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97c0b5600 0x7fb97c072220 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c450 tx=0x7fb96400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:17.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb973fff640 1 -- 172.21.15.1:0/4052556678 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964012830 con 0x7fb97c0b5600 2024-09-15T21:56:17.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb973fff640 1 -- 172.21.15.1:0/4052556678 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb964017070 con 0x7fb97c0b5600 2024-09-15T21:56:17.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb9819d1640 1 -- 172.21.15.1:0/4052556678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb97c0b00f0 con 0x7fb97c0b5600 2024-09-15T21:56:17.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.572+0000 7fb973fff640 1 -- 172.21.15.1:0/4052556678 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964012c30 con 0x7fb97c0b5600 2024-09-15T21:56:17.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.576+0000 7fb9819d1640 1 -- 172.21.15.1:0/4052556678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb97c072760 con 0x7fb97c0b5600 2024-09-15T21:56:17.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.576+0000 7fb9819d1640 1 -- 172.21.15.1:0/4052556678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb97c0af870 con 0x7fb97c0b5600 2024-09-15T21:56:17.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.576+0000 7fb973fff640 1 -- 172.21.15.1:0/4052556678 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb96401c460 con 0x7fb97c0b5600 2024-09-15T21:56:17.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.576+0000 7fb973fff640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb95c0678c0 0x7fb95c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.576+0000 7fb973fff640 1 -- 172.21.15.1:0/4052556678 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7fb9640856e0 con 0x7fb97c0b5600 2024-09-15T21:56:17.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.576+0000 7fb97affd640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb95c0678c0 0x7fb95c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.576+0000 7fb97affd640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb95c0678c0 0x7fb95c069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0ae000 tx=0x7fb96c0a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:17.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.580+0000 7fb973fff640 1 -- 172.21.15.1:0/4052556678 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb9640565b0 con 0x7fb97c0b5600 2024-09-15T21:56:17.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.740+0000 7fb9819d1640 1 -- 172.21.15.1:0/4052556678 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb97c09aa50 con 0x7fb95c0678c0 2024-09-15T21:56:17.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.740+0000 7fb973fff640 1 -- 172.21.15.1:0/4052556678 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13474 (secure 0 0 0) 0x7fb97c09aa50 con 0x7fb95c0678c0 2024-09-15T21:56:17.747 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:17.747 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:56:17.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.744+0000 7fb9819d1640 1 -- 172.21.15.1:0/4052556678 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb95c0678c0 msgr2=0x7fb95c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.744+0000 7fb9819d1640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb95c0678c0 0x7fb95c069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0ae000 tx=0x7fb96c0a7000 comp rx=0 tx=0).stop 2024-09-15T21:56:17.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.744+0000 7fb9819d1640 1 -- 172.21.15.1:0/4052556678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97c0b5600 msgr2=0x7fb97c072220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.744+0000 7fb9819d1640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97c0b5600 0x7fb97c072220 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c450 tx=0x7fb96400c910 comp rx=0 tx=0).stop 2024-09-15T21:56:17.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.744+0000 7fb9819d1640 1 -- 172.21.15.1:0/4052556678 shutdown_connections 2024-09-15T21:56:17.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.744+0000 7fb9819d1640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb95c0678c0 0x7fb95c069d80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.744+0000 7fb9819d1640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb97c148f20 0x7fb97c146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.744+0000 7fb9819d1640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb97c0b5600 0x7fb97c072220 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.744+0000 7fb9819d1640 1 --2- 172.21.15.1:0/4052556678 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb97c0b5220 0x7fb97c1437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.744+0000 7fb9819d1640 1 -- 172.21.15.1:0/4052556678 >> 172.21.15.1:0/4052556678 conn(0x7fb97c0b5c40 msgr2=0x7fb97c0b7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:17.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.744+0000 7fb9819d1640 1 -- 172.21.15.1:0/4052556678 shutdown_connections 2024-09-15T21:56:17.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.744+0000 7fb9819d1640 1 -- 172.21.15.1:0/4052556678 wait complete. 2024-09-15T21:56:17.767 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-09-15T21:56:17.095030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261712,"kb_used_data":3884,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754713008,"statfs":{"total":773094113280,"available":772826120192,"internally_reserved":0,"allocated":3977216,"data_stored":2253476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10895,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002083"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295729+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:57.295729+0000","last_peered":"2024-09-15T21:55:57.295729+0000","last_clean":"2024-09-15T21:55:57.295729+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:57.295729+0000","last_undegraded":"2024-09-15T21:55:57.295729+0000","last_fullsized":"2024-09-15T21:55:57.295729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":348160,"data_stored":132522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":348160,"data_stored":132578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":356352,"data_stored":137909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":356352,"data_stored":137909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":364544,"data_stored":142025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36260,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335580,"statfs":{"total":96636764160,"available":96599633920,"internally_reserved":0,"allocated":933888,"data_stored":722274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":925696,"data_stored":716283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35684,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336156,"statfs":{"total":96636764160,"available":96600223744,"internally_reserved":0,"allocated":344064,"data_stored":131976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:56:17.767 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T21:56:17.768 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:56:17.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f0576766640 1 Processor -- start 2024-09-15T21:56:17.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f0576766640 1 -- start start 2024-09-15T21:56:17.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f0576766640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f05700b5220 0x7f057009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f0576766640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f05700b5600 0x7f057009ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f0576766640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0570148f20 0x7f05701493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f0576766640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f057009b800 con 0x7f05700b5220 2024-09-15T21:56:17.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f0576766640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f05700b4dd0 con 0x7f05700b5600 2024-09-15T21:56:17.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f0576766640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f05701498f0 con 0x7f0570148f20 2024-09-15T21:56:17.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f056ffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f05700b5220 0x7f057009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f056ffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f05700b5220 0x7f057009aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38766/0 (socket says 172.21.15.1:38766) 2024-09-15T21:56:17.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f056ffff640 1 -- 172.21.15.1:0/282001234 learned_addr learned my addr 172.21.15.1:0/282001234 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:17.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f056f7fe640 1 --2- 172.21.15.1:0/282001234 >> v2:172.21.15.70:3300/0 conn(0x7f05700b5600 0x7f057009ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f0574d03640 1 --2- 172.21.15.1:0/282001234 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0570148f20 0x7f05701493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f056ffff640 1 -- 172.21.15.1:0/282001234 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0570148f20 msgr2=0x7f05701493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:17.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f056ffff640 1 --2- 172.21.15.1:0/282001234 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0570148f20 0x7f05701493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f056ffff640 1 -- 172.21.15.1:0/282001234 >> v2:172.21.15.70:3300/0 conn(0x7f05700b5600 msgr2=0x7f057009ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:17.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f056ffff640 1 --2- 172.21.15.1:0/282001234 >> v2:172.21.15.70:3300/0 conn(0x7f05700b5600 0x7f057009ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.884+0000 7f056ffff640 1 -- 172.21.15.1:0/282001234 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05700b6a50 con 0x7f05700b5220 2024-09-15T21:56:17.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f056ffff640 1 --2- 172.21.15.1:0/282001234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05700b5220 0x7f057009aa50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f057006e530 tx=0x7f055801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65226f9b5b1243c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:17.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f056effd640 1 -- 172.21.15.1:0/282001234 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05580b1070 con 0x7f05700b5220 2024-09-15T21:56:17.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f056effd640 1 -- 172.21.15.1:0/282001234 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05580ac620 con 0x7f05700b5220 2024-09-15T21:56:17.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f056effd640 1 -- 172.21.15.1:0/282001234 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05580ac9f0 con 0x7f05700b5220 2024-09-15T21:56:17.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f0576766640 1 -- 172.21.15.1:0/282001234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05700b5220 msgr2=0x7f057009aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f0576766640 1 --2- 172.21.15.1:0/282001234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05700b5220 0x7f057009aa50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f057006e530 tx=0x7f055801c400 comp rx=0 tx=0).stop 2024-09-15T21:56:17.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f0576766640 1 -- 172.21.15.1:0/282001234 shutdown_connections 2024-09-15T21:56:17.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f0576766640 1 --2- 172.21.15.1:0/282001234 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0570148f20 0x7f05701493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f0576766640 1 --2- 172.21.15.1:0/282001234 >> v2:172.21.15.70:3300/0 conn(0x7f05700b5600 0x7f057009ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f0576766640 1 --2- 172.21.15.1:0/282001234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f05700b5220 0x7f057009aa50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f0576766640 1 -- 172.21.15.1:0/282001234 >> 172.21.15.1:0/282001234 conn(0x7f05700b5c40 msgr2=0x7f05700b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:17.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f0576766640 1 -- 172.21.15.1:0/282001234 shutdown_connections 2024-09-15T21:56:17.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f0576766640 1 -- 172.21.15.1:0/282001234 wait complete. 2024-09-15T21:56:17.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f0576766640 1 Processor -- start 2024-09-15T21:56:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.888+0000 7f0576766640 1 -- start start 2024-09-15T21:56:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0576766640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700b5220 0x7f057013e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0576766640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f05700b5600 0x7f05700ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0576766640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0570148f20 0x7f05700af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0576766640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f057009f4d0 con 0x7f0570148f20 2024-09-15T21:56:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0576766640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f057009f350 con 0x7f05700b5220 2024-09-15T21:56:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0576766640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f05700b4350 con 0x7f05700b5600 2024-09-15T21:56:17.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0574d03640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0570148f20 0x7f05700af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0574d03640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0570148f20 0x7f05700af970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38776/0 (socket says 172.21.15.1:38776) 2024-09-15T21:56:17.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0574d03640 1 -- 172.21.15.1:0/1642301684 learned_addr learned my addr 172.21.15.1:0/1642301684 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:17.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f056ffff640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700b5220 0x7f057013e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f056f7fe640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f05700b5600 0x7f05700ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0574d03640 1 -- 172.21.15.1:0/1642301684 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f05700b5600 msgr2=0x7f05700ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0574d03640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f05700b5600 0x7f05700ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0574d03640 1 -- 172.21.15.1:0/1642301684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700b5220 msgr2=0x7f057013e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0574d03640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700b5220 0x7f057013e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0574d03640 1 -- 172.21.15.1:0/1642301684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05701409e0 con 0x7f0570148f20 2024-09-15T21:56:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f056f7fe640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f05700b5600 0x7f05700ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0574d03640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0570148f20 0x7f05700af970 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0568007e40 tx=0x7f056800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f056cff9640 1 -- 172.21.15.1:0/1642301684 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568014620 con 0x7f0570148f20 2024-09-15T21:56:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f056cff9640 1 -- 172.21.15.1:0/1642301684 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0568019070 con 0x7f0570148f20 2024-09-15T21:56:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0576766640 1 -- 172.21.15.1:0/1642301684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05701414c0 con 0x7f0570148f20 2024-09-15T21:56:17.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f056cff9640 1 -- 172.21.15.1:0/1642301684 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568014a20 con 0x7f0570148f20 2024-09-15T21:56:17.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0576766640 1 -- 172.21.15.1:0/1642301684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f057014fc00 con 0x7f0570148f20 2024-09-15T21:56:17.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f0576766640 1 -- 172.21.15.1:0/1642301684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05701419a0 con 0x7f0570148f20 2024-09-15T21:56:17.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f056cff9640 1 -- 172.21.15.1:0/1642301684 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0568014bc0 con 0x7f0570148f20 2024-09-15T21:56:17.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f056cff9640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f05500678f0 0x7f0550069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:17.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f056cff9640 1 -- 172.21.15.1:0/1642301684 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f05680860a0 con 0x7f0570148f20 2024-09-15T21:56:17.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f056ffff640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f05500678f0 0x7f0550069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:17.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.892+0000 7f056ffff640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f05500678f0 0x7f0550069db0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f05580ae000 tx=0x7f05580a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:17.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:17.896+0000 7f056cff9640 1 -- 172.21.15.1:0/1642301684 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f05701419a0 con 0x7f0570148f20 2024-09-15T21:56:18.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.060+0000 7f0576766640 1 -- 172.21.15.1:0/1642301684 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f057013f030 con 0x7f05500678f0 2024-09-15T21:56:18.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.060+0000 7f056cff9640 1 -- 172.21.15.1:0/1642301684 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13474 (secure 0 0 0) 0x7f057013f030 con 0x7f05500678f0 2024-09-15T21:56:18.068 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:18.068 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:56:18.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.064+0000 7f0576766640 1 -- 172.21.15.1:0/1642301684 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f05500678f0 msgr2=0x7f0550069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:18.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.064+0000 7f0576766640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f05500678f0 0x7f0550069db0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f05580ae000 tx=0x7f05580a7000 comp rx=0 tx=0).stop 2024-09-15T21:56:18.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.064+0000 7f0576766640 1 -- 172.21.15.1:0/1642301684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0570148f20 msgr2=0x7f05700af970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:18.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.064+0000 7f0576766640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0570148f20 0x7f05700af970 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0568007e40 tx=0x7f056800e4b0 comp rx=0 tx=0).stop 2024-09-15T21:56:18.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.064+0000 7f0576766640 1 -- 172.21.15.1:0/1642301684 shutdown_connections 2024-09-15T21:56:18.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.064+0000 7f0576766640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0570148f20 0x7f05700af970 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:18.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.064+0000 7f0576766640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f05700b5600 0x7f05700ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:18.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.064+0000 7f0576766640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f05500678f0 0x7f0550069db0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:18.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.064+0000 7f0576766640 1 --2- 172.21.15.1:0/1642301684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05700b5220 0x7f057013e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:18.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.064+0000 7f0576766640 1 -- 172.21.15.1:0/1642301684 >> 172.21.15.1:0/1642301684 conn(0x7f05700b5c40 msgr2=0x7f057013ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:18.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.064+0000 7f0576766640 1 -- 172.21.15.1:0/1642301684 shutdown_connections 2024-09-15T21:56:18.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.064+0000 7f0576766640 1 -- 172.21.15.1:0/1642301684 wait complete. 2024-09-15T21:56:18.086 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-09-15T21:56:17.095030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261712,"kb_used_data":3884,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754713008,"statfs":{"total":773094113280,"available":772826120192,"internally_reserved":0,"allocated":3977216,"data_stored":2253476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10895,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002083"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T21:55:57.295729+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:55:57.295729+0000","last_peered":"2024-09-15T21:55:57.295729+0000","last_clean":"2024-09-15T21:55:57.295729+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:55:57.295729+0000","last_undegraded":"2024-09-15T21:55:57.295729+0000","last_fullsized":"2024-09-15T21:55:57.295729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":348160,"data_stored":132522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":348160,"data_stored":132578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":356352,"data_stored":137909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":356352,"data_stored":137909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":364544,"data_stored":142025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36260,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335580,"statfs":{"total":96636764160,"available":96599633920,"internally_reserved":0,"allocated":933888,"data_stored":722274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":925696,"data_stored":716283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35684,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336156,"statfs":{"total":96636764160,"available":96600223744,"internally_reserved":0,"allocated":344064,"data_stored":131976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:56:18.087 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T21:56:18.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd42198b640 1 Processor -- start 2024-09-15T21:56:18.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd42198b640 1 -- start start 2024-09-15T21:56:18.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd42198b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd41c06bf20 0x7fd41c147960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:18.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd42198b640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd41c071d80 con 0x7fd41c147ea0 2024-09-15T21:56:18.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd42198b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd41c073460 con 0x7fd41c1501f0 2024-09-15T21:56:18.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd42198b640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fd41c073a70 con 0x7fd41c06bf20 2024-09-15T21:56:18.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd41affd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd41c06bf20 0x7fd41c147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:18.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd41a7fc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd41c147ea0 0x7fd41c0b0c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58288/0 (socket says 172.21.15.1:58288) 2024-09-15T21:56:18.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd41a7fc640 1 -- 172.21.15.1:0/2728715134 learned_addr learned my addr 172.21.15.1:0/2728715134 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:18.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd41affd640 1 -- 172.21.15.1:0/2728715134 >> v1:172.21.15.70:6789/0 conn(0x7fd41c1501f0 legacy=0x7fd41c1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:18.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd41affd640 1 -- 172.21.15.1:0/2728715134 >> v1:172.21.15.1:6789/0 conn(0x7fd41c147ea0 legacy=0x7fd41c0b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:18.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd419ffb640 1 -- 172.21.15.1:0/2728715134 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1450025942 0 0) 0x7fd410001120 con 0x7fd41c147ea0 2024-09-15T21:56:18.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd41affd640 1 -- 172.21.15.1:0/2728715134 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c06c300 con 0x7fd41c06bf20 2024-09-15T21:56:18.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd41affd640 1 --2- 172.21.15.1:0/2728715134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd41c06bf20 0x7fd41c147960 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0097c0 tx=0x7fd40c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a03c62c9381c35a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:18.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.200+0000 7fd419ffb640 1 -- 172.21.15.1:0/2728715134 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c0b0070 con 0x7fd41c06bf20 2024-09-15T21:56:18.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd419ffb640 1 -- 172.21.15.1:0/2728715134 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40c0ab600 con 0x7fd41c06bf20 2024-09-15T21:56:18.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd419ffb640 1 -- 172.21.15.1:0/2728715134 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c0ab9d0 con 0x7fd41c06bf20 2024-09-15T21:56:18.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 -- 172.21.15.1:0/2728715134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd41c06bf20 msgr2=0x7fd41c147960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:18.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 --2- 172.21.15.1:0/2728715134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd41c06bf20 0x7fd41c147960 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0097c0 tx=0x7fd40c01c340 comp rx=0 tx=0).stop 2024-09-15T21:56:18.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 -- 172.21.15.1:0/2728715134 shutdown_connections 2024-09-15T21:56:18.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 --2- 172.21.15.1:0/2728715134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd41c06bf20 0x7fd41c147960 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:18.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 -- 172.21.15.1:0/2728715134 >> 172.21.15.1:0/2728715134 conn(0x7fd41c0ba200 msgr2=0x7fd41c0ba610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:18.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 -- 172.21.15.1:0/2728715134 shutdown_connections 2024-09-15T21:56:18.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 -- 172.21.15.1:0/2728715134 wait complete. 2024-09-15T21:56:18.210 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T21:56:18.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 Processor -- start 2024-09-15T21:56:18.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 -- start start 2024-09-15T21:56:18.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c06bf20 0x7fd41c144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:18.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd41c147ea0 0x7fd41c143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:18.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c1501f0 0x7fd41c1e0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:18.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0b1340 con 0x7fd41c147ea0 2024-09-15T21:56:18.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0b6a40 con 0x7fd41c1501f0 2024-09-15T21:56:18.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c072970 con 0x7fd41c06bf20 2024-09-15T21:56:18.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd41a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd41c147ea0 0x7fd41c143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:18.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd41a7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd41c147ea0 0x7fd41c143ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38794/0 (socket says 172.21.15.1:38794) 2024-09-15T21:56:18.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd41a7fc640 1 -- 172.21.15.1:0/3731719497 learned_addr learned my addr 172.21.15.1:0/3731719497 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:18.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd41affd640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c06bf20 0x7fd41c144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:18.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd41a7fc640 1 -- 172.21.15.1:0/3731719497 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c06bf20 msgr2=0x7fd41c144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:18.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd41a7fc640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c06bf20 0x7fd41c144d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:18.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd41b7fe640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c1501f0 0x7fd41c1e0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:18.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd41a7fc640 1 -- 172.21.15.1:0/3731719497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c1501f0 msgr2=0x7fd41c1e0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:18.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd41a7fc640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c1501f0 0x7fd41c1e0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:18.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd41a7fc640 1 -- 172.21.15.1:0/3731719497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c142480 con 0x7fd41c147ea0 2024-09-15T21:56:18.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd41a7fc640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd41c147ea0 0x7fd41c143ba0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c780 tx=0x7fd41000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:18.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd403fff640 1 -- 172.21.15.1:0/3731719497 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410018070 con 0x7fd41c147ea0 2024-09-15T21:56:18.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd403fff640 1 -- 172.21.15.1:0/3731719497 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4100072d0 con 0x7fd41c147ea0 2024-09-15T21:56:18.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 -- 172.21.15.1:0/3731719497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41c1e02f0 con 0x7fd41c147ea0 2024-09-15T21:56:18.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd403fff640 1 -- 172.21.15.1:0/3731719497 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4100047f0 con 0x7fd41c147ea0 2024-09-15T21:56:18.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.204+0000 7fd42198b640 1 -- 172.21.15.1:0/3731719497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41c1520d0 con 0x7fd41c147ea0 2024-09-15T21:56:18.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.208+0000 7fd42198b640 1 -- 172.21.15.1:0/3731719497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41c072530 con 0x7fd41c147ea0 2024-09-15T21:56:18.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.208+0000 7fd403fff640 1 -- 172.21.15.1:0/3731719497 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd41001b070 con 0x7fd41c147ea0 2024-09-15T21:56:18.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.208+0000 7fd403fff640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd4080678c0 0x7fd408069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:18.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.208+0000 7fd41affd640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd4080678c0 0x7fd408069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:18.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.208+0000 7fd403fff640 1 -- 172.21.15.1:0/3731719497 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7fd410084cd0 con 0x7fd41c147ea0 2024-09-15T21:56:18.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T21:56:18.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.208+0000 7fd41affd640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd4080678c0 0x7fd408069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0ad000 tx=0x7fd40c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:18.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.212+0000 7fd403fff640 1 -- 172.21.15.1:0/3731719497 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd41c071d80 con 0x7fd41c147ea0 2024-09-15T21:56:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.376+0000 7fd42198b640 1 -- 172.21.15.1:0/3731719497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd41c0b6480 con 0x7fd41c147ea0 2024-09-15T21:56:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.376+0000 7fd403fff640 1 -- 172.21.15.1:0/3731719497 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+12958 (secure 0 0 0) 0x7fd410055b00 con 0x7fd41c147ea0 2024-09-15T21:56:18.383 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:18.383 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":33,"fsid":"a77d0aed-4b44-4b66-9239-aae9fcdd297c","created":"2024-09-15T21:54:56.301192+0000","modified":"2024-09-15T21:56:15.538595+0000","last_up_change":"2024-09-15T21:55:09.634324+0000","last_in_change":"2024-09-15T21:54:59.245298+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T21:55:09.137939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa48708f-0cb2-4d7b-ad99-83a0e11814b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6819","nonce":2645824093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6821","nonce":2645824093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6825","nonce":2645824093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":2645824093},{"type":"v1","addr":"172.21.15.1:6823","nonce":2645824093}]},"public_addr":"172.21.15.1:6819/2645824093","cluster_addr":"172.21.15.1:6821/2645824093","heartbeat_back_addr":"172.21.15.1:6825/2645824093","heartbeat_front_addr":"172.21.15.1:6823/2645824093","state":["exists","up"]},{"osd":1,"uuid":"7299a093-9550-4267-95b4-073361e64c32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6827","nonce":4281279445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6829","nonce":4281279445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6833","nonce":4281279445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":4281279445},{"type":"v1","addr":"172.21.15.1:6831","nonce":4281279445}]},"public_addr":"172.21.15.1:6827/4281279445","cluster_addr":"172.21.15.1:6829/4281279445","heartbeat_back_addr":"172.21.15.1:6833/4281279445","heartbeat_front_addr":"172.21.15.1:6831/4281279445","state":["exists","up"]},{"osd":2,"uuid":"144e63cd-0e36-4988-8d50-6b99198752d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6801","nonce":3014237921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6803","nonce":3014237921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6807","nonce":3014237921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":3014237921},{"type":"v1","addr":"172.21.15.1:6805","nonce":3014237921}]},"public_addr":"172.21.15.1:6801/3014237921","cluster_addr":"172.21.15.1:6803/3014237921","heartbeat_back_addr":"172.21.15.1:6807/3014237921","heartbeat_front_addr":"172.21.15.1:6805/3014237921","state":["exists","up"]},{"osd":3,"uuid":"8ef87915-483d-453e-8d9d-6e19986d537f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6811","nonce":4171924987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6813","nonce":4171924987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6817","nonce":4171924987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":4171924987},{"type":"v1","addr":"172.21.15.1:6815","nonce":4171924987}]},"public_addr":"172.21.15.1:6811/4171924987","cluster_addr":"172.21.15.1:6813/4171924987","heartbeat_back_addr":"172.21.15.1:6817/4171924987","heartbeat_front_addr":"172.21.15.1:6815/4171924987","state":["exists","up"]},{"osd":4,"uuid":"307bd14a-a3ef-4565-9bba-4ae91e65b01d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6817","nonce":3705222670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6819","nonce":3705222670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6823","nonce":3705222670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3705222670},{"type":"v1","addr":"172.21.15.70:6821","nonce":3705222670}]},"public_addr":"172.21.15.70:6817/3705222670","cluster_addr":"172.21.15.70:6819/3705222670","heartbeat_back_addr":"172.21.15.70:6823/3705222670","heartbeat_front_addr":"172.21.15.70:6821/3705222670","state":["exists","up"]},{"osd":5,"uuid":"934dded5-49c6-4d64-9341-e1209c0f21c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6801","nonce":1012183169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6803","nonce":1012183169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6807","nonce":1012183169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1012183169},{"type":"v1","addr":"172.21.15.70:6805","nonce":1012183169}]},"public_addr":"172.21.15.70:6801/1012183169","cluster_addr":"172.21.15.70:6803/1012183169","heartbeat_back_addr":"172.21.15.70:6807/1012183169","heartbeat_front_addr":"172.21.15.70:6805/1012183169","state":["exists","up"]},{"osd":6,"uuid":"ebb7a66f-2d89-4df5-b18b-2c305cef9cb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6825","nonce":2395913130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6827","nonce":2395913130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6831","nonce":2395913130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2395913130},{"type":"v1","addr":"172.21.15.70:6829","nonce":2395913130}]},"public_addr":"172.21.15.70:6825/2395913130","cluster_addr":"172.21.15.70:6827/2395913130","heartbeat_back_addr":"172.21.15.70:6831/2395913130","heartbeat_front_addr":"172.21.15.70:6829/2395913130","state":["exists","up"]},{"osd":7,"uuid":"f5ff9c93-d38e-4cca-9949-5fc533aeaad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6809","nonce":1018485464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6811","nonce":1018485464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6815","nonce":1018485464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1018485464},{"type":"v1","addr":"172.21.15.70:6813","nonce":1018485464}]},"public_addr":"172.21.15.70:6809/1018485464","cluster_addr":"172.21.15.70:6811/1018485464","heartbeat_back_addr":"172.21.15.70:6815/1018485464","heartbeat_front_addr":"172.21.15.70:6813/1018485464","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.791064+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.949616+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.234376+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.890489+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.664624+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.953407+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.839065+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T21:55:06.169196+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6835/3595905659":"2024-09-16T21:56:12.523065+0000","172.21.15.1:6834/3595905659":"2024-09-16T21:56:12.523065+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T21:56:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.380+0000 7fd42198b640 1 -- 172.21.15.1:0/3731719497 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd4080678c0 msgr2=0x7fd408069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.380+0000 7fd42198b640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd4080678c0 0x7fd408069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0ad000 tx=0x7fd40c008040 comp rx=0 tx=0).stop 2024-09-15T21:56:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.380+0000 7fd42198b640 1 -- 172.21.15.1:0/3731719497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd41c147ea0 msgr2=0x7fd41c143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.380+0000 7fd42198b640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd41c147ea0 0x7fd41c143ba0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c780 tx=0x7fd41000cc40 comp rx=0 tx=0).stop 2024-09-15T21:56:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.380+0000 7fd42198b640 1 -- 172.21.15.1:0/3731719497 shutdown_connections 2024-09-15T21:56:18.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.380+0000 7fd42198b640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fd4080678c0 0x7fd408069d80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:18.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.380+0000 7fd42198b640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd41c1501f0 0x7fd41c1e0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:18.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.380+0000 7fd42198b640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd41c147ea0 0x7fd41c143ba0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:18.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.380+0000 7fd42198b640 1 --2- 172.21.15.1:0/3731719497 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd41c06bf20 0x7fd41c144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:18.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.380+0000 7fd42198b640 1 -- 172.21.15.1:0/3731719497 >> 172.21.15.1:0/3731719497 conn(0x7fd41c0ba200 msgr2=0x7fd41c0b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:18.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.380+0000 7fd42198b640 1 -- 172.21.15.1:0/3731719497 shutdown_connections 2024-09-15T21:56:18.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:18.380+0000 7fd42198b640 1 -- 172.21.15.1:0/3731719497 wait complete. 2024-09-15T21:56:19.402 INFO:tasks.ceph:Scrubbing osd.0 2024-09-15T21:56:19.402 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-15T21:56:19.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.536+0000 7f535d677640 1 Processor -- start 2024-09-15T21:56:19.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.536+0000 7f535d677640 1 -- start start 2024-09-15T21:56:19.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.536+0000 7f535d677640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f53580b4560 0x7f53580b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.536+0000 7f535d677640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f535806d0d0 0x7f5358148d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.536+0000 7f535d677640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5358149280 0x7f535809dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.536+0000 7f535d677640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f535806dc00 con 0x7f535806d0d0 2024-09-15T21:56:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.536+0000 7f535d677640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f53581496c0 con 0x7f53580b4560 2024-09-15T21:56:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.536+0000 7f535d677640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f535806d5b0 con 0x7f5358149280 2024-09-15T21:56:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.536+0000 7f53567fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f535806d0d0 0x7f5358148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f53567fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f535806d0d0 0x7f5358148d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38798/0 (socket says 172.21.15.1:38798) 2024-09-15T21:56:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f53567fc640 1 -- 172.21.15.1:0/1890936680 learned_addr learned my addr 172.21.15.1:0/1890936680 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f53577fe640 1 --2- 172.21.15.1:0/1890936680 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5358149280 0x7f535809dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f5356ffd640 1 --2- 172.21.15.1:0/1890936680 >> v2:172.21.15.70:3300/0 conn(0x7f53580b4560 0x7f53580b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f53567fc640 1 -- 172.21.15.1:0/1890936680 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5358149280 msgr2=0x7f535809dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f53567fc640 1 --2- 172.21.15.1:0/1890936680 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5358149280 0x7f535809dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f53567fc640 1 -- 172.21.15.1:0/1890936680 >> v2:172.21.15.70:3300/0 conn(0x7f53580b4560 msgr2=0x7f53580b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f53567fc640 1 --2- 172.21.15.1:0/1890936680 >> v2:172.21.15.70:3300/0 conn(0x7f53580b4560 0x7f53580b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f53567fc640 1 -- 172.21.15.1:0/1890936680 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535806d890 con 0x7f535806d0d0 2024-09-15T21:56:19.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f53577fe640 1 --2- 172.21.15.1:0/1890936680 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5358149280 0x7f535809dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:19.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f53567fc640 1 --2- 172.21.15.1:0/1890936680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f535806d0d0 0x7f5358148d40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f53580b03d0 tx=0x7f534c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6dc331d29d1f9da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:19.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f5355ffb640 1 -- 172.21.15.1:0/1890936680 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c0b0070 con 0x7f535806d0d0 2024-09-15T21:56:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f5355ffb640 1 -- 172.21.15.1:0/1890936680 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f534c0ab600 con 0x7f535806d0d0 2024-09-15T21:56:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f5355ffb640 1 -- 172.21.15.1:0/1890936680 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c0ab9d0 con 0x7f535806d0d0 2024-09-15T21:56:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f535d677640 1 -- 172.21.15.1:0/1890936680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f535806d0d0 msgr2=0x7f5358148d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f535d677640 1 --2- 172.21.15.1:0/1890936680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f535806d0d0 0x7f5358148d40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f53580b03d0 tx=0x7f534c01c490 comp rx=0 tx=0).stop 2024-09-15T21:56:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f535d677640 1 -- 172.21.15.1:0/1890936680 shutdown_connections 2024-09-15T21:56:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f535d677640 1 --2- 172.21.15.1:0/1890936680 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5358149280 0x7f535809dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f535d677640 1 --2- 172.21.15.1:0/1890936680 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f535806d0d0 0x7f5358148d40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f535d677640 1 --2- 172.21.15.1:0/1890936680 >> v2:172.21.15.70:3300/0 conn(0x7f53580b4560 0x7f53580b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f535d677640 1 -- 172.21.15.1:0/1890936680 >> 172.21.15.1:0/1890936680 conn(0x7f535806c730 msgr2=0x7f53580b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f535d677640 1 -- 172.21.15.1:0/1890936680 shutdown_connections 2024-09-15T21:56:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.540+0000 7f535d677640 1 -- 172.21.15.1:0/1890936680 wait complete. 2024-09-15T21:56:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f535d677640 1 Processor -- start 2024-09-15T21:56:19.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f535d677640 1 -- start start 2024-09-15T21:56:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f535d677640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f535806d0d0 0x7f53580b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f535d677640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53580b4560 0x7f53581e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f535d677640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5358149280 0x7f53581e0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f535d677640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f535809b5f0 con 0x7f535806d0d0 2024-09-15T21:56:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f535d677640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f535809b470 con 0x7f53580b4560 2024-09-15T21:56:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f535d677640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f535809b770 con 0x7f5358149280 2024-09-15T21:56:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f5356ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f535806d0d0 0x7f53580b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f5356ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f535806d0d0 0x7f53580b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38800/0 (socket says 172.21.15.1:38800) 2024-09-15T21:56:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f5356ffd640 1 -- 172.21.15.1:0/112891476 learned_addr learned my addr 172.21.15.1:0/112891476 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:19.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f53577fe640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5358149280 0x7f53581e0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f5356ffd640 1 -- 172.21.15.1:0/112891476 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5358149280 msgr2=0x7f53581e0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:19.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f53567fc640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53580b4560 0x7f53581e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f5356ffd640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5358149280 0x7f53581e0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f5356ffd640 1 -- 172.21.15.1:0/112891476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53580b4560 msgr2=0x7f53581e05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:19.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f5356ffd640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53580b4560 0x7f53581e05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f5356ffd640 1 -- 172.21.15.1:0/112891476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53580af900 con 0x7f535806d0d0 2024-09-15T21:56:19.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f53567fc640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53580b4560 0x7f53581e05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:19.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f5356ffd640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f535806d0d0 0x7f53580b2360 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f534800d800 tx=0x7f534800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:19.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f533f7fe640 1 -- 172.21.15.1:0/112891476 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534800b6c0 con 0x7f535806d0d0 2024-09-15T21:56:19.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f533f7fe640 1 -- 172.21.15.1:0/112891476 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5348019070 con 0x7f535806d0d0 2024-09-15T21:56:19.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f533f7fe640 1 -- 172.21.15.1:0/112891476 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534800ba60 con 0x7f535806d0d0 2024-09-15T21:56:19.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f535d677640 1 -- 172.21.15.1:0/112891476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53580ae560 con 0x7f535806d0d0 2024-09-15T21:56:19.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f535d677640 1 -- 172.21.15.1:0/112891476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53580ae800 con 0x7f535806d0d0 2024-09-15T21:56:19.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f535d677640 1 -- 172.21.15.1:0/112891476 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53580b4940 con 0x7f535806d0d0 2024-09-15T21:56:19.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f533f7fe640 1 -- 172.21.15.1:0/112891476 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f534800bc00 con 0x7f535806d0d0 2024-09-15T21:56:19.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f533f7fe640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f53440678c0 0x7f5344069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.544+0000 7f533f7fe640 1 -- 172.21.15.1:0/112891476 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f5348086810 con 0x7f535806d0d0 2024-09-15T21:56:19.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.548+0000 7f53567fc640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f53440678c0 0x7f5344069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.548+0000 7f533f7fe640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] conn(0x7f534406d780 0x7f534406fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.548+0000 7f533f7fe640 1 -- 172.21.15.1:0/112891476 --> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f534801fe50 con 0x7f534406d780 2024-09-15T21:56:19.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.548+0000 7f533f7fe640 1 -- 172.21.15.1:0/112891476 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5348086ca0 con 0x7f535806d0d0 2024-09-15T21:56:19.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.548+0000 7f53577fe640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] conn(0x7f534406d780 0x7f534406fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.548+0000 7f53567fc640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f53440678c0 0x7f5344069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f534c0ad000 tx=0x7f534c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:19.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.548+0000 7f53577fe640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] conn(0x7f534406d780 0x7f534406fba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:19.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.548+0000 7f533f7fe640 1 -- 172.21.15.1:0/112891476 <== osd.0 v2:172.21.15.1:6818/2645824093 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f534801fe50 con 0x7f534406d780 2024-09-15T21:56:19.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.560+0000 7f535d677640 1 -- 172.21.15.1:0/112891476 --> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5358076170 con 0x7f534406d780 2024-09-15T21:56:19.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.560+0000 7f533f7fe640 1 -- 172.21.15.1:0/112891476 <== osd.0 v2:172.21.15.1:6818/2645824093 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5358076170 con 0x7f534406d780 2024-09-15T21:56:19.567 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T21:56:19.567 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T21:56:19.567 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T21:56:19.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.560+0000 7f535d677640 1 -- 172.21.15.1:0/112891476 >> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] conn(0x7f534406d780 msgr2=0x7f534406fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:19.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.560+0000 7f535d677640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.1:6818/2645824093,v1:172.21.15.1:6819/2645824093] conn(0x7f534406d780 0x7f534406fba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.560+0000 7f535d677640 1 -- 172.21.15.1:0/112891476 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f53440678c0 msgr2=0x7f5344069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:19.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.560+0000 7f535d677640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f53440678c0 0x7f5344069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f534c0ad000 tx=0x7f534c008040 comp rx=0 tx=0).stop 2024-09-15T21:56:19.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.560+0000 7f535d677640 1 -- 172.21.15.1:0/112891476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f535806d0d0 msgr2=0x7f53580b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:19.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.560+0000 7f535d677640 1 --2- 172.21.15.1:0/112891476 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f535806d0d0 0x7f53580b2360 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f534800d800 tx=0x7f534800dcc0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.560+0000 7f53577fe640 1 -- 172.21.15.1:0/112891476 reap_dead start 2024-09-15T21:56:19.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.560+0000 7f535d677640 1 -- 172.21.15.1:0/112891476 shutdown_connections 2024-09-15T21:56:19.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.560+0000 7f535d677640 1 -- 172.21.15.1:0/112891476 >> 172.21.15.1:0/112891476 conn(0x7f535806c730 msgr2=0x7f5358145740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:19.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.560+0000 7f535d677640 1 -- 172.21.15.1:0/112891476 shutdown_connections 2024-09-15T21:56:19.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.560+0000 7f535d677640 1 -- 172.21.15.1:0/112891476 wait complete. 2024-09-15T21:56:19.583 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-15T21:56:19.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5fe86e640 1 Processor -- start 2024-09-15T21:56:19.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5fe86e640 1 -- start start 2024-09-15T21:56:19.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5fe86e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe5f80b6220 0x7fe5f80b6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5fe86e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe5f806f340 0x7fe5f81494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5fe86e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f806fc30 con 0x7fe5f806f770 2024-09-15T21:56:19.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5fe86e640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fe5f8072580 con 0x7fe5f806f340 2024-09-15T21:56:19.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5fe86e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fe5f8148fa0 con 0x7fe5f80b6220 2024-09-15T21:56:19.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5f77fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe5f806f340 0x7fe5f81494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5f77fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe5f806f340 0x7fe5f81494c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38816/0 (socket says 172.21.15.1:38816) 2024-09-15T21:56:19.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5f77fe640 1 -- 172.21.15.1:0/2722074580 learned_addr learned my addr 172.21.15.1:0/2722074580 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5f7fff640 1 --2- 172.21.15.1:0/2722074580 >> v2:172.21.15.70:3300/0 conn(0x7fe5f80b6220 0x7fe5f80b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5f77fe640 1 -- 172.21.15.1:0/2722074580 >> v2:172.21.15.70:3300/0 conn(0x7fe5f80b6220 msgr2=0x7fe5f80b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5f77fe640 1 --2- 172.21.15.1:0/2722074580 >> v2:172.21.15.70:3300/0 conn(0x7fe5f80b6220 0x7fe5f80b6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5f77fe640 1 -- 172.21.15.1:0/2722074580 >> v1:172.21.15.70:6789/0 conn(0x7fe5f806f770 legacy=0x7fe5f8142a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:19.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.696+0000 7fe5f77fe640 1 -- 172.21.15.1:0/2722074580 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f81431a0 con 0x7fe5f806f340 2024-09-15T21:56:19.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5f77fe640 1 --2- 172.21.15.1:0/2722074580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5f806f340 0x7fe5f81494c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8068990 tx=0x7fe5e801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e044c1a005ad35 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:19.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5f6ffd640 1 -- 172.21.15.1:0/2722074580 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e80b0070 con 0x7fe5f806f340 2024-09-15T21:56:19.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5f6ffd640 1 -- 172.21.15.1:0/2722074580 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e80ab600 con 0x7fe5f806f340 2024-09-15T21:56:19.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5f6ffd640 1 -- 172.21.15.1:0/2722074580 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e80ab9d0 con 0x7fe5f806f340 2024-09-15T21:56:19.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5fe86e640 1 -- 172.21.15.1:0/2722074580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5f806f340 msgr2=0x7fe5f81494c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:19.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5fe86e640 1 --2- 172.21.15.1:0/2722074580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5f806f340 0x7fe5f81494c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8068990 tx=0x7fe5e801c460 comp rx=0 tx=0).stop 2024-09-15T21:56:19.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5fe86e640 1 -- 172.21.15.1:0/2722074580 shutdown_connections 2024-09-15T21:56:19.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5fe86e640 1 --2- 172.21.15.1:0/2722074580 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5f806f340 0x7fe5f81494c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5fe86e640 1 --2- 172.21.15.1:0/2722074580 >> v2:172.21.15.70:3300/0 conn(0x7fe5f80b6220 0x7fe5f80b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5fe86e640 1 -- 172.21.15.1:0/2722074580 >> 172.21.15.1:0/2722074580 conn(0x7fe5f809d160 msgr2=0x7fe5f809d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:19.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5fe86e640 1 -- 172.21.15.1:0/2722074580 shutdown_connections 2024-09-15T21:56:19.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5fe86e640 1 -- 172.21.15.1:0/2722074580 wait complete. 2024-09-15T21:56:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5fe86e640 1 Processor -- start 2024-09-15T21:56:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.700+0000 7fe5fe86e640 1 -- start start 2024-09-15T21:56:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fe86e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f806f340 0x7fe5f813ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fe86e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe5f806f770 0x7fe5f80ba9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fe86e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5f80b6220 0x7fe5f81e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fe86e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8152d40 con 0x7fe5f80b6220 2024-09-15T21:56:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fe86e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8152bc0 con 0x7fe5f806f340 2024-09-15T21:56:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fe86e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f8152ec0 con 0x7fe5f806f770 2024-09-15T21:56:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fce0b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5f80b6220 0x7fe5f81e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fce0b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5f80b6220 0x7fe5f81e36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38824/0 (socket says 172.21.15.1:38824) 2024-09-15T21:56:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fce0b640 1 -- 172.21.15.1:0/3850424840 learned_addr learned my addr 172.21.15.1:0/3850424840 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5f7fff640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f806f340 0x7fe5f813ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5f77fe640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe5f806f770 0x7fe5f80ba9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fce0b640 1 -- 172.21.15.1:0/3850424840 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe5f806f770 msgr2=0x7fe5f80ba9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fce0b640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe5f806f770 0x7fe5f80ba9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fce0b640 1 -- 172.21.15.1:0/3850424840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f806f340 msgr2=0x7fe5f813ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fce0b640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f806f340 0x7fe5f813ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fce0b640 1 -- 172.21.15.1:0/3850424840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f813c540 con 0x7fe5f80b6220 2024-09-15T21:56:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5f7fff640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f806f340 0x7fe5f813ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:56:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fce0b640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5f80b6220 0x7fe5f81e36e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000c770 tx=0x7fe5f000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5f4ff9640 1 -- 172.21.15.1:0/3850424840 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0003b80 con 0x7fe5f80b6220 2024-09-15T21:56:19.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5f4ff9640 1 -- 172.21.15.1:0/3850424840 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f0003d20 con 0x7fe5f80b6220 2024-09-15T21:56:19.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fe86e640 1 -- 172.21.15.1:0/3850424840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f813bbc0 con 0x7fe5f80b6220 2024-09-15T21:56:19.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5f4ff9640 1 -- 172.21.15.1:0/3850424840 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f000aa90 con 0x7fe5f80b6220 2024-09-15T21:56:19.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fe86e640 1 -- 172.21.15.1:0/3850424840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f80baee0 con 0x7fe5f80b6220 2024-09-15T21:56:19.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5fe86e640 1 -- 172.21.15.1:0/3850424840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f80b7c50 con 0x7fe5f80b6220 2024-09-15T21:56:19.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5f4ff9640 1 -- 172.21.15.1:0/3850424840 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe5f000ac30 con 0x7fe5f80b6220 2024-09-15T21:56:19.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5f4ff9640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe5d80678f0 0x7fe5d8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:19.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5f4ff9640 1 -- 172.21.15.1:0/3850424840 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7fe5f00862e0 con 0x7fe5f80b6220 2024-09-15T21:56:19.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5f7fff640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe5d80678f0 0x7fe5d8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:19.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.704+0000 7fe5f7fff640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe5d80678f0 0x7fe5d8069db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe5f813fb60 tx=0x7fe5e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:19.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.708+0000 7fe5f4ff9640 1 -- 172.21.15.1:0/3850424840 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe5f0057210 con 0x7fe5f80b6220 2024-09-15T21:56:19.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5fe86e640 1 -- 172.21.15.1:0/3850424840 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe5f813c330 con 0x7fe5d80678f0 2024-09-15T21:56:19.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5f4ff9640 1 -- 172.21.15.1:0/3850424840 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe5f813c330 con 0x7fe5d80678f0 2024-09-15T21:56:19.873 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 0 to deep-scrub 2024-09-15T21:56:19.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5fe86e640 1 -- 172.21.15.1:0/3850424840 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe5d80678f0 msgr2=0x7fe5d8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:19.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5fe86e640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe5d80678f0 0x7fe5d8069db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe5f813fb60 tx=0x7fe5e0008040 comp rx=0 tx=0).stop 2024-09-15T21:56:19.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5fe86e640 1 -- 172.21.15.1:0/3850424840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5f80b6220 msgr2=0x7fe5f81e36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:19.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5fe86e640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5f80b6220 0x7fe5f81e36e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000c770 tx=0x7fe5f000cc30 comp rx=0 tx=0).stop 2024-09-15T21:56:19.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5fe86e640 1 -- 172.21.15.1:0/3850424840 shutdown_connections 2024-09-15T21:56:19.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5fe86e640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5f80b6220 0x7fe5f81e36e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5fe86e640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe5f806f770 0x7fe5f80ba9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5fe86e640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe5d80678f0 0x7fe5d8069db0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5fe86e640 1 --2- 172.21.15.1:0/3850424840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5f806f340 0x7fe5f813ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:19.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5fe86e640 1 -- 172.21.15.1:0/3850424840 >> 172.21.15.1:0/3850424840 conn(0x7fe5f809d160 msgr2=0x7fe5f809b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:19.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5fe86e640 1 -- 172.21.15.1:0/3850424840 shutdown_connections 2024-09-15T21:56:19.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:19.868+0000 7fe5fe86e640 1 -- 172.21.15.1:0/3850424840 wait complete. 2024-09-15T21:56:19.890 INFO:tasks.ceph:Scrubbing osd.1 2024-09-15T21:56:19.891 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-15T21:56:20.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f2df70640 1 Processor -- start 2024-09-15T21:56:20.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f2df70640 1 -- start start 2024-09-15T21:56:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f2df70640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6f280bc1a0 0x7f6f280bb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f2df70640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6f28147fe0 0x7f6f281483f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f2df70640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2806db80 con 0x7f6f280b9710 2024-09-15T21:56:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f2df70640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f6f280bb650 con 0x7f6f28147fe0 2024-09-15T21:56:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f2df70640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f6f28145300 con 0x7f6f280bc1a0 2024-09-15T21:56:20.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f27fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6f28147fe0 0x7f6f281483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f27fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6f28147fe0 0x7f6f281483f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38828/0 (socket says 172.21.15.1:38828) 2024-09-15T21:56:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f27fff640 1 -- 172.21.15.1:0/1492008093 learned_addr learned my addr 172.21.15.1:0/1492008093 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f277fe640 1 --2- 172.21.15.1:0/1492008093 >> v2:172.21.15.70:3300/0 conn(0x7f6f280bc1a0 0x7f6f280bb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f27fff640 1 -- 172.21.15.1:0/1492008093 >> v2:172.21.15.70:3300/0 conn(0x7f6f280bc1a0 msgr2=0x7f6f280bb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f27fff640 1 --2- 172.21.15.1:0/1492008093 >> v2:172.21.15.70:3300/0 conn(0x7f6f280bc1a0 0x7f6f280bb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f27fff640 1 -- 172.21.15.1:0/1492008093 >> v1:172.21.15.70:6789/0 conn(0x7f6f280b9710 legacy=0x7f6f2806d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f27fff640 1 -- 172.21.15.1:0/1492008093 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f280bc580 con 0x7f6f28147fe0 2024-09-15T21:56:20.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.004+0000 7f6f277fe640 1 --2- 172.21.15.1:0/1492008093 >> v2:172.21.15.70:3300/0 conn(0x7f6f280bc1a0 0x7f6f280bb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:20.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f27fff640 1 --2- 172.21.15.1:0/1492008093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f28147fe0 0x7f6f281483f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6f28069580 tx=0x7f6f2001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c792883c2c15728b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f267fc640 1 -- 172.21.15.1:0/1492008093 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f200a5760 con 0x7f6f28147fe0 2024-09-15T21:56:20.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f267fc640 1 -- 172.21.15.1:0/1492008093 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f200a5900 con 0x7f6f28147fe0 2024-09-15T21:56:20.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f267fc640 1 -- 172.21.15.1:0/1492008093 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f200a5cd0 con 0x7f6f28147fe0 2024-09-15T21:56:20.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 -- 172.21.15.1:0/1492008093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f28147fe0 msgr2=0x7f6f281483f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 --2- 172.21.15.1:0/1492008093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f28147fe0 0x7f6f281483f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6f28069580 tx=0x7f6f2001c9b0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 -- 172.21.15.1:0/1492008093 shutdown_connections 2024-09-15T21:56:20.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 --2- 172.21.15.1:0/1492008093 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f28147fe0 0x7f6f281483f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 --2- 172.21.15.1:0/1492008093 >> v2:172.21.15.70:3300/0 conn(0x7f6f280bc1a0 0x7f6f280bb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 -- 172.21.15.1:0/1492008093 >> 172.21.15.1:0/1492008093 conn(0x7f6f280b9df0 msgr2=0x7f6f280ba200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:20.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 -- 172.21.15.1:0/1492008093 shutdown_connections 2024-09-15T21:56:20.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 -- 172.21.15.1:0/1492008093 wait complete. 2024-09-15T21:56:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 Processor -- start 2024-09-15T21:56:20.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 -- start start 2024-09-15T21:56:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f280b9710 0x7f6f2809cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f280bc1a0 0x7f6f28149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f28147fe0 0x7f6f2809e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6f281479d0 con 0x7f6f280b9710 2024-09-15T21:56:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6f28147850 con 0x7f6f28147fe0 2024-09-15T21:56:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f2df70640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f6f28154990 con 0x7f6f280bc1a0 2024-09-15T21:56:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f277fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f280b9710 0x7f6f2809cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f277fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f280b9710 0x7f6f2809cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38832/0 (socket says 172.21.15.1:38832) 2024-09-15T21:56:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f277fe640 1 -- 172.21.15.1:0/537703262 learned_addr learned my addr 172.21.15.1:0/537703262 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f26ffd640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f280bc1a0 0x7f6f28149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f27fff640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f28147fe0 0x7f6f2809e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f277fe640 1 -- 172.21.15.1:0/537703262 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f280bc1a0 msgr2=0x7f6f28149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f277fe640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6f280bc1a0 0x7f6f28149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f277fe640 1 -- 172.21.15.1:0/537703262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f28147fe0 msgr2=0x7f6f2809e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f277fe640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f28147fe0 0x7f6f2809e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f277fe640 1 -- 172.21.15.1:0/537703262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2809dc80 con 0x7f6f280b9710 2024-09-15T21:56:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f27fff640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f28147fe0 0x7f6f2809e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.008+0000 7f6f277fe640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f280b9710 0x7f6f2809cb50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00c7f0 tx=0x7f6f1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f0ffff640 1 -- 172.21.15.1:0/537703262 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c007a30 con 0x7f6f280b9710 2024-09-15T21:56:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f0ffff640 1 -- 172.21.15.1:0/537703262 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f1c007bd0 con 0x7f6f280b9710 2024-09-15T21:56:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f2df70640 1 -- 172.21.15.1:0/537703262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2814b6f0 con 0x7f6f280b9710 2024-09-15T21:56:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f0ffff640 1 -- 172.21.15.1:0/537703262 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0113f0 con 0x7f6f280b9710 2024-09-15T21:56:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f2df70640 1 -- 172.21.15.1:0/537703262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f2809c080 con 0x7f6f280b9710 2024-09-15T21:56:20.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f2df70640 1 -- 172.21.15.1:0/537703262 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f280bb110 con 0x7f6f280b9710 2024-09-15T21:56:20.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f0ffff640 1 -- 172.21.15.1:0/537703262 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f1c011590 con 0x7f6f280b9710 2024-09-15T21:56:20.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f0ffff640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f6f140678c0 0x7f6f14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f0ffff640 1 -- 172.21.15.1:0/537703262 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f6f1c085b00 con 0x7f6f280b9710 2024-09-15T21:56:20.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f26ffd640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f6f140678c0 0x7f6f14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f0ffff640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] conn(0x7f6f1406d780 0x7f6f1406fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f0ffff640 1 -- 172.21.15.1:0/537703262 --> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f1c006820 con 0x7f6f1406d780 2024-09-15T21:56:20.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f0ffff640 1 -- 172.21.15.1:0/537703262 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6f1c08a2c0 con 0x7f6f280b9710 2024-09-15T21:56:20.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f27fff640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] conn(0x7f6f1406d780 0x7f6f1406fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f26ffd640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f6f140678c0 0x7f6f14069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6f18007fd0 tx=0x7f6f18009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f27fff640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] conn(0x7f6f1406d780 0x7f6f1406fba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.012+0000 7f6f0ffff640 1 -- 172.21.15.1:0/537703262 <== osd.1 v2:172.21.15.1:6826/4281279445 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f1c006820 con 0x7f6f1406d780 2024-09-15T21:56:20.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.024+0000 7f6f2df70640 1 -- 172.21.15.1:0/537703262 --> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6f280b2b20 con 0x7f6f1406d780 2024-09-15T21:56:20.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.028+0000 7f6f0ffff640 1 -- 172.21.15.1:0/537703262 <== osd.1 v2:172.21.15.1:6826/4281279445 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6f280b2b20 con 0x7f6f1406d780 2024-09-15T21:56:20.032 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T21:56:20.032 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T21:56:20.033 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T21:56:20.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.028+0000 7f6f2df70640 1 -- 172.21.15.1:0/537703262 >> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] conn(0x7f6f1406d780 msgr2=0x7f6f1406fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.028+0000 7f6f2df70640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.1:6826/4281279445,v1:172.21.15.1:6827/4281279445] conn(0x7f6f1406d780 0x7f6f1406fba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.028+0000 7f6f2df70640 1 -- 172.21.15.1:0/537703262 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f6f140678c0 msgr2=0x7f6f14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.028+0000 7f6f2df70640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f6f140678c0 0x7f6f14069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6f18007fd0 tx=0x7f6f18009040 comp rx=0 tx=0).stop 2024-09-15T21:56:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.028+0000 7f6f2df70640 1 -- 172.21.15.1:0/537703262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f280b9710 msgr2=0x7f6f2809cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.028+0000 7f6f2df70640 1 --2- 172.21.15.1:0/537703262 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6f280b9710 0x7f6f2809cb50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00c7f0 tx=0x7f6f1c00ccb0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.028+0000 7f6f27fff640 1 -- 172.21.15.1:0/537703262 reap_dead start 2024-09-15T21:56:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.028+0000 7f6f2df70640 1 -- 172.21.15.1:0/537703262 shutdown_connections 2024-09-15T21:56:20.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.028+0000 7f6f2df70640 1 -- 172.21.15.1:0/537703262 >> 172.21.15.1:0/537703262 conn(0x7f6f280b9df0 msgr2=0x7f6f28146e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:20.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.028+0000 7f6f2df70640 1 -- 172.21.15.1:0/537703262 shutdown_connections 2024-09-15T21:56:20.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.028+0000 7f6f2df70640 1 -- 172.21.15.1:0/537703262 wait complete. 2024-09-15T21:56:20.047 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-15T21:56:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b1f855640 1 Processor -- start 2024-09-15T21:56:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b1f855640 1 -- start start 2024-09-15T21:56:20.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b1f855640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4b18145080 0x7f4b18147800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b1f855640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b180b91b0 con 0x7f4b180b9a50 2024-09-15T21:56:20.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b1f855640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b180bdfc0 con 0x7f4b180b8dd0 2024-09-15T21:56:20.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b1f855640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f4b18147d40 con 0x7f4b18145080 2024-09-15T21:56:20.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b1ddf2640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4b180b9a50 0x7f4b181520e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58298/0 (socket says 172.21.15.1:58298) 2024-09-15T21:56:20.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b1ddf2640 1 -- 172.21.15.1:0/2796937431 learned_addr learned my addr 172.21.15.1:0/2796937431 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:20.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b1cdf0640 1 --2- 172.21.15.1:0/2796937431 >> v2:172.21.15.1:3300/0 conn(0x7f4b18145080 0x7f4b18147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b0bfff640 1 -- 172.21.15.1:0/2796937431 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 834901057 0 0) 0x7f4b180b91b0 con 0x7f4b180b9a50 2024-09-15T21:56:20.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b0bfff640 1 -- 172.21.15.1:0/2796937431 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b04003530 con 0x7f4b180b9a50 2024-09-15T21:56:20.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b1cdf0640 1 -- 172.21.15.1:0/2796937431 >> v1:172.21.15.70:6789/0 conn(0x7f4b180b8dd0 legacy=0x7f4b18144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b1cdf0640 1 -- 172.21.15.1:0/2796937431 >> v1:172.21.15.1:6789/0 conn(0x7f4b180b9a50 legacy=0x7f4b181520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.156+0000 7f4b1cdf0640 1 -- 172.21.15.1:0/2796937431 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1809b140 con 0x7f4b18145080 2024-09-15T21:56:20.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1cdf0640 1 --2- 172.21.15.1:0/2796937431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b18145080 0x7f4b18147800 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009d90 tx=0x7f4b1401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7a9d6083fba859 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b0bfff640 1 -- 172.21.15.1:0/2796937431 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b140a66a0 con 0x7f4b18145080 2024-09-15T21:56:20.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b0bfff640 1 -- 172.21.15.1:0/2796937431 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b140a6840 con 0x7f4b18145080 2024-09-15T21:56:20.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b0bfff640 1 -- 172.21.15.1:0/2796937431 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b140a6c10 con 0x7f4b18145080 2024-09-15T21:56:20.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 -- 172.21.15.1:0/2796937431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b18145080 msgr2=0x7f4b18147800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 --2- 172.21.15.1:0/2796937431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b18145080 0x7f4b18147800 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009d90 tx=0x7f4b1401c850 comp rx=0 tx=0).stop 2024-09-15T21:56:20.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 -- 172.21.15.1:0/2796937431 shutdown_connections 2024-09-15T21:56:20.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 --2- 172.21.15.1:0/2796937431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b18145080 0x7f4b18147800 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 -- 172.21.15.1:0/2796937431 >> 172.21.15.1:0/2796937431 conn(0x7f4b18068060 msgr2=0x7f4b180bd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:20.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 -- 172.21.15.1:0/2796937431 shutdown_connections 2024-09-15T21:56:20.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 -- 172.21.15.1:0/2796937431 wait complete. 2024-09-15T21:56:20.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 Processor -- start 2024-09-15T21:56:20.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 -- start start 2024-09-15T21:56:20.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4b180b8dd0 0x7f4b180a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b18145080 0x7f4b1813bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b1813c170 0x7f4b18139150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4b18156230 con 0x7f4b1813c170 2024-09-15T21:56:20.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b180a2980 con 0x7f4b18145080 2024-09-15T21:56:20.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1f855640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4b181563b0 con 0x7f4b180b8dd0 2024-09-15T21:56:20.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1ddf2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b1813c170 0x7f4b18139150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1ddf2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b1813c170 0x7f4b18139150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38840/0 (socket says 172.21.15.1:38840) 2024-09-15T21:56:20.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.160+0000 7f4b1ddf2640 1 -- 172.21.15.1:0/3527971292 learned_addr learned my addr 172.21.15.1:0/3527971292 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:20.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b1cdf0640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b18145080 0x7f4b1813bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b1d5f1640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4b180b8dd0 0x7f4b180a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b1ddf2640 1 -- 172.21.15.1:0/3527971292 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4b180b8dd0 msgr2=0x7f4b180a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b1ddf2640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4b180b8dd0 0x7f4b180a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b1ddf2640 1 -- 172.21.15.1:0/3527971292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b18145080 msgr2=0x7f4b1813bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b1ddf2640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b18145080 0x7f4b1813bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b1ddf2640 1 -- 172.21.15.1:0/3527971292 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b181e3d90 con 0x7f4b1813c170 2024-09-15T21:56:20.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b1ddf2640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b1813c170 0x7f4b18139150 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000c450 tx=0x7f4b1000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b09ffb640 1 -- 172.21.15.1:0/3527971292 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b10017070 con 0x7f4b1813c170 2024-09-15T21:56:20.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b09ffb640 1 -- 172.21.15.1:0/3527971292 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b10005cf0 con 0x7f4b1813c170 2024-09-15T21:56:20.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b1f855640 1 -- 172.21.15.1:0/3527971292 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b181e4070 con 0x7f4b1813c170 2024-09-15T21:56:20.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b09ffb640 1 -- 172.21.15.1:0/3527971292 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b100072b0 con 0x7f4b1813c170 2024-09-15T21:56:20.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b1f855640 1 -- 172.21.15.1:0/3527971292 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b181e4870 con 0x7f4b1813c170 2024-09-15T21:56:20.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b1f855640 1 -- 172.21.15.1:0/3527971292 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b18152c50 con 0x7f4b1813c170 2024-09-15T21:56:20.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b09ffb640 1 -- 172.21.15.1:0/3527971292 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b1001a070 con 0x7f4b1813c170 2024-09-15T21:56:20.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b09ffb640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4afc0678c0 0x7f4afc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b09ffb640 1 -- 172.21.15.1:0/3527971292 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f4b10084c70 con 0x7f4b1813c170 2024-09-15T21:56:20.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b1d5f1640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4afc0678c0 0x7f4afc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.164+0000 7f4b1d5f1640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4afc0678c0 0x7f4afc069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c007fd0 tx=0x7f4b0c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.168+0000 7f4b09ffb640 1 -- 172.21.15.1:0/3527971292 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4b10055ab0 con 0x7f4b1813c170 2024-09-15T21:56:20.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.332+0000 7f4b1f855640 1 -- 172.21.15.1:0/3527971292 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f4b18147800 con 0x7f4afc0678c0 2024-09-15T21:56:20.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.332+0000 7f4b09ffb640 1 -- 172.21.15.1:0/3527971292 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4b18147800 con 0x7f4afc0678c0 2024-09-15T21:56:20.338 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 1 to deep-scrub 2024-09-15T21:56:20.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.336+0000 7f4b1f855640 1 -- 172.21.15.1:0/3527971292 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4afc0678c0 msgr2=0x7f4afc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.336+0000 7f4b1f855640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4afc0678c0 0x7f4afc069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c007fd0 tx=0x7f4b0c009040 comp rx=0 tx=0).stop 2024-09-15T21:56:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.336+0000 7f4b1f855640 1 -- 172.21.15.1:0/3527971292 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b1813c170 msgr2=0x7f4b18139150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.336+0000 7f4b1f855640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b1813c170 0x7f4b18139150 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000c450 tx=0x7f4b1000c910 comp rx=0 tx=0).stop 2024-09-15T21:56:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.336+0000 7f4b1f855640 1 -- 172.21.15.1:0/3527971292 shutdown_connections 2024-09-15T21:56:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.336+0000 7f4b1f855640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b1813c170 0x7f4b18139150 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.336+0000 7f4b1f855640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4afc0678c0 0x7f4afc069d80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.336+0000 7f4b1f855640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b18145080 0x7f4b1813bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.336+0000 7f4b1f855640 1 --2- 172.21.15.1:0/3527971292 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4b180b8dd0 0x7f4b180a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.336+0000 7f4b1f855640 1 -- 172.21.15.1:0/3527971292 >> 172.21.15.1:0/3527971292 conn(0x7f4b18068060 msgr2=0x7f4b18143cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:20.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.336+0000 7f4b1f855640 1 -- 172.21.15.1:0/3527971292 shutdown_connections 2024-09-15T21:56:20.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.336+0000 7f4b1f855640 1 -- 172.21.15.1:0/3527971292 wait complete. 2024-09-15T21:56:20.357 INFO:tasks.ceph:Scrubbing osd.2 2024-09-15T21:56:20.358 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-15T21:56:20.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.476+0000 7f3d57607640 1 Processor -- start 2024-09-15T21:56:20.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.476+0000 7f3d57607640 1 -- start start 2024-09-15T21:56:20.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d57607640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3d500b5560 0x7f3d500ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d57607640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3d5006d0d0 0x7f3d500afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d57607640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d5013e570 0x7f3d500b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d57607640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f3d500b0300 con 0x7f3d5006d0d0 2024-09-15T21:56:20.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d57607640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f3d500b5940 con 0x7f3d500b5560 2024-09-15T21:56:20.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d57607640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5006dbd0 con 0x7f3d5013e570 2024-09-15T21:56:20.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d54ba2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3d5006d0d0 0x7f3d500afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d54ba2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3d5006d0d0 0x7f3d500afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38848/0 (socket says 172.21.15.1:38848) 2024-09-15T21:56:20.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d54ba2640 1 -- 172.21.15.1:0/3560649418 learned_addr learned my addr 172.21.15.1:0/3560649418 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:20.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d55ba4640 1 --2- 172.21.15.1:0/3560649418 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d5013e570 0x7f3d500b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d553a3640 1 --2- 172.21.15.1:0/3560649418 >> v2:172.21.15.70:3300/0 conn(0x7f3d500b5560 0x7f3d500ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d54ba2640 1 -- 172.21.15.1:0/3560649418 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d5013e570 msgr2=0x7f3d500b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:20.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d54ba2640 1 --2- 172.21.15.1:0/3560649418 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d5013e570 0x7f3d500b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d54ba2640 1 -- 172.21.15.1:0/3560649418 >> v2:172.21.15.70:3300/0 conn(0x7f3d500b5560 msgr2=0x7f3d500ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:20.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d54ba2640 1 --2- 172.21.15.1:0/3560649418 >> v2:172.21.15.70:3300/0 conn(0x7f3d500b5560 0x7f3d500ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d54ba2640 1 -- 172.21.15.1:0/3560649418 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5006deb0 con 0x7f3d5006d0d0 2024-09-15T21:56:20.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d54ba2640 1 --2- 172.21.15.1:0/3560649418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d5006d0d0 0x7f3d500afdc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3d5006ea60 tx=0x7f3d4001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86347827a4d2d23 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d47fff640 1 -- 172.21.15.1:0/3560649418 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400b0070 con 0x7f3d5006d0d0 2024-09-15T21:56:20.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d47fff640 1 -- 172.21.15.1:0/3560649418 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d400ab600 con 0x7f3d5006d0d0 2024-09-15T21:56:20.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.480+0000 7f3d47fff640 1 -- 172.21.15.1:0/3560649418 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400ab9d0 con 0x7f3d5006d0d0 2024-09-15T21:56:20.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 -- 172.21.15.1:0/3560649418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d5006d0d0 msgr2=0x7f3d500afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 --2- 172.21.15.1:0/3560649418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d5006d0d0 0x7f3d500afdc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3d5006ea60 tx=0x7f3d4001c400 comp rx=0 tx=0).stop 2024-09-15T21:56:20.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 -- 172.21.15.1:0/3560649418 shutdown_connections 2024-09-15T21:56:20.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 --2- 172.21.15.1:0/3560649418 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d5013e570 0x7f3d500b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 --2- 172.21.15.1:0/3560649418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d5006d0d0 0x7f3d500afdc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 --2- 172.21.15.1:0/3560649418 >> v2:172.21.15.70:3300/0 conn(0x7f3d500b5560 0x7f3d500ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 -- 172.21.15.1:0/3560649418 >> 172.21.15.1:0/3560649418 conn(0x7f3d5006c730 msgr2=0x7f3d500b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:20.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 -- 172.21.15.1:0/3560649418 shutdown_connections 2024-09-15T21:56:20.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 -- 172.21.15.1:0/3560649418 wait complete. 2024-09-15T21:56:20.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 Processor -- start 2024-09-15T21:56:20.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 -- start start 2024-09-15T21:56:20.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d5006d0d0 0x7f3d500b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d500b5560 0x7f3d5013ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d5013e570 0x7f3d50141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3d50150dd0 con 0x7f3d5013e570 2024-09-15T21:56:20.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3d500b4f00 con 0x7f3d5006d0d0 2024-09-15T21:56:20.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f3d50150f50 con 0x7f3d500b5560 2024-09-15T21:56:20.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d55ba4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d5013e570 0x7f3d50141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d55ba4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d5013e570 0x7f3d50141580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38854/0 (socket says 172.21.15.1:38854) 2024-09-15T21:56:20.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d55ba4640 1 -- 172.21.15.1:0/637442654 learned_addr learned my addr 172.21.15.1:0/637442654 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:20.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d54ba2640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d500b5560 0x7f3d5013ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d553a3640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d5006d0d0 0x7f3d500b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d55ba4640 1 -- 172.21.15.1:0/637442654 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d500b5560 msgr2=0x7f3d5013ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d55ba4640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3d500b5560 0x7f3d5013ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d55ba4640 1 -- 172.21.15.1:0/637442654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d5006d0d0 msgr2=0x7f3d500b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d55ba4640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d5006d0d0 0x7f3d500b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d55ba4640 1 -- 172.21.15.1:0/637442654 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5013f680 con 0x7f3d5013e570 2024-09-15T21:56:20.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d55ba4640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d5013e570 0x7f3d50141580 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800d590 tx=0x7f3d4800da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d45ffb640 1 -- 172.21.15.1:0/637442654 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d480125f0 con 0x7f3d5013e570 2024-09-15T21:56:20.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d45ffb640 1 -- 172.21.15.1:0/637442654 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d48019070 con 0x7f3d5013e570 2024-09-15T21:56:20.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 -- 172.21.15.1:0/637442654 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5013f960 con 0x7f3d5013e570 2024-09-15T21:56:20.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d45ffb640 1 -- 172.21.15.1:0/637442654 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d480129f0 con 0x7f3d5013e570 2024-09-15T21:56:20.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.484+0000 7f3d57607640 1 -- 172.21.15.1:0/637442654 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d50071740 con 0x7f3d5013e570 2024-09-15T21:56:20.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.488+0000 7f3d57607640 1 -- 172.21.15.1:0/637442654 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d500ae0f0 con 0x7f3d5013e570 2024-09-15T21:56:20.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.488+0000 7f3d45ffb640 1 -- 172.21.15.1:0/637442654 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d48012b90 con 0x7f3d5013e570 2024-09-15T21:56:20.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.488+0000 7f3d45ffb640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3d340678f0 0x7f3d34069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.488+0000 7f3d45ffb640 1 -- 172.21.15.1:0/637442654 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f3d48086690 con 0x7f3d5013e570 2024-09-15T21:56:20.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.488+0000 7f3d553a3640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3d340678f0 0x7f3d34069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.488+0000 7f3d45ffb640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] conn(0x7f3d3406d7b0 0x7f3d3406fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.488+0000 7f3d45ffb640 1 -- 172.21.15.1:0/637442654 --> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d34070280 con 0x7f3d3406d7b0 2024-09-15T21:56:20.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.488+0000 7f3d45ffb640 1 -- 172.21.15.1:0/637442654 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3d48086b20 con 0x7f3d5013e570 2024-09-15T21:56:20.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.488+0000 7f3d54ba2640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] conn(0x7f3d3406d7b0 0x7f3d3406fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.488+0000 7f3d553a3640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3d340678f0 0x7f3d34069db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c003fd0 tx=0x7f3d4c003a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.488+0000 7f3d54ba2640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] conn(0x7f3d3406d7b0 0x7f3d3406fbd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.488+0000 7f3d45ffb640 1 -- 172.21.15.1:0/637442654 <== osd.2 v2:172.21.15.1:6800/3014237921 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d34070280 con 0x7f3d3406d7b0 2024-09-15T21:56:20.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.500+0000 7f3d57607640 1 -- 172.21.15.1:0/637442654 --> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3d500af350 con 0x7f3d3406d7b0 2024-09-15T21:56:20.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.504+0000 7f3d45ffb640 1 -- 172.21.15.1:0/637442654 <== osd.2 v2:172.21.15.1:6800/3014237921 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3d500af350 con 0x7f3d3406d7b0 2024-09-15T21:56:20.508 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T21:56:20.508 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T21:56:20.509 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T21:56:20.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.504+0000 7f3d57607640 1 -- 172.21.15.1:0/637442654 >> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] conn(0x7f3d3406d7b0 msgr2=0x7f3d3406fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.504+0000 7f3d57607640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.1:6800/3014237921,v1:172.21.15.1:6801/3014237921] conn(0x7f3d3406d7b0 0x7f3d3406fbd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.504+0000 7f3d57607640 1 -- 172.21.15.1:0/637442654 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3d340678f0 msgr2=0x7f3d34069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.504+0000 7f3d57607640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f3d340678f0 0x7f3d34069db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c003fd0 tx=0x7f3d4c003a00 comp rx=0 tx=0).stop 2024-09-15T21:56:20.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.504+0000 7f3d57607640 1 -- 172.21.15.1:0/637442654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d5013e570 msgr2=0x7f3d50141580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.504+0000 7f3d57607640 1 --2- 172.21.15.1:0/637442654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d5013e570 0x7f3d50141580 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800d590 tx=0x7f3d4800da50 comp rx=0 tx=0).stop 2024-09-15T21:56:20.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.504+0000 7f3d55ba4640 1 -- 172.21.15.1:0/637442654 reap_dead start 2024-09-15T21:56:20.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.504+0000 7f3d57607640 1 -- 172.21.15.1:0/637442654 shutdown_connections 2024-09-15T21:56:20.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.504+0000 7f3d57607640 1 -- 172.21.15.1:0/637442654 >> 172.21.15.1:0/637442654 conn(0x7f3d5006c730 msgr2=0x7f3d500b6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:20.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.504+0000 7f3d57607640 1 -- 172.21.15.1:0/637442654 shutdown_connections 2024-09-15T21:56:20.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.504+0000 7f3d57607640 1 -- 172.21.15.1:0/637442654 wait complete. 2024-09-15T21:56:20.524 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-15T21:56:20.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.636+0000 7f4eb53ca640 1 Processor -- start 2024-09-15T21:56:20.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.636+0000 7f4eb53ca640 1 -- start start 2024-09-15T21:56:20.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.636+0000 7f4eb53ca640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4eb0067c60 0x7f4eb0073080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.636+0000 7f4eb53ca640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb0068040 con 0x7f4eb00b5f70 2024-09-15T21:56:20.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.636+0000 7f4eb53ca640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb0072510 con 0x7f4eb0150170 2024-09-15T21:56:20.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.636+0000 7f4eb53ca640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f4eb0071180 con 0x7f4eb0067c60 2024-09-15T21:56:20.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.636+0000 7f4eaeffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4eb0067c60 0x7f4eb0073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.636+0000 7f4eae7fc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4eb00b5f70 0x7f4eb01418b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58304/0 (socket says 172.21.15.1:58304) 2024-09-15T21:56:20.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.636+0000 7f4eae7fc640 1 -- 172.21.15.1:0/489333677 learned_addr learned my addr 172.21.15.1:0/489333677 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:20.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.636+0000 7f4eaeffd640 1 -- 172.21.15.1:0/489333677 >> v1:172.21.15.70:6789/0 conn(0x7f4eb0150170 legacy=0x7f4eb0152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.636+0000 7f4eaeffd640 1 -- 172.21.15.1:0/489333677 >> v1:172.21.15.1:6789/0 conn(0x7f4eb00b5f70 legacy=0x7f4eb01418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.636+0000 7f4eaeffd640 1 -- 172.21.15.1:0/489333677 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb0071460 con 0x7f4eb0067c60 2024-09-15T21:56:20.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.640+0000 7f4eaeffd640 1 --2- 172.21.15.1:0/489333677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb0067c60 0x7f4eb0073080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009d90 tx=0x7f4ea801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1075547ecc54197 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.640+0000 7f4eadffb640 1 -- 172.21.15.1:0/489333677 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea80b2070 con 0x7f4eb0067c60 2024-09-15T21:56:20.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.640+0000 7f4eadffb640 1 -- 172.21.15.1:0/489333677 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea80a5960 con 0x7f4eb0067c60 2024-09-15T21:56:20.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.640+0000 7f4eadffb640 1 -- 172.21.15.1:0/489333677 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea80a5d30 con 0x7f4eb0067c60 2024-09-15T21:56:20.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.640+0000 7f4eb53ca640 1 -- 172.21.15.1:0/489333677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb0067c60 msgr2=0x7f4eb0073080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.640+0000 7f4eb53ca640 1 --2- 172.21.15.1:0/489333677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb0067c60 0x7f4eb0073080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009d90 tx=0x7f4ea801c8e0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.640+0000 7f4eb53ca640 1 -- 172.21.15.1:0/489333677 shutdown_connections 2024-09-15T21:56:20.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.640+0000 7f4eb53ca640 1 --2- 172.21.15.1:0/489333677 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb0067c60 0x7f4eb0073080 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.640+0000 7f4eb53ca640 1 -- 172.21.15.1:0/489333677 >> 172.21.15.1:0/489333677 conn(0x7f4eb00b63a0 msgr2=0x7f4eb00b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:20.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.640+0000 7f4eb53ca640 1 -- 172.21.15.1:0/489333677 shutdown_connections 2024-09-15T21:56:20.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.640+0000 7f4eb53ca640 1 -- 172.21.15.1:0/489333677 wait complete. 2024-09-15T21:56:20.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.640+0000 7f4eb53ca640 1 Processor -- start 2024-09-15T21:56:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.640+0000 7f4eb53ca640 1 -- start start 2024-09-15T21:56:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eb53ca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4eb0067c60 0x7f4eb00b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eb53ca640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4eb00b5f70 0x7f4eb013db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eb53ca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb0150170 0x7f4eb013e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eb53ca640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb01478c0 con 0x7f4eb0150170 2024-09-15T21:56:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eb53ca640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb0070da0 con 0x7f4eb0067c60 2024-09-15T21:56:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eb53ca640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb0152f20 con 0x7f4eb00b5f70 2024-09-15T21:56:20.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eaf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb0150170 0x7f4eb013e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eaf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb0150170 0x7f4eb013e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38868/0 (socket says 172.21.15.1:38868) 2024-09-15T21:56:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eaf7fe640 1 -- 172.21.15.1:0/293847471 learned_addr learned my addr 172.21.15.1:0/293847471 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eaeffd640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4eb0067c60 0x7f4eb00b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eae7fc640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4eb00b5f70 0x7f4eb013db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eaf7fe640 1 -- 172.21.15.1:0/293847471 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4eb00b5f70 msgr2=0x7f4eb013db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eaf7fe640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4eb00b5f70 0x7f4eb013db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eaf7fe640 1 -- 172.21.15.1:0/293847471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4eb0067c60 msgr2=0x7f4eb00b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eaf7fe640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4eb0067c60 0x7f4eb00b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eaf7fe640 1 -- 172.21.15.1:0/293847471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb01449c0 con 0x7f4eb0150170 2024-09-15T21:56:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eae7fc640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4eb00b5f70 0x7f4eb013db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eaf7fe640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb0150170 0x7f4eb013e040 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c400 tx=0x7f4ea000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4ea77fe640 1 -- 172.21.15.1:0/293847471 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0017070 con 0x7f4eb0150170 2024-09-15T21:56:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4ea77fe640 1 -- 172.21.15.1:0/293847471 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea00052d0 con 0x7f4eb0150170 2024-09-15T21:56:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eb53ca640 1 -- 172.21.15.1:0/293847471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb00b29e0 con 0x7f4eb0150170 2024-09-15T21:56:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4ea77fe640 1 -- 172.21.15.1:0/293847471 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0003800 con 0x7f4eb0150170 2024-09-15T21:56:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eb53ca640 1 -- 172.21.15.1:0/293847471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb0143440 con 0x7f4eb0150170 2024-09-15T21:56:20.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eb53ca640 1 -- 172.21.15.1:0/293847471 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb00736e0 con 0x7f4eb0150170 2024-09-15T21:56:20.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4ea77fe640 1 -- 172.21.15.1:0/293847471 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ea001a070 con 0x7f4eb0150170 2024-09-15T21:56:20.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4ea77fe640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4e900678c0 0x7f4e90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eaeffd640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4e900678c0 0x7f4e90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4ea77fe640 1 -- 172.21.15.1:0/293847471 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f4ea0084b40 con 0x7f4eb0150170 2024-09-15T21:56:20.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.644+0000 7f4eaeffd640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4e900678c0 0x7f4e90069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80af000 tx=0x7f4ea80a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.648+0000 7f4ea77fe640 1 -- 172.21.15.1:0/293847471 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4ea0005480 con 0x7f4eb0150170 2024-09-15T21:56:20.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.812+0000 7f4eb53ca640 1 -- 172.21.15.1:0/293847471 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f4eb01446e0 con 0x7f4e900678c0 2024-09-15T21:56:20.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.812+0000 7f4ea77fe640 1 -- 172.21.15.1:0/293847471 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4eb01446e0 con 0x7f4e900678c0 2024-09-15T21:56:20.820 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 2 to deep-scrub 2024-09-15T21:56:20.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.816+0000 7f4eb53ca640 1 -- 172.21.15.1:0/293847471 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4e900678c0 msgr2=0x7f4e90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.816+0000 7f4eb53ca640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4e900678c0 0x7f4e90069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80af000 tx=0x7f4ea80a7070 comp rx=0 tx=0).stop 2024-09-15T21:56:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.816+0000 7f4eb53ca640 1 -- 172.21.15.1:0/293847471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb0150170 msgr2=0x7f4eb013e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.816+0000 7f4eb53ca640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb0150170 0x7f4eb013e040 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c400 tx=0x7f4ea000c8c0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.816+0000 7f4eb53ca640 1 -- 172.21.15.1:0/293847471 shutdown_connections 2024-09-15T21:56:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.816+0000 7f4eb53ca640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4eb0150170 0x7f4eb013e040 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.816+0000 7f4eb53ca640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4eb00b5f70 0x7f4eb013db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.816+0000 7f4eb53ca640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f4e900678c0 0x7f4e90069d80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.816+0000 7f4eb53ca640 1 --2- 172.21.15.1:0/293847471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4eb0067c60 0x7f4eb00b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.816+0000 7f4eb53ca640 1 -- 172.21.15.1:0/293847471 >> 172.21.15.1:0/293847471 conn(0x7f4eb00b63a0 msgr2=0x7f4eb0146940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:20.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.816+0000 7f4eb53ca640 1 -- 172.21.15.1:0/293847471 shutdown_connections 2024-09-15T21:56:20.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.816+0000 7f4eb53ca640 1 -- 172.21.15.1:0/293847471 wait complete. 2024-09-15T21:56:20.838 INFO:tasks.ceph:Scrubbing osd.3 2024-09-15T21:56:20.839 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-15T21:56:20.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e97da640 1 Processor -- start 2024-09-15T21:56:20.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e97da640 1 -- start start 2024-09-15T21:56:20.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e97da640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f16e406f420 0x7f16e40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e97da640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f16e406f800 0x7f16e4148f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e97da640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f16e406fef0 0x7f16e4072660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e97da640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f16e40b7130 con 0x7f16e406fef0 2024-09-15T21:56:20.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e97da640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f16e40b7a00 con 0x7f16e406f420 2024-09-15T21:56:20.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e97da640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f16e40b68b0 con 0x7f16e406f800 2024-09-15T21:56:20.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e37fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f16e406fef0 0x7f16e4072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e37fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f16e406fef0 0x7f16e4072660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38874/0 (socket says 172.21.15.1:38874) 2024-09-15T21:56:20.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e37fe640 1 -- 172.21.15.1:0/1195045450 learned_addr learned my addr 172.21.15.1:0/1195045450 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:20.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e27fc640 1 --2- 172.21.15.1:0/1195045450 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f16e406f800 0x7f16e4148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e2ffd640 1 --2- 172.21.15.1:0/1195045450 >> v2:172.21.15.70:3300/0 conn(0x7f16e406f420 0x7f16e40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e37fe640 1 -- 172.21.15.1:0/1195045450 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f16e406f800 msgr2=0x7f16e4148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:20.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e37fe640 1 --2- 172.21.15.1:0/1195045450 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f16e406f800 0x7f16e4148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e37fe640 1 -- 172.21.15.1:0/1195045450 >> v2:172.21.15.70:3300/0 conn(0x7f16e406f420 msgr2=0x7f16e40b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:20.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e37fe640 1 --2- 172.21.15.1:0/1195045450 >> v2:172.21.15.70:3300/0 conn(0x7f16e406f420 0x7f16e40b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.968+0000 7f16e37fe640 1 -- 172.21.15.1:0/1195045450 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e40b65d0 con 0x7f16e406fef0 2024-09-15T21:56:20.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e37fe640 1 --2- 172.21.15.1:0/1195045450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16e406fef0 0x7f16e4072660 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f16e406fe10 tx=0x7f16d401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b94977362bf95 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e1ffb640 1 -- 172.21.15.1:0/1195045450 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d40b2070 con 0x7f16e406fef0 2024-09-15T21:56:20.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e1ffb640 1 -- 172.21.15.1:0/1195045450 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d40a9070 con 0x7f16e406fef0 2024-09-15T21:56:20.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e1ffb640 1 -- 172.21.15.1:0/1195045450 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d40ad880 con 0x7f16e406fef0 2024-09-15T21:56:20.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 -- 172.21.15.1:0/1195045450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16e406fef0 msgr2=0x7f16e4072660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 --2- 172.21.15.1:0/1195045450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16e406fef0 0x7f16e4072660 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f16e406fe10 tx=0x7f16d401c490 comp rx=0 tx=0).stop 2024-09-15T21:56:20.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 -- 172.21.15.1:0/1195045450 shutdown_connections 2024-09-15T21:56:20.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 --2- 172.21.15.1:0/1195045450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16e406fef0 0x7f16e4072660 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 --2- 172.21.15.1:0/1195045450 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f16e406f800 0x7f16e4148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 --2- 172.21.15.1:0/1195045450 >> v2:172.21.15.70:3300/0 conn(0x7f16e406f420 0x7f16e40b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 -- 172.21.15.1:0/1195045450 >> 172.21.15.1:0/1195045450 conn(0x7f16e40bb4e0 msgr2=0x7f16e40bb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:20.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 -- 172.21.15.1:0/1195045450 shutdown_connections 2024-09-15T21:56:20.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 -- 172.21.15.1:0/1195045450 wait complete. 2024-09-15T21:56:20.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 Processor -- start 2024-09-15T21:56:20.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 -- start start 2024-09-15T21:56:20.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f16e406f420 0x7f16e41e40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16e406f800 0x7f16e406d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e406fef0 0x7f16e406df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f16e4152270 con 0x7f16e406f800 2024-09-15T21:56:20.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f16e41523f0 con 0x7f16e406fef0 2024-09-15T21:56:20.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e97da640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f16e4152570 con 0x7f16e406f420 2024-09-15T21:56:20.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16e406f800 0x7f16e406d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16e406f800 0x7f16e406d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38890/0 (socket says 172.21.15.1:38890) 2024-09-15T21:56:20.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e27fc640 1 -- 172.21.15.1:0/3664646401 learned_addr learned my addr 172.21.15.1:0/3664646401 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:20.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e37fe640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e406fef0 0x7f16e406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e27fc640 1 -- 172.21.15.1:0/3664646401 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f16e406f420 msgr2=0x7f16e41e40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e27fc640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f16e406f420 0x7f16e41e40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e27fc640 1 -- 172.21.15.1:0/3664646401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e406fef0 msgr2=0x7f16e406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.972+0000 7f16e27fc640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e406fef0 0x7f16e406df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16e27fc640 1 -- 172.21.15.1:0/3664646401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e40b3c60 con 0x7f16e406f800 2024-09-15T21:56:20.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16e37fe640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e406fef0 0x7f16e406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:20.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16e27fc640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16e406f800 0x7f16e406d9d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f16d800d800 tx=0x7f16d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16cb7fe640 1 -- 172.21.15.1:0/3664646401 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d800b6c0 con 0x7f16e406f800 2024-09-15T21:56:20.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16cb7fe640 1 -- 172.21.15.1:0/3664646401 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d8019070 con 0x7f16e406f800 2024-09-15T21:56:20.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16e97da640 1 -- 172.21.15.1:0/3664646401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e41e4780 con 0x7f16e406f800 2024-09-15T21:56:20.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16cb7fe640 1 -- 172.21.15.1:0/3664646401 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d800ba60 con 0x7f16e406f800 2024-09-15T21:56:20.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16e97da640 1 -- 172.21.15.1:0/3664646401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e4142000 con 0x7f16e406f800 2024-09-15T21:56:20.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16e97da640 1 -- 172.21.15.1:0/3664646401 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f16e4148f30 con 0x7f16e406f800 2024-09-15T21:56:20.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16cb7fe640 1 -- 172.21.15.1:0/3664646401 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f16d800bc00 con 0x7f16e406f800 2024-09-15T21:56:20.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16cb7fe640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f16d00678c0 0x7f16d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16cb7fe640 1 -- 172.21.15.1:0/3664646401 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f16d8086790 con 0x7f16e406f800 2024-09-15T21:56:20.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16e2ffd640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f16d00678c0 0x7f16d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16cb7fe640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] conn(0x7f16d006d780 0x7f16d006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:20.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16cb7fe640 1 -- 172.21.15.1:0/3664646401 --> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16d8001d40 con 0x7f16d006d780 2024-09-15T21:56:20.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16cb7fe640 1 -- 172.21.15.1:0/3664646401 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f16d8086c20 con 0x7f16e406f800 2024-09-15T21:56:20.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16e37fe640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] conn(0x7f16d006d780 0x7f16d006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:20.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16e2ffd640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f16d00678c0 0x7f16d0069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0070b0 tx=0x7f16dc007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16e37fe640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] conn(0x7f16d006d780 0x7f16d006fba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:20.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.976+0000 7f16cb7fe640 1 -- 172.21.15.1:0/3664646401 <== osd.3 v2:172.21.15.1:6810/4171924987 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f16d8001d40 con 0x7f16d006d780 2024-09-15T21:56:20.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.992+0000 7f16e97da640 1 -- 172.21.15.1:0/3664646401 --> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f16e409e8d0 con 0x7f16d006d780 2024-09-15T21:56:20.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.992+0000 7f16cb7fe640 1 -- 172.21.15.1:0/3664646401 <== osd.3 v2:172.21.15.1:6810/4171924987 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f16e409e8d0 con 0x7f16d006d780 2024-09-15T21:56:20.998 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T21:56:20.998 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T21:56:20.998 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T21:56:20.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.992+0000 7f16e97da640 1 -- 172.21.15.1:0/3664646401 >> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] conn(0x7f16d006d780 msgr2=0x7f16d006fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.992+0000 7f16e97da640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.1:6810/4171924987,v1:172.21.15.1:6811/4171924987] conn(0x7f16d006d780 0x7f16d006fba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:20.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.992+0000 7f16e97da640 1 -- 172.21.15.1:0/3664646401 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f16d00678c0 msgr2=0x7f16d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:20.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.992+0000 7f16e97da640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f16d00678c0 0x7f16d0069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0070b0 tx=0x7f16dc007040 comp rx=0 tx=0).stop 2024-09-15T21:56:21.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.992+0000 7f16e97da640 1 -- 172.21.15.1:0/3664646401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16e406f800 msgr2=0x7f16e406d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.992+0000 7f16e97da640 1 --2- 172.21.15.1:0/3664646401 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16e406f800 0x7f16e406d9d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f16d800d800 tx=0x7f16d800dcc0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.992+0000 7f16e37fe640 1 -- 172.21.15.1:0/3664646401 reap_dead start 2024-09-15T21:56:21.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.992+0000 7f16e97da640 1 -- 172.21.15.1:0/3664646401 shutdown_connections 2024-09-15T21:56:21.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.992+0000 7f16e97da640 1 -- 172.21.15.1:0/3664646401 >> 172.21.15.1:0/3664646401 conn(0x7f16e40bb4e0 msgr2=0x7f16e409edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:21.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.992+0000 7f16e97da640 1 -- 172.21.15.1:0/3664646401 shutdown_connections 2024-09-15T21:56:21.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:20.992+0000 7f16e97da640 1 -- 172.21.15.1:0/3664646401 wait complete. 2024-09-15T21:56:21.013 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-15T21:56:21.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29fdbb640 1 Processor -- start 2024-09-15T21:56:21.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29fdbb640 1 -- start start 2024-09-15T21:56:21.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29fdbb640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb2980ae0f0 0x7fb2980afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29fdbb640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2980ae500 con 0x7fb2980b5560 2024-09-15T21:56:21.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29fdbb640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb29813ec80 con 0x7fb29806d0d0 2024-09-15T21:56:21.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29fdbb640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fb2980b0300 con 0x7fb2980ae0f0 2024-09-15T21:56:21.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29db57640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb2980b5560 0x7fb29813e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58312/0 (socket says 172.21.15.1:58312) 2024-09-15T21:56:21.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29db57640 1 -- 172.21.15.1:0/93879429 learned_addr learned my addr 172.21.15.1:0/93879429 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:21.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29e358640 1 --2- 172.21.15.1:0/93879429 >> v2:172.21.15.70:3300/0 conn(0x7fb2980ae0f0 0x7fb2980afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3947757378 0 0) 0x7fb2980ae500 con 0x7fb2980b5560 2024-09-15T21:56:21.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb284003530 con 0x7fb2980b5560 2024-09-15T21:56:21.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3633317618 0 0) 0x7fb284003530 con 0x7fb2980b5560 2024-09-15T21:56:21.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 >> v2:172.21.15.70:3300/0 conn(0x7fb2980ae0f0 msgr2=0x7fb2980afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:21.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 --2- 172.21.15.1:0/93879429 >> v2:172.21.15.70:3300/0 conn(0x7fb2980ae0f0 0x7fb2980afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 >> v1:172.21.15.70:6789/0 conn(0x7fb29806d0d0 legacy=0x7fb29814cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2980b5940 con 0x7fb2980b5560 2024-09-15T21:56:21.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7fb2940016a0 con 0x7fb2980b5560 2024-09-15T21:56:21.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 >> v1:172.21.15.1:6789/0 conn(0x7fb2980b5560 legacy=0x7fb29813e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 --2- 172.21.15.1:0/93879429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2840039c0 0x7fb284003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 --2- 172.21.15.1:0/93879429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb284004810 0x7fb284004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 --2- 172.21.15.1:0/93879429 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb2840051d0 0x7fb28400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb2980b0300 con 0x7fb2840039c0 2024-09-15T21:56:21.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb28400c170 con 0x7fb284004810 2024-09-15T21:56:21.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb28400c370 con 0x7fb2840051d0 2024-09-15T21:56:21.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29db57640 1 --2- 172.21.15.1:0/93879429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2840039c0 0x7fb284003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29d356640 1 --2- 172.21.15.1:0/93879429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb284004810 0x7fb284004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29e358640 1 --2- 172.21.15.1:0/93879429 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb2840051d0 0x7fb28400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29db57640 1 -- 172.21.15.1:0/93879429 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb2840051d0 msgr2=0x7fb28400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:21.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29db57640 1 --2- 172.21.15.1:0/93879429 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb2840051d0 0x7fb28400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29db57640 1 -- 172.21.15.1:0/93879429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb284004810 msgr2=0x7fb284004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:21.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29db57640 1 --2- 172.21.15.1:0/93879429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb284004810 0x7fb284004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29db57640 1 -- 172.21.15.1:0/93879429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb284003530 con 0x7fb2840039c0 2024-09-15T21:56:21.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29e358640 1 --2- 172.21.15.1:0/93879429 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb2840051d0 0x7fb28400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:21.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.124+0000 7fb29e358640 1 -- 172.21.15.1:0/93879429 reap_dead start 2024-09-15T21:56:21.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29db57640 1 --2- 172.21.15.1:0/93879429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2840039c0 0x7fb284003de0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb29400c290 tx=0x7fb29401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261dce7ec5491676 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb294007d60 con 0x7fb2840039c0 2024-09-15T21:56:21.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2940a9070 con 0x7fb2840039c0 2024-09-15T21:56:21.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29cb55640 1 -- 172.21.15.1:0/93879429 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb294005d40 con 0x7fb2840039c0 2024-09-15T21:56:21.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 -- 172.21.15.1:0/93879429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2840039c0 msgr2=0x7fb284003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 --2- 172.21.15.1:0/93879429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2840039c0 0x7fb284003de0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb29400c290 tx=0x7fb29401cc40 comp rx=0 tx=0).stop 2024-09-15T21:56:21.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 -- 172.21.15.1:0/93879429 shutdown_connections 2024-09-15T21:56:21.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 --2- 172.21.15.1:0/93879429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2840039c0 0x7fb284003de0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 -- 172.21.15.1:0/93879429 >> 172.21.15.1:0/93879429 conn(0x7fb29806c730 msgr2=0x7fb2980b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:21.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 -- 172.21.15.1:0/93879429 shutdown_connections 2024-09-15T21:56:21.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 -- 172.21.15.1:0/93879429 wait complete. 2024-09-15T21:56:21.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 Processor -- start 2024-09-15T21:56:21.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 -- start start 2024-09-15T21:56:21.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2840039c0 0x7fb298146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb2980b1e00 0x7fb2980b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2980b2260 0x7fb2980b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb29813e980 con 0x7fb2980b2260 2024-09-15T21:56:21.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb29806e220 con 0x7fb2840039c0 2024-09-15T21:56:21.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29fdbb640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb29813eb00 con 0x7fb2980b1e00 2024-09-15T21:56:21.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29e358640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2980b2260 0x7fb2980b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29e358640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2980b2260 0x7fb2980b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38922/0 (socket says 172.21.15.1:38922) 2024-09-15T21:56:21.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29e358640 1 -- 172.21.15.1:0/947953881 learned_addr learned my addr 172.21.15.1:0/947953881 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:21.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.128+0000 7fb29db57640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2840039c0 0x7fb298146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb29d356640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb2980b1e00 0x7fb2980b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb29e358640 1 -- 172.21.15.1:0/947953881 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb2980b1e00 msgr2=0x7fb2980b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb29e358640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb2980b1e00 0x7fb2980b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb29e358640 1 -- 172.21.15.1:0/947953881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2840039c0 msgr2=0x7fb298146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb29e358640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2840039c0 0x7fb298146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb29e358640 1 -- 172.21.15.1:0/947953881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2981484b0 con 0x7fb2980b2260 2024-09-15T21:56:21.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb29e358640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2980b2260 0x7fb2980b12c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb2980702a0 tx=0x7fb29000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb28e7fc640 1 -- 172.21.15.1:0/947953881 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb290016620 con 0x7fb2980b2260 2024-09-15T21:56:21.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb28e7fc640 1 -- 172.21.15.1:0/947953881 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29001b070 con 0x7fb2980b2260 2024-09-15T21:56:21.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb29fdbb640 1 -- 172.21.15.1:0/947953881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2981481d0 con 0x7fb2980b2260 2024-09-15T21:56:21.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb28e7fc640 1 -- 172.21.15.1:0/947953881 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2900169e0 con 0x7fb2980b2260 2024-09-15T21:56:21.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb29fdbb640 1 -- 172.21.15.1:0/947953881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb29813b980 con 0x7fb2980b2260 2024-09-15T21:56:21.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb29fdbb640 1 -- 172.21.15.1:0/947953881 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2980b42e0 con 0x7fb2980b2260 2024-09-15T21:56:21.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb28e7fc640 1 -- 172.21.15.1:0/947953881 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb290016b80 con 0x7fb2980b2260 2024-09-15T21:56:21.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb28e7fc640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb27c0678f0 0x7fb27c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb28e7fc640 1 -- 172.21.15.1:0/947953881 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7fb2900865a0 con 0x7fb2980b2260 2024-09-15T21:56:21.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb29db57640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb27c0678f0 0x7fb27c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.132+0000 7fb29db57640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb27c0678f0 0x7fb27c069db0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb2940ab000 tx=0x7fb2940a7070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.136+0000 7fb28e7fc640 1 -- 172.21.15.1:0/947953881 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb2981484b0 con 0x7fb2980b2260 2024-09-15T21:56:21.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.296+0000 7fb29fdbb640 1 -- 172.21.15.1:0/947953881 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb2980b9f20 con 0x7fb27c0678f0 2024-09-15T21:56:21.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.296+0000 7fb28e7fc640 1 -- 172.21.15.1:0/947953881 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb2980b9f20 con 0x7fb27c0678f0 2024-09-15T21:56:21.304 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 3 to deep-scrub 2024-09-15T21:56:21.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.300+0000 7fb29fdbb640 1 -- 172.21.15.1:0/947953881 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb27c0678f0 msgr2=0x7fb27c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.300+0000 7fb29fdbb640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb27c0678f0 0x7fb27c069db0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb2940ab000 tx=0x7fb2940a7070 comp rx=0 tx=0).stop 2024-09-15T21:56:21.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.300+0000 7fb29fdbb640 1 -- 172.21.15.1:0/947953881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2980b2260 msgr2=0x7fb2980b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.300+0000 7fb29fdbb640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2980b2260 0x7fb2980b12c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb2980702a0 tx=0x7fb29000f520 comp rx=0 tx=0).stop 2024-09-15T21:56:21.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.300+0000 7fb29fdbb640 1 -- 172.21.15.1:0/947953881 shutdown_connections 2024-09-15T21:56:21.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.300+0000 7fb29fdbb640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2980b2260 0x7fb2980b12c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.300+0000 7fb29fdbb640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb2980b1e00 0x7fb2980b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.300+0000 7fb29fdbb640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb27c0678f0 0x7fb27c069db0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.300+0000 7fb29fdbb640 1 --2- 172.21.15.1:0/947953881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2840039c0 0x7fb298146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.300+0000 7fb29fdbb640 1 -- 172.21.15.1:0/947953881 >> 172.21.15.1:0/947953881 conn(0x7fb29806c730 msgr2=0x7fb2981377e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:21.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.300+0000 7fb29fdbb640 1 -- 172.21.15.1:0/947953881 shutdown_connections 2024-09-15T21:56:21.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.300+0000 7fb29fdbb640 1 -- 172.21.15.1:0/947953881 wait complete. 2024-09-15T21:56:21.321 INFO:tasks.ceph:Scrubbing osd.4 2024-09-15T21:56:21.321 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-15T21:56:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.444+0000 7f1eaed8f640 1 Processor -- start 2024-09-15T21:56:21.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.444+0000 7f1eaed8f640 1 -- start start 2024-09-15T21:56:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1eaed8f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1ea80af540 0x7f1ea806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1eaed8f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ea80b0f10 0x7f1ea814af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1eaed8f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1ea814b440 0x7f1ea814b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1eaed8f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f1ea806f760 con 0x7f1ea814b440 2024-09-15T21:56:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1eaed8f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f1ea80af920 con 0x7f1ea80af540 2024-09-15T21:56:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1eaed8f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea80b6ba0 con 0x7f1ea80b0f10 2024-09-15T21:56:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1ead32c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1ea814b440 0x7f1ea814b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1ead32c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1ea814b440 0x7f1ea814b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38926/0 (socket says 172.21.15.1:38926) 2024-09-15T21:56:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1ead32c640 1 -- 172.21.15.1:0/2650306777 learned_addr learned my addr 172.21.15.1:0/2650306777 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1ea7fff640 1 --2- 172.21.15.1:0/2650306777 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ea80b0f10 0x7f1ea814af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1eacb2b640 1 --2- 172.21.15.1:0/2650306777 >> v2:172.21.15.70:3300/0 conn(0x7f1ea80af540 0x7f1ea806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1ead32c640 1 -- 172.21.15.1:0/2650306777 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ea80b0f10 msgr2=0x7f1ea814af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1ead32c640 1 --2- 172.21.15.1:0/2650306777 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ea80b0f10 0x7f1ea814af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1ead32c640 1 -- 172.21.15.1:0/2650306777 >> v2:172.21.15.70:3300/0 conn(0x7f1ea80af540 msgr2=0x7f1ea806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1ead32c640 1 --2- 172.21.15.1:0/2650306777 >> v2:172.21.15.70:3300/0 conn(0x7f1ea80af540 0x7f1ea806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1ead32c640 1 -- 172.21.15.1:0/2650306777 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea80b65e0 con 0x7f1ea814b440 2024-09-15T21:56:21.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1ead32c640 1 --2- 172.21.15.1:0/2650306777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea814b440 0x7f1ea814b8d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80b7d20 tx=0x7f1ea001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14aa969f448f9b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1ea77fe640 1 -- 172.21.15.1:0/2650306777 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea00a5670 con 0x7f1ea814b440 2024-09-15T21:56:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1ea77fe640 1 -- 172.21.15.1:0/2650306777 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea00a5810 con 0x7f1ea814b440 2024-09-15T21:56:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.448+0000 7f1ea77fe640 1 -- 172.21.15.1:0/2650306777 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea00a5be0 con 0x7f1ea814b440 2024-09-15T21:56:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2650306777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea814b440 msgr2=0x7f1ea814b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 --2- 172.21.15.1:0/2650306777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea814b440 0x7f1ea814b8d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80b7d20 tx=0x7f1ea001c9f0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2650306777 shutdown_connections 2024-09-15T21:56:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 --2- 172.21.15.1:0/2650306777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea814b440 0x7f1ea814b8d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 --2- 172.21.15.1:0/2650306777 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ea80b0f10 0x7f1ea814af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 --2- 172.21.15.1:0/2650306777 >> v2:172.21.15.70:3300/0 conn(0x7f1ea80af540 0x7f1ea806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2650306777 >> 172.21.15.1:0/2650306777 conn(0x7f1ea80b6dc0 msgr2=0x7f1ea80b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2650306777 shutdown_connections 2024-09-15T21:56:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2650306777 wait complete. 2024-09-15T21:56:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 Processor -- start 2024-09-15T21:56:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 -- start start 2024-09-15T21:56:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ea80af540 0x7f1ea8072560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea80b0f10 0x7f1ea81e0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ea814b440 0x7f1ea81e0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea81481a0 con 0x7f1ea80b0f10 2024-09-15T21:56:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea8148320 con 0x7f1ea814b440 2024-09-15T21:56:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea81484a0 con 0x7f1ea80af540 2024-09-15T21:56:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1ea7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea80b0f10 0x7f1ea81e0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1ea7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea80b0f10 0x7f1ea81e0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38932/0 (socket says 172.21.15.1:38932) 2024-09-15T21:56:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1ea7fff640 1 -- 172.21.15.1:0/2464601198 learned_addr learned my addr 172.21.15.1:0/2464601198 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:21.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1ead32c640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ea814b440 0x7f1ea81e0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eacb2b640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ea80af540 0x7f1ea8072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1ea7fff640 1 -- 172.21.15.1:0/2464601198 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ea80af540 msgr2=0x7f1ea8072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1ea7fff640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ea80af540 0x7f1ea8072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1ea7fff640 1 -- 172.21.15.1:0/2464601198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ea814b440 msgr2=0x7f1ea81e0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1ea7fff640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ea814b440 0x7f1ea81e0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1ea7fff640 1 -- 172.21.15.1:0/2464601198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea80b27e0 con 0x7f1ea80b0f10 2024-09-15T21:56:21.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eacb2b640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ea80af540 0x7f1ea8072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:21.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1ea7fff640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea80b0f10 0x7f1ea81e0130 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c820 tx=0x7f1e9800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1ea57fa640 1 -- 172.21.15.1:0/2464601198 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98004230 con 0x7f1ea80b0f10 2024-09-15T21:56:21.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1ea57fa640 1 -- 172.21.15.1:0/2464601198 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e980043d0 con 0x7f1ea80b0f10 2024-09-15T21:56:21.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2464601198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea809ee40 con 0x7f1ea80b0f10 2024-09-15T21:56:21.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1ea57fa640 1 -- 172.21.15.1:0/2464601198 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98007a70 con 0x7f1ea80b0f10 2024-09-15T21:56:21.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2464601198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea80b2a50 con 0x7f1ea80b0f10 2024-09-15T21:56:21.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.452+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2464601198 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ea809f040 con 0x7f1ea80b0f10 2024-09-15T21:56:21.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.456+0000 7f1ea57fa640 1 -- 172.21.15.1:0/2464601198 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e98007c10 con 0x7f1ea80b0f10 2024-09-15T21:56:21.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.456+0000 7f1ea57fa640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1e880678f0 0x7f1e88069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.456+0000 7f1ea57fa640 1 -- 172.21.15.1:0/2464601198 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f1e98085e60 con 0x7f1ea80b0f10 2024-09-15T21:56:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.456+0000 7f1eacb2b640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1e880678f0 0x7f1e88069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.456+0000 7f1ea57fa640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] conn(0x7f1e8806d7b0 0x7f1e8806fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.456+0000 7f1ea57fa640 1 -- 172.21.15.1:0/2464601198 --> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e88070280 con 0x7f1e8806d7b0 2024-09-15T21:56:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.456+0000 7f1ea57fa640 1 -- 172.21.15.1:0/2464601198 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1e98086210 con 0x7f1ea80b0f10 2024-09-15T21:56:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.456+0000 7f1ead32c640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] conn(0x7f1e8806d7b0 0x7f1e8806fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.456+0000 7f1eacb2b640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1e880678f0 0x7f1e88069db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009840 tx=0x7f1e90008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.456+0000 7f1ead32c640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] conn(0x7f1e8806d7b0 0x7f1e8806fbd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.456+0000 7f1ea57fa640 1 -- 172.21.15.1:0/2464601198 <== osd.4 v2:172.21.15.70:6816/3705222670 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1e88070280 con 0x7f1e8806d7b0 2024-09-15T21:56:21.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.472+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2464601198 --> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1ea814af00 con 0x7f1e8806d7b0 2024-09-15T21:56:21.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.472+0000 7f1ea57fa640 1 -- 172.21.15.1:0/2464601198 <== osd.4 v2:172.21.15.70:6816/3705222670 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1ea814af00 con 0x7f1e8806d7b0 2024-09-15T21:56:21.477 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T21:56:21.477 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T21:56:21.478 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T21:56:21.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.472+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2464601198 >> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] conn(0x7f1e8806d7b0 msgr2=0x7f1e8806fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.472+0000 7f1eaed8f640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.70:6816/3705222670,v1:172.21.15.70:6817/3705222670] conn(0x7f1e8806d7b0 0x7f1e8806fbd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.472+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2464601198 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1e880678f0 msgr2=0x7f1e88069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.472+0000 7f1eaed8f640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f1e880678f0 0x7f1e88069db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009840 tx=0x7f1e90008040 comp rx=0 tx=0).stop 2024-09-15T21:56:21.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.472+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2464601198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea80b0f10 msgr2=0x7f1ea81e0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.472+0000 7f1eaed8f640 1 --2- 172.21.15.1:0/2464601198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1ea80b0f10 0x7f1ea81e0130 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c820 tx=0x7f1e9800cce0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.472+0000 7f1ead32c640 1 -- 172.21.15.1:0/2464601198 reap_dead start 2024-09-15T21:56:21.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.472+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2464601198 shutdown_connections 2024-09-15T21:56:21.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.472+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2464601198 >> 172.21.15.1:0/2464601198 conn(0x7f1ea80b6dc0 msgr2=0x7f1ea80b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:21.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.472+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2464601198 shutdown_connections 2024-09-15T21:56:21.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.472+0000 7f1eaed8f640 1 -- 172.21.15.1:0/2464601198 wait complete. 2024-09-15T21:56:21.493 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-15T21:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68bdd4f640 1 Processor -- start 2024-09-15T21:56:21.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68bdd4f640 1 -- start start 2024-09-15T21:56:21.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68bdd4f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f68b80b4560 0x7f68b80b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68bdd4f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f68b8149450 0x7f68b809dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68bdd4f640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b806d5b0 con 0x7f68b806d0d0 2024-09-15T21:56:21.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68bdd4f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f68b806dc00 con 0x7f68b8149450 2024-09-15T21:56:21.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68bdd4f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f68b806d890 con 0x7f68b80b4560 2024-09-15T21:56:21.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68b7fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f68b8149450 0x7f68b809dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68b6ffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f68b806d0d0 0x7f68b8148d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58328/0 (socket says 172.21.15.1:58328) 2024-09-15T21:56:21.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68b6ffd640 1 -- 172.21.15.1:0/4056937561 learned_addr learned my addr 172.21.15.1:0/4056937561 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:21.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68b7fff640 1 -- 172.21.15.1:0/4056937561 >> v2:172.21.15.70:3300/0 conn(0x7f68b80b4560 msgr2=0x7f68b80b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:21.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68b7fff640 1 --2- 172.21.15.1:0/4056937561 >> v2:172.21.15.70:3300/0 conn(0x7f68b80b4560 0x7f68b80b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68b7fff640 1 -- 172.21.15.1:0/4056937561 >> v1:172.21.15.1:6789/0 conn(0x7f68b806d0d0 legacy=0x7f68b8148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68b67fc640 1 -- 172.21.15.1:0/4056937561 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1502492285 0 0) 0x7f68b806d5b0 con 0x7f68b806d0d0 2024-09-15T21:56:21.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.604+0000 7f68b7fff640 1 -- 172.21.15.1:0/4056937561 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b80b3ad0 con 0x7f68b8149450 2024-09-15T21:56:21.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68b7fff640 1 --2- 172.21.15.1:0/4056937561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b8149450 0x7f68b809dca0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f68b80b03d0 tx=0x7f68b001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68142daa696d0d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68b67fc640 1 -- 172.21.15.1:0/4056937561 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b00b2070 con 0x7f68b8149450 2024-09-15T21:56:21.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68b67fc640 1 -- 172.21.15.1:0/4056937561 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b00a5870 con 0x7f68b8149450 2024-09-15T21:56:21.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68b67fc640 1 -- 172.21.15.1:0/4056937561 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b00a5c40 con 0x7f68b8149450 2024-09-15T21:56:21.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4056937561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b8149450 msgr2=0x7f68b809dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68bdd4f640 1 --2- 172.21.15.1:0/4056937561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b8149450 0x7f68b809dca0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f68b80b03d0 tx=0x7f68b001c8a0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4056937561 shutdown_connections 2024-09-15T21:56:21.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68bdd4f640 1 --2- 172.21.15.1:0/4056937561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b8149450 0x7f68b809dca0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68bdd4f640 1 --2- 172.21.15.1:0/4056937561 >> v2:172.21.15.70:3300/0 conn(0x7f68b80b4560 0x7f68b80b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4056937561 >> 172.21.15.1:0/4056937561 conn(0x7f68b806c730 msgr2=0x7f68b80b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:21.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4056937561 shutdown_connections 2024-09-15T21:56:21.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4056937561 wait complete. 2024-09-15T21:56:21.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68bdd4f640 1 Processor -- start 2024-09-15T21:56:21.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.608+0000 7f68bdd4f640 1 -- start start 2024-09-15T21:56:21.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68bdd4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b806d0d0 0x7f68b81de370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68bdd4f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68b80b4560 0x7f68b8142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68bdd4f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b8149450 0x7f68b8141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68bdd4f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f68b8152b20 con 0x7f68b806d0d0 2024-09-15T21:56:21.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68bdd4f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81529a0 con 0x7f68b8149450 2024-09-15T21:56:21.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68bdd4f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f68b8152ca0 con 0x7f68b80b4560 2024-09-15T21:56:21.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68b77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b806d0d0 0x7f68b81de370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68b77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b806d0d0 0x7f68b81de370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38954/0 (socket says 172.21.15.1:38954) 2024-09-15T21:56:21.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68b77fe640 1 -- 172.21.15.1:0/4041813297 learned_addr learned my addr 172.21.15.1:0/4041813297 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:21.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68b6ffd640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68b80b4560 0x7f68b8142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68b7fff640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b8149450 0x7f68b8141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68b77fe640 1 -- 172.21.15.1:0/4041813297 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68b80b4560 msgr2=0x7f68b8142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68b77fe640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68b80b4560 0x7f68b8142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68b77fe640 1 -- 172.21.15.1:0/4041813297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b8149450 msgr2=0x7f68b8141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68b77fe640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b8149450 0x7f68b8141050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68b77fe640 1 -- 172.21.15.1:0/4041813297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b80b0be0 con 0x7f68b806d0d0 2024-09-15T21:56:21.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68b6ffd640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68b80b4560 0x7f68b8142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:21.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68b77fe640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b806d0d0 0x7f68b81de370 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f68a800b550 tx=0x7f68a800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f689ffff640 1 -- 172.21.15.1:0/4041813297 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8014070 con 0x7f68b806d0d0 2024-09-15T21:56:21.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f689ffff640 1 -- 172.21.15.1:0/4041813297 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a8010890 con 0x7f68b806d0d0 2024-09-15T21:56:21.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f689ffff640 1 -- 172.21.15.1:0/4041813297 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8010c80 con 0x7f68b806d0d0 2024-09-15T21:56:21.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4041813297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b8141f50 con 0x7f68b806d0d0 2024-09-15T21:56:21.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4041813297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b8140250 con 0x7f68b806d0d0 2024-09-15T21:56:21.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4041813297 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b80b4940 con 0x7f68b806d0d0 2024-09-15T21:56:21.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f689ffff640 1 -- 172.21.15.1:0/4041813297 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f68a8017070 con 0x7f68b806d0d0 2024-09-15T21:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f689ffff640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f68a40678c0 0x7f68a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f689ffff640 1 -- 172.21.15.1:0/4041813297 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f68a8085750 con 0x7f68b806d0d0 2024-09-15T21:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.612+0000 7f68b6ffd640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f68a40678c0 0x7f68a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.616+0000 7f68b6ffd640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f68a40678c0 0x7f68a4069d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f68b8143220 tx=0x7f68ac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.616+0000 7f689ffff640 1 -- 172.21.15.1:0/4041813297 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f68a8056620 con 0x7f68b806d0d0 2024-09-15T21:56:21.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4041813297 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f68b80b5510 con 0x7f68a40678c0 2024-09-15T21:56:21.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f689ffff640 1 -- 172.21.15.1:0/4041813297 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f68b80b5510 con 0x7f68a40678c0 2024-09-15T21:56:21.789 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 4 to deep-scrub 2024-09-15T21:56:21.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4041813297 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f68a40678c0 msgr2=0x7f68a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f68bdd4f640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f68a40678c0 0x7f68a4069d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f68b8143220 tx=0x7f68ac009040 comp rx=0 tx=0).stop 2024-09-15T21:56:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4041813297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b806d0d0 msgr2=0x7f68b81de370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f68bdd4f640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b806d0d0 0x7f68b81de370 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f68a800b550 tx=0x7f68a800ba10 comp rx=0 tx=0).stop 2024-09-15T21:56:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4041813297 shutdown_connections 2024-09-15T21:56:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f68bdd4f640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f68a40678c0 0x7f68a4069d80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f68bdd4f640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68b8149450 0x7f68b8141050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f68bdd4f640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68b80b4560 0x7f68b8142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f68bdd4f640 1 --2- 172.21.15.1:0/4041813297 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f68b806d0d0 0x7f68b81de370 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4041813297 >> 172.21.15.1:0/4041813297 conn(0x7f68b806c730 msgr2=0x7f68b8145740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:21.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4041813297 shutdown_connections 2024-09-15T21:56:21.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.784+0000 7f68bdd4f640 1 -- 172.21.15.1:0/4041813297 wait complete. 2024-09-15T21:56:21.808 INFO:tasks.ceph:Scrubbing osd.5 2024-09-15T21:56:21.809 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-15T21:56:21.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe7c86b640 1 Processor -- start 2024-09-15T21:56:21.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe7c86b640 1 -- start start 2024-09-15T21:56:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe7c86b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbe780b5560 0x7fbe780ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe7c86b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbe7806d0d0 0x7fbe780afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe7c86b640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe780b5940 con 0x7fbe7813e570 2024-09-15T21:56:21.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe7c86b640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fbe780b0300 con 0x7fbe7806d0d0 2024-09-15T21:56:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe7c86b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fbe7806dbd0 con 0x7fbe780b5560 2024-09-15T21:56:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe75d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbe7806d0d0 0x7fbe780afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe76d9d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbe7813e570 0x7fbe780b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58344/0 (socket says 172.21.15.1:58344) 2024-09-15T21:56:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe76d9d640 1 -- 172.21.15.1:0/191291812 learned_addr learned my addr 172.21.15.1:0/191291812 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe7659c640 1 --2- 172.21.15.1:0/191291812 >> v2:172.21.15.70:3300/0 conn(0x7fbe780b5560 0x7fbe780ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe75d9b640 1 -- 172.21.15.1:0/191291812 >> v2:172.21.15.70:3300/0 conn(0x7fbe780b5560 msgr2=0x7fbe780ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:21.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe75d9b640 1 --2- 172.21.15.1:0/191291812 >> v2:172.21.15.70:3300/0 conn(0x7fbe780b5560 0x7fbe780ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe75d9b640 1 -- 172.21.15.1:0/191291812 >> v1:172.21.15.1:6789/0 conn(0x7fbe7813e570 legacy=0x7fbe780b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe7559a640 1 -- 172.21.15.1:0/191291812 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2093121905 0 0) 0x7fbe780b5940 con 0x7fbe7813e570 2024-09-15T21:56:21.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.924+0000 7fbe75d9b640 1 -- 172.21.15.1:0/191291812 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7806deb0 con 0x7fbe7806d0d0 2024-09-15T21:56:21.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.928+0000 7fbe75d9b640 1 --2- 172.21.15.1:0/191291812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7806d0d0 0x7fbe780afdc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbe7806ea60 tx=0x7fbe6c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c751d27a7c74b00 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.928+0000 7fbe7559a640 1 -- 172.21.15.1:0/191291812 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c0b0070 con 0x7fbe7806d0d0 2024-09-15T21:56:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.928+0000 7fbe7559a640 1 -- 172.21.15.1:0/191291812 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6c0ab600 con 0x7fbe7806d0d0 2024-09-15T21:56:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.928+0000 7fbe7559a640 1 -- 172.21.15.1:0/191291812 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c0ab9d0 con 0x7fbe7806d0d0 2024-09-15T21:56:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.928+0000 7fbe7c86b640 1 -- 172.21.15.1:0/191291812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7806d0d0 msgr2=0x7fbe780afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.928+0000 7fbe7c86b640 1 --2- 172.21.15.1:0/191291812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7806d0d0 0x7fbe780afdc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbe7806ea60 tx=0x7fbe6c01c3f0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.928+0000 7fbe7c86b640 1 -- 172.21.15.1:0/191291812 shutdown_connections 2024-09-15T21:56:21.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.928+0000 7fbe7c86b640 1 --2- 172.21.15.1:0/191291812 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7806d0d0 0x7fbe780afdc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.928+0000 7fbe7c86b640 1 --2- 172.21.15.1:0/191291812 >> v2:172.21.15.70:3300/0 conn(0x7fbe780b5560 0x7fbe780ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.928+0000 7fbe7c86b640 1 -- 172.21.15.1:0/191291812 >> 172.21.15.1:0/191291812 conn(0x7fbe7806c730 msgr2=0x7fbe780b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:21.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.928+0000 7fbe7c86b640 1 -- 172.21.15.1:0/191291812 shutdown_connections 2024-09-15T21:56:21.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.928+0000 7fbe7c86b640 1 -- 172.21.15.1:0/191291812 wait complete. 2024-09-15T21:56:21.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7c86b640 1 Processor -- start 2024-09-15T21:56:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7c86b640 1 -- start start 2024-09-15T21:56:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7c86b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7806d0d0 0x7fbe780714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7c86b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbe780b5560 0x7fbe7813aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7c86b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe7813e570 0x7fbe781e1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7c86b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbe78151f60 con 0x7fbe7806d0d0 2024-09-15T21:56:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7c86b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe78151de0 con 0x7fbe7813e570 2024-09-15T21:56:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7c86b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fbe781520e0 con 0x7fbe780b5560 2024-09-15T21:56:21.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7806d0d0 0x7fbe780714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7806d0d0 0x7fbe780714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38978/0 (socket says 172.21.15.1:38978) 2024-09-15T21:56:21.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7659c640 1 -- 172.21.15.1:0/3711541257 learned_addr learned my addr 172.21.15.1:0/3711541257 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:21.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe75d9b640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbe780b5560 0x7fbe7813aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7659c640 1 -- 172.21.15.1:0/3711541257 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbe780b5560 msgr2=0x7fbe7813aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7659c640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbe780b5560 0x7fbe7813aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7659c640 1 -- 172.21.15.1:0/3711541257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe7813e570 msgr2=0x7fbe781e1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe76d9d640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe7813e570 0x7fbe781e1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7659c640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe7813e570 0x7fbe781e1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7659c640 1 -- 172.21.15.1:0/3711541257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7813af60 con 0x7fbe7806d0d0 2024-09-15T21:56:21.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7659c640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7806d0d0 0x7fbe780714f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800d830 tx=0x7fbe6800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe66ffd640 1 -- 172.21.15.1:0/3711541257 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6800b6c0 con 0x7fbe7806d0d0 2024-09-15T21:56:21.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe66ffd640 1 -- 172.21.15.1:0/3711541257 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe68019070 con 0x7fbe7806d0d0 2024-09-15T21:56:21.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7c86b640 1 -- 172.21.15.1:0/3711541257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe78070560 con 0x7fbe7806d0d0 2024-09-15T21:56:21.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe66ffd640 1 -- 172.21.15.1:0/3711541257 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6800ba60 con 0x7fbe7806d0d0 2024-09-15T21:56:21.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7c86b640 1 -- 172.21.15.1:0/3711541257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe78073140 con 0x7fbe7806d0d0 2024-09-15T21:56:21.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe7c86b640 1 -- 172.21.15.1:0/3711541257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe780afdc0 con 0x7fbe7806d0d0 2024-09-15T21:56:21.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe66ffd640 1 -- 172.21.15.1:0/3711541257 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbe6801e460 con 0x7fbe7806d0d0 2024-09-15T21:56:21.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe66ffd640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fbe580678c0 0x7fbe58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe66ffd640 1 -- 172.21.15.1:0/3711541257 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7fbe68086a70 con 0x7fbe7806d0d0 2024-09-15T21:56:21.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe75d9b640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fbe580678c0 0x7fbe58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe66ffd640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] conn(0x7fbe5806d780 0x7fbe5806fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:21.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe66ffd640 1 -- 172.21.15.1:0/3711541257 --> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe58070250 con 0x7fbe5806d780 2024-09-15T21:56:21.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.932+0000 7fbe66ffd640 1 -- 172.21.15.1:0/3711541257 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbe68086f00 con 0x7fbe7806d0d0 2024-09-15T21:56:21.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.936+0000 7fbe75d9b640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fbe580678c0 0x7fbe58069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0ad000 tx=0x7fbe6c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.936+0000 7fbe76d9d640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] conn(0x7fbe5806d780 0x7fbe5806fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:21.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.936+0000 7fbe76d9d640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] conn(0x7fbe5806d780 0x7fbe5806fba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:21.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.936+0000 7fbe66ffd640 1 -- 172.21.15.1:0/3711541257 <== osd.5 v2:172.21.15.70:6800/1012183169 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe58070250 con 0x7fbe5806d780 2024-09-15T21:56:21.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.948+0000 7fbe7c86b640 1 -- 172.21.15.1:0/3711541257 --> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbe780af350 con 0x7fbe5806d780 2024-09-15T21:56:21.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.952+0000 7fbe66ffd640 1 -- 172.21.15.1:0/3711541257 <== osd.5 v2:172.21.15.70:6800/1012183169 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbe780af350 con 0x7fbe5806d780 2024-09-15T21:56:21.957 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T21:56:21.957 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T21:56:21.957 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T21:56:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.952+0000 7fbe7c86b640 1 -- 172.21.15.1:0/3711541257 >> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] conn(0x7fbe5806d780 msgr2=0x7fbe5806fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.952+0000 7fbe7c86b640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.70:6800/1012183169,v1:172.21.15.70:6801/1012183169] conn(0x7fbe5806d780 0x7fbe5806fba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.952+0000 7fbe7c86b640 1 -- 172.21.15.1:0/3711541257 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fbe580678c0 msgr2=0x7fbe58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.952+0000 7fbe7c86b640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fbe580678c0 0x7fbe58069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0ad000 tx=0x7fbe6c008040 comp rx=0 tx=0).stop 2024-09-15T21:56:21.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.952+0000 7fbe7c86b640 1 -- 172.21.15.1:0/3711541257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7806d0d0 msgr2=0x7fbe780714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:21.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.952+0000 7fbe7c86b640 1 --2- 172.21.15.1:0/3711541257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe7806d0d0 0x7fbe780714f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800d830 tx=0x7fbe6800dcf0 comp rx=0 tx=0).stop 2024-09-15T21:56:21.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.952+0000 7fbe76d9d640 1 -- 172.21.15.1:0/3711541257 reap_dead start 2024-09-15T21:56:21.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.952+0000 7fbe7c86b640 1 -- 172.21.15.1:0/3711541257 shutdown_connections 2024-09-15T21:56:21.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.952+0000 7fbe7c86b640 1 -- 172.21.15.1:0/3711541257 >> 172.21.15.1:0/3711541257 conn(0x7fbe7806c730 msgr2=0x7fbe7809d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:21.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.952+0000 7fbe7c86b640 1 -- 172.21.15.1:0/3711541257 shutdown_connections 2024-09-15T21:56:21.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:21.952+0000 7fbe7c86b640 1 -- 172.21.15.1:0/3711541257 wait complete. 2024-09-15T21:56:21.973 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-15T21:56:22.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f9166c58640 1 Processor -- start 2024-09-15T21:56:22.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f9166c58640 1 -- start start 2024-09-15T21:56:22.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f9166c58640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9160067c60 0x7f91600af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f9166c58640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f916006ef90 0x7f9160146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f9166c58640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91600b9630 con 0x7f9160147230 2024-09-15T21:56:22.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f9166c58640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f916006e2f0 con 0x7f916006ef90 2024-09-15T21:56:22.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f9166c58640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f9160068040 con 0x7f9160067c60 2024-09-15T21:56:22.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f915ffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f916006ef90 0x7f9160146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f915ffff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f916006ef90 0x7f9160146cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38992/0 (socket says 172.21.15.1:38992) 2024-09-15T21:56:22.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f915ffff640 1 -- 172.21.15.1:0/1237423901 learned_addr learned my addr 172.21.15.1:0/1237423901 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:22.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f91649f4640 1 --2- 172.21.15.1:0/1237423901 >> v2:172.21.15.70:3300/0 conn(0x7f9160067c60 0x7f91600af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f915ffff640 1 -- 172.21.15.1:0/1237423901 >> v2:172.21.15.70:3300/0 conn(0x7f9160067c60 msgr2=0x7f91600af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:22.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f915ffff640 1 --2- 172.21.15.1:0/1237423901 >> v2:172.21.15.70:3300/0 conn(0x7f9160067c60 0x7f91600af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f915ffff640 1 -- 172.21.15.1:0/1237423901 >> v1:172.21.15.70:6789/0 conn(0x7f9160147230 legacy=0x7f916009ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:22.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.088+0000 7f915ffff640 1 -- 172.21.15.1:0/1237423901 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91600af280 con 0x7f916006ef90 2024-09-15T21:56:22.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f915ffff640 1 --2- 172.21.15.1:0/1237423901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f916006ef90 0x7f9160146cf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9160050700 tx=0x7f915401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e06639e52e8c1e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f915f7fe640 1 -- 172.21.15.1:0/1237423901 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91540b0070 con 0x7f916006ef90 2024-09-15T21:56:22.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f915f7fe640 1 -- 172.21.15.1:0/1237423901 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91540ab600 con 0x7f916006ef90 2024-09-15T21:56:22.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f915f7fe640 1 -- 172.21.15.1:0/1237423901 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91540ab9d0 con 0x7f916006ef90 2024-09-15T21:56:22.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 -- 172.21.15.1:0/1237423901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f916006ef90 msgr2=0x7f9160146cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 --2- 172.21.15.1:0/1237423901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f916006ef90 0x7f9160146cf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9160050700 tx=0x7f915401c3c0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 -- 172.21.15.1:0/1237423901 shutdown_connections 2024-09-15T21:56:22.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 --2- 172.21.15.1:0/1237423901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f916006ef90 0x7f9160146cf0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 --2- 172.21.15.1:0/1237423901 >> v2:172.21.15.70:3300/0 conn(0x7f9160067c60 0x7f91600af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 -- 172.21.15.1:0/1237423901 >> 172.21.15.1:0/1237423901 conn(0x7f91600b7970 msgr2=0x7f91600b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:22.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 -- 172.21.15.1:0/1237423901 shutdown_connections 2024-09-15T21:56:22.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 -- 172.21.15.1:0/1237423901 wait complete. 2024-09-15T21:56:22.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 Processor -- start 2024-09-15T21:56:22.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 -- start start 2024-09-15T21:56:22.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9160067c60 0x7f91600b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f916006ef90 0x7f9160144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9160147230 0x7f91601e02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f91601476a0 con 0x7f9160067c60 2024-09-15T21:56:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91600aef00 con 0x7f9160147230 2024-09-15T21:56:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f91600b0a50 con 0x7f916006ef90 2024-09-15T21:56:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f91649f4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9160067c60 0x7f91600b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f91649f4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9160067c60 0x7f91600b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39002/0 (socket says 172.21.15.1:39002) 2024-09-15T21:56:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f91649f4640 1 -- 172.21.15.1:0/4022898225 learned_addr learned my addr 172.21.15.1:0/4022898225 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f91651f5640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9160147230 0x7f91601e02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f915ffff640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f916006ef90 0x7f9160144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f91649f4640 1 -- 172.21.15.1:0/4022898225 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f916006ef90 msgr2=0x7f9160144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f91649f4640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f916006ef90 0x7f9160144ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f91649f4640 1 -- 172.21.15.1:0/4022898225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9160147230 msgr2=0x7f91601e02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f91649f4640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9160147230 0x7f91601e02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f91649f4640 1 -- 172.21.15.1:0/4022898225 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916013b4a0 con 0x7f9160067c60 2024-09-15T21:56:22.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f915ffff640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f916006ef90 0x7f9160144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:22.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f91649f4640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9160067c60 0x7f91600b30d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f915800d620 tx=0x7f915800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f915d7fa640 1 -- 172.21.15.1:0/4022898225 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915800b620 con 0x7f9160067c60 2024-09-15T21:56:22.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f915d7fa640 1 -- 172.21.15.1:0/4022898225 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9158019070 con 0x7f9160067c60 2024-09-15T21:56:22.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.092+0000 7f9166c58640 1 -- 172.21.15.1:0/4022898225 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9160139a90 con 0x7f9160067c60 2024-09-15T21:56:22.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.096+0000 7f915d7fa640 1 -- 172.21.15.1:0/4022898225 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915800b9e0 con 0x7f9160067c60 2024-09-15T21:56:22.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.096+0000 7f9166c58640 1 -- 172.21.15.1:0/4022898225 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f916013a290 con 0x7f9160067c60 2024-09-15T21:56:22.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.096+0000 7f9166c58640 1 -- 172.21.15.1:0/4022898225 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91600af9f0 con 0x7f9160067c60 2024-09-15T21:56:22.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.096+0000 7f915d7fa640 1 -- 172.21.15.1:0/4022898225 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f915800bb80 con 0x7f9160067c60 2024-09-15T21:56:22.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.096+0000 7f915d7fa640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f914c0678c0 0x7f914c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.096+0000 7f915d7fa640 1 -- 172.21.15.1:0/4022898225 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f9158086800 con 0x7f9160067c60 2024-09-15T21:56:22.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.096+0000 7f915ffff640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f914c0678c0 0x7f914c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.096+0000 7f915ffff640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f914c0678c0 0x7f914c069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f91540ad000 tx=0x7f9154008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.100+0000 7f915d7fa640 1 -- 172.21.15.1:0/4022898225 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9158057730 con 0x7f9160067c60 2024-09-15T21:56:22.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f9166c58640 1 -- 172.21.15.1:0/4022898225 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f91600734c0 con 0x7f914c0678c0 2024-09-15T21:56:22.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f915d7fa640 1 -- 172.21.15.1:0/4022898225 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f91600734c0 con 0x7f914c0678c0 2024-09-15T21:56:22.270 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 5 to deep-scrub 2024-09-15T21:56:22.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f9166c58640 1 -- 172.21.15.1:0/4022898225 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f914c0678c0 msgr2=0x7f914c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f9166c58640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f914c0678c0 0x7f914c069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f91540ad000 tx=0x7f9154008040 comp rx=0 tx=0).stop 2024-09-15T21:56:22.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f9166c58640 1 -- 172.21.15.1:0/4022898225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9160067c60 msgr2=0x7f91600b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f9166c58640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9160067c60 0x7f91600b30d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f915800d620 tx=0x7f915800dae0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f9166c58640 1 -- 172.21.15.1:0/4022898225 shutdown_connections 2024-09-15T21:56:22.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f9166c58640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f914c0678c0 0x7f914c069d80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f9166c58640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9160147230 0x7f91601e02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f9166c58640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f916006ef90 0x7f9160144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f9166c58640 1 --2- 172.21.15.1:0/4022898225 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9160067c60 0x7f91600b30d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f9166c58640 1 -- 172.21.15.1:0/4022898225 >> 172.21.15.1:0/4022898225 conn(0x7f91600b7970 msgr2=0x7f9160147f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:22.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f9166c58640 1 -- 172.21.15.1:0/4022898225 shutdown_connections 2024-09-15T21:56:22.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.264+0000 7f9166c58640 1 -- 172.21.15.1:0/4022898225 wait complete. 2024-09-15T21:56:22.288 INFO:tasks.ceph:Scrubbing osd.6 2024-09-15T21:56:22.289 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-15T21:56:22.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.412+0000 7fb66e1f8640 1 Processor -- start 2024-09-15T21:56:22.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.412+0000 7fb66e1f8640 1 -- start start 2024-09-15T21:56:22.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.412+0000 7fb66e1f8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb6680b4560 0x7fb6680b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.412+0000 7fb66e1f8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb668149450 0x7fb66809dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.412+0000 7fb66e1f8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66806d5b0 con 0x7fb66806d0d0 2024-09-15T21:56:22.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.412+0000 7fb66e1f8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fb66806dc00 con 0x7fb6680b4560 2024-09-15T21:56:22.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.412+0000 7fb66e1f8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb66806d890 con 0x7fb668149450 2024-09-15T21:56:22.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.416+0000 7fb667fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb668149450 0x7fb66809dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.416+0000 7fb6677fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb6680b4560 0x7fb6680b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.416+0000 7fb6677fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb6680b4560 0x7fb6680b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.1:46238/0 (socket says 172.21.15.1:46238) 2024-09-15T21:56:22.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.416+0000 7fb6677fe640 1 -- 172.21.15.1:0/2052815086 learned_addr learned my addr 172.21.15.1:0/2052815086 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:22.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.416+0000 7fb65effd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb66806d0d0 0x7fb668148d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.1:47192/0 (socket says 172.21.15.1:47192) 2024-09-15T21:56:22.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.416+0000 7fb6677fe640 1 -- 172.21.15.1:0/2052815086 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb668149450 msgr2=0x7fb66809dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:22.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.416+0000 7fb6677fe640 1 --2- 172.21.15.1:0/2052815086 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb668149450 0x7fb66809dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.416+0000 7fb6677fe640 1 -- 172.21.15.1:0/2052815086 >> v1:172.21.15.70:6789/0 conn(0x7fb66806d0d0 legacy=0x7fb668148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.416+0000 7fb6677fe640 1 -- 172.21.15.1:0/2052815086 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6680b3ad0 con 0x7fb6680b4560 2024-09-15T21:56:22.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.416+0000 7fb6677fe640 1 --2- 172.21.15.1:0/2052815086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6680b4560 0x7fb6680b4940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb658009870 tx=0x7fb65801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9bbadceda348a41 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb666ffd640 1 -- 172.21.15.1:0/2052815086 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6580b1070 con 0x7fb6680b4560 2024-09-15T21:56:22.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb666ffd640 1 -- 172.21.15.1:0/2052815086 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6580a8050 con 0x7fb6680b4560 2024-09-15T21:56:22.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb666ffd640 1 -- 172.21.15.1:0/2052815086 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6580ac860 con 0x7fb6680b4560 2024-09-15T21:56:22.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2052815086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6680b4560 msgr2=0x7fb6680b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 --2- 172.21.15.1:0/2052815086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6680b4560 0x7fb6680b4940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb658009870 tx=0x7fb65801c4d0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2052815086 shutdown_connections 2024-09-15T21:56:22.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 --2- 172.21.15.1:0/2052815086 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb668149450 0x7fb66809dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 --2- 172.21.15.1:0/2052815086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6680b4560 0x7fb6680b4940 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2052815086 >> 172.21.15.1:0/2052815086 conn(0x7fb66806c730 msgr2=0x7fb6680b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:22.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2052815086 shutdown_connections 2024-09-15T21:56:22.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2052815086 wait complete. 2024-09-15T21:56:22.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 Processor -- start 2024-09-15T21:56:22.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 -- start start 2024-09-15T21:56:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb66806d0d0 0x7fb668070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6680b4560 0x7fb668070a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb668149450 0x7fb6681dc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6680ae480 con 0x7fb668149450 2024-09-15T21:56:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb6680ae300 con 0x7fb6680b4560 2024-09-15T21:56:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb66e1f8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fb6680ae600 con 0x7fb66806d0d0 2024-09-15T21:56:22.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb667fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb668149450 0x7fb6681dc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb667fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb668149450 0x7fb6681dc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39018/0 (socket says 172.21.15.1:39018) 2024-09-15T21:56:22.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb667fff640 1 -- 172.21.15.1:0/2522472063 learned_addr learned my addr 172.21.15.1:0/2522472063 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:22.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb6677fe640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb66806d0d0 0x7fb668070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb65effd640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6680b4560 0x7fb668070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb667fff640 1 -- 172.21.15.1:0/2522472063 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb66806d0d0 msgr2=0x7fb668070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb667fff640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb66806d0d0 0x7fb668070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb667fff640 1 -- 172.21.15.1:0/2522472063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6680b4560 msgr2=0x7fb668070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb667fff640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6680b4560 0x7fb668070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb667fff640 1 -- 172.21.15.1:0/2522472063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb668072640 con 0x7fb668149450 2024-09-15T21:56:22.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb6677fe640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb66806d0d0 0x7fb668070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:56:22.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.420+0000 7fb667fff640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb668149450 0x7fb6681dc0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb66000efc0 tx=0x7fb66000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb664ff9640 1 -- 172.21.15.1:0/2522472063 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660018020 con 0x7fb668149450 2024-09-15T21:56:22.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb664ff9640 1 -- 172.21.15.1:0/2522472063 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb660014480 con 0x7fb668149450 2024-09-15T21:56:22.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2522472063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb668070850 con 0x7fb668149450 2024-09-15T21:56:22.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb664ff9640 1 -- 172.21.15.1:0/2522472063 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660014870 con 0x7fb668149450 2024-09-15T21:56:22.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2522472063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6680728b0 con 0x7fb668149450 2024-09-15T21:56:22.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2522472063 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb66809dca0 con 0x7fb668149450 2024-09-15T21:56:22.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb664ff9640 1 -- 172.21.15.1:0/2522472063 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb66001b020 con 0x7fb668149450 2024-09-15T21:56:22.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb664ff9640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb6480678c0 0x7fb648069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb664ff9640 1 -- 172.21.15.1:0/2522472063 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7fb6600870a0 con 0x7fb668149450 2024-09-15T21:56:22.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb6677fe640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb6480678c0 0x7fb648069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb664ff9640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] conn(0x7fb64806d780 0x7fb64806fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb664ff9640 1 -- 172.21.15.1:0/2522472063 --> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb648070250 con 0x7fb64806d780 2024-09-15T21:56:22.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb664ff9640 1 -- 172.21.15.1:0/2522472063 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb660087530 con 0x7fb668149450 2024-09-15T21:56:22.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb6677fe640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb6480678c0 0x7fb648069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb6580ae000 tx=0x7fb6580a7000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb65effd640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] conn(0x7fb64806d780 0x7fb64806fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.424+0000 7fb65effd640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] conn(0x7fb64806d780 0x7fb64806fba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.428+0000 7fb664ff9640 1 -- 172.21.15.1:0/2522472063 <== osd.6 v2:172.21.15.70:6824/2395913130 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb648070250 con 0x7fb64806d780 2024-09-15T21:56:22.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.440+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2522472063 --> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb668142e40 con 0x7fb64806d780 2024-09-15T21:56:22.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.440+0000 7fb664ff9640 1 -- 172.21.15.1:0/2522472063 <== osd.6 v2:172.21.15.70:6824/2395913130 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb668142e40 con 0x7fb64806d780 2024-09-15T21:56:22.447 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T21:56:22.447 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T21:56:22.447 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T21:56:22.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.440+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2522472063 >> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] conn(0x7fb64806d780 msgr2=0x7fb64806fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.440+0000 7fb66e1f8640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.70:6824/2395913130,v1:172.21.15.70:6825/2395913130] conn(0x7fb64806d780 0x7fb64806fba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.440+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2522472063 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb6480678c0 msgr2=0x7fb648069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.440+0000 7fb66e1f8640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fb6480678c0 0x7fb648069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb6580ae000 tx=0x7fb6580a7000 comp rx=0 tx=0).stop 2024-09-15T21:56:22.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.440+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2522472063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb668149450 msgr2=0x7fb6681dc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.440+0000 7fb66e1f8640 1 --2- 172.21.15.1:0/2522472063 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb668149450 0x7fb6681dc0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb66000efc0 tx=0x7fb66000c490 comp rx=0 tx=0).stop 2024-09-15T21:56:22.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.440+0000 7fb667fff640 1 -- 172.21.15.1:0/2522472063 reap_dead start 2024-09-15T21:56:22.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.440+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2522472063 shutdown_connections 2024-09-15T21:56:22.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.440+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2522472063 >> 172.21.15.1:0/2522472063 conn(0x7fb66806c730 msgr2=0x7fb6680afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:22.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.440+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2522472063 shutdown_connections 2024-09-15T21:56:22.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.440+0000 7fb66e1f8640 1 -- 172.21.15.1:0/2522472063 wait complete. 2024-09-15T21:56:22.462 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-15T21:56:22.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f686d5d8640 1 Processor -- start 2024-09-15T21:56:22.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f686d5d8640 1 -- start start 2024-09-15T21:56:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f686d5d8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68680b9710 0x7f68680bb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f686d5d8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6868147fe0 0x7f6868148430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f686d5d8640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f686806db80 con 0x7f68680bc1a0 2024-09-15T21:56:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f686d5d8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f68680bb650 con 0x7f6868147fe0 2024-09-15T21:56:22.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f686d5d8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f6868145300 con 0x7f68680b9710 2024-09-15T21:56:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6866ffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f68680bc1a0 0x7f686806d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58358/0 (socket says 172.21.15.1:58358) 2024-09-15T21:56:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6866ffd640 1 -- 172.21.15.1:0/922695519 learned_addr learned my addr 172.21.15.1:0/922695519 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f68667fc640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68680b9710 0x7f68680bb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 392323465 0 0) 0x7f686806db80 con 0x7f68680bc1a0 2024-09-15T21:56:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6850003530 con 0x7f68680bc1a0 2024-09-15T21:56:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f68677fe640 1 --2- 172.21.15.1:0/922695519 >> v2:172.21.15.70:3300/0 conn(0x7f6868147fe0 0x7f6868148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4172003433 0 0) 0x7f6850003530 con 0x7f68680bc1a0 2024-09-15T21:56:22.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68680b9710 msgr2=0x7f68680bb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68680b9710 0x7f68680bb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 >> v2:172.21.15.70:3300/0 conn(0x7f6868147fe0 msgr2=0x7f6868148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 --2- 172.21.15.1:0/922695519 >> v2:172.21.15.70:3300/0 conn(0x7f6868147fe0 0x7f6868148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68680bc580 con 0x7f68680bc1a0 2024-09-15T21:56:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f685c001680 con 0x7f68680bc1a0 2024-09-15T21:56:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 >> v1:172.21.15.1:6789/0 conn(0x7f68680bc1a0 legacy=0x7f686806d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68500039c0 0x7f6850003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68500043b0 0x7f6850004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6850004fb0 0x7f685000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f68680bb650 con 0x7f6850004fb0 2024-09-15T21:56:22.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6868145300 con 0x7f68500043b0 2024-09-15T21:56:22.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f685000bf40 con 0x7f68500039c0 2024-09-15T21:56:22.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f68667fc640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68680b9710 0x7f68680bb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:56:22.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f68677fe640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6850004fb0 0x7f685000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f6866ffd640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68500039c0 0x7f6850003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f68677fe640 1 -- 172.21.15.1:0/922695519 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68500039c0 msgr2=0x7f6850003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:22.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f68667fc640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68500043b0 0x7f6850004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f68677fe640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68500039c0 0x7f6850003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f68677fe640 1 -- 172.21.15.1:0/922695519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68500043b0 msgr2=0x7f6850004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:22.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f68677fe640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68500043b0 0x7f6850004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f68677fe640 1 -- 172.21.15.1:0/922695519 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6850003530 con 0x7f6850004fb0 2024-09-15T21:56:22.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.572+0000 7f68667fc640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68500043b0 0x7f6850004890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:22.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.576+0000 7f68677fe640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6850004fb0 0x7f685000b9d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6860009fc0 tx=0x7f686001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aec3c634b30ccf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.576+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600b2070 con 0x7f6850004fb0 2024-09-15T21:56:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.576+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68600a5cd0 con 0x7f6850004fb0 2024-09-15T21:56:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.576+0000 7f6865ffb640 1 -- 172.21.15.1:0/922695519 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860009c10 con 0x7f6850004fb0 2024-09-15T21:56:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.576+0000 7f686d5d8640 1 -- 172.21.15.1:0/922695519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6850004fb0 msgr2=0x7f685000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.576+0000 7f686d5d8640 1 --2- 172.21.15.1:0/922695519 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6850004fb0 0x7f685000b9d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6860009fc0 tx=0x7f686001ccc0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.576+0000 7f68677fe640 1 -- 172.21.15.1:0/922695519 reap_dead start 2024-09-15T21:56:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.576+0000 7f686d5d8640 1 -- 172.21.15.1:0/922695519 shutdown_connections 2024-09-15T21:56:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.576+0000 7f686d5d8640 1 -- 172.21.15.1:0/922695519 >> 172.21.15.1:0/922695519 conn(0x7f68680b9df0 msgr2=0x7f68680ba200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.576+0000 7f686d5d8640 1 -- 172.21.15.1:0/922695519 shutdown_connections 2024-09-15T21:56:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.576+0000 7f686d5d8640 1 -- 172.21.15.1:0/922695519 wait complete. 2024-09-15T21:56:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.576+0000 7f686d5d8640 1 Processor -- start 2024-09-15T21:56:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.576+0000 7f686d5d8640 1 -- start start 2024-09-15T21:56:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f686d5d8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6850004fb0 0x7f686809b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f686d5d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686809baa0 0x7f686809e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f686d5d8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f686809eaf0 0x7f68681dd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f686d5d8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f68680bc810 con 0x7f686809baa0 2024-09-15T21:56:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f686d5d8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68680bce30 con 0x7f686809eaf0 2024-09-15T21:56:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f686d5d8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f6868147850 con 0x7f6850004fb0 2024-09-15T21:56:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f68667fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686809baa0 0x7f686809e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f68667fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686809baa0 0x7f686809e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39024/0 (socket says 172.21.15.1:39024) 2024-09-15T21:56:22.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f68667fc640 1 -- 172.21.15.1:0/3457985254 learned_addr learned my addr 172.21.15.1:0/3457985254 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:22.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f6866ffd640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6850004fb0 0x7f686809b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f68667fc640 1 -- 172.21.15.1:0/3457985254 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6850004fb0 msgr2=0x7f686809b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f68667fc640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6850004fb0 0x7f686809b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f68667fc640 1 -- 172.21.15.1:0/3457985254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f686809eaf0 msgr2=0x7f68681dd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f68667fc640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f686809eaf0 0x7f68681dd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f68667fc640 1 -- 172.21.15.1:0/3457985254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686809c9e0 con 0x7f686809baa0 2024-09-15T21:56:22.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f6866ffd640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6850004fb0 0x7f686809b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:22.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f68667fc640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686809baa0 0x7f686809e5b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f685800f4c0 tx=0x7f685800f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f684f7fe640 1 -- 172.21.15.1:0/3457985254 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858018020 con 0x7f686809baa0 2024-09-15T21:56:22.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f684f7fe640 1 -- 172.21.15.1:0/3457985254 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6858014890 con 0x7f686809baa0 2024-09-15T21:56:22.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f684f7fe640 1 -- 172.21.15.1:0/3457985254 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858014c40 con 0x7f686809baa0 2024-09-15T21:56:22.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f686d5d8640 1 -- 172.21.15.1:0/3457985254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686809ccc0 con 0x7f686809baa0 2024-09-15T21:56:22.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f686d5d8640 1 -- 172.21.15.1:0/3457985254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f686809de30 con 0x7f686809baa0 2024-09-15T21:56:22.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f686d5d8640 1 -- 172.21.15.1:0/3457985254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68680b6f00 con 0x7f686809baa0 2024-09-15T21:56:22.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f684f7fe640 1 -- 172.21.15.1:0/3457985254 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f685801b020 con 0x7f686809baa0 2024-09-15T21:56:22.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f684f7fe640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f68540678c0 0x7f6854069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f684f7fe640 1 -- 172.21.15.1:0/3457985254 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f6858085ea0 con 0x7f686809baa0 2024-09-15T21:56:22.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f6866ffd640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f68540678c0 0x7f6854069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.580+0000 7f6866ffd640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f68540678c0 0x7f6854069d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f685c0017f0 tx=0x7f685c000f00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.584+0000 7f684f7fe640 1 -- 172.21.15.1:0/3457985254 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6858022020 con 0x7f686809baa0 2024-09-15T21:56:22.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.748+0000 7f686d5d8640 1 -- 172.21.15.1:0/3457985254 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f6868148410 con 0x7f68540678c0 2024-09-15T21:56:22.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.748+0000 7f684f7fe640 1 -- 172.21.15.1:0/3457985254 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6868148410 con 0x7f68540678c0 2024-09-15T21:56:22.755 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 6 to deep-scrub 2024-09-15T21:56:22.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.752+0000 7f686d5d8640 1 -- 172.21.15.1:0/3457985254 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f68540678c0 msgr2=0x7f6854069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.752+0000 7f686d5d8640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f68540678c0 0x7f6854069d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f685c0017f0 tx=0x7f685c000f00 comp rx=0 tx=0).stop 2024-09-15T21:56:22.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.752+0000 7f686d5d8640 1 -- 172.21.15.1:0/3457985254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686809baa0 msgr2=0x7f686809e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.752+0000 7f686d5d8640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686809baa0 0x7f686809e5b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f685800f4c0 tx=0x7f685800f980 comp rx=0 tx=0).stop 2024-09-15T21:56:22.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.752+0000 7f686d5d8640 1 -- 172.21.15.1:0/3457985254 shutdown_connections 2024-09-15T21:56:22.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.752+0000 7f686d5d8640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f68540678c0 0x7f6854069d80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.752+0000 7f686d5d8640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f686809eaf0 0x7f68681dd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.752+0000 7f686d5d8640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f686809baa0 0x7f686809e5b0 secure :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f685800f4c0 tx=0x7f685800f980 comp rx=0 tx=0).stop 2024-09-15T21:56:22.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.752+0000 7f686d5d8640 1 --2- 172.21.15.1:0/3457985254 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6850004fb0 0x7f686809b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.752+0000 7f686d5d8640 1 -- 172.21.15.1:0/3457985254 >> 172.21.15.1:0/3457985254 conn(0x7f68680b9df0 msgr2=0x7f68680b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:22.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.752+0000 7f686d5d8640 1 -- 172.21.15.1:0/3457985254 shutdown_connections 2024-09-15T21:56:22.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.752+0000 7f686d5d8640 1 -- 172.21.15.1:0/3457985254 wait complete. 2024-09-15T21:56:22.774 INFO:tasks.ceph:Scrubbing osd.7 2024-09-15T21:56:22.775 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-15T21:56:22.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f364cc23640 1 Processor -- start 2024-09-15T21:56:22.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f364cc23640 1 -- start start 2024-09-15T21:56:22.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f364cc23640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f36480b5560 0x7f36480ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f364cc23640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f36480afdc0 0x7f364814edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f364cc23640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f364813ec80 con 0x7f364806d0d0 2024-09-15T21:56:22.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f364cc23640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f36480b5940 con 0x7f36480afdc0 2024-09-15T21:56:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f364cc23640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f364806dbd0 con 0x7f36480b5560 2024-09-15T21:56:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f3645d9b640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f364806d0d0 0x7f364813e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58370/0 (socket says 172.21.15.1:58370) 2024-09-15T21:56:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f3645d9b640 1 -- 172.21.15.1:0/3084251248 learned_addr learned my addr 172.21.15.1:0/3084251248 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f3646d9d640 1 --2- 172.21.15.1:0/3084251248 >> v2:172.21.15.1:3300/0 conn(0x7f36480afdc0 0x7f364814edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f364659c640 1 --2- 172.21.15.1:0/3084251248 >> v2:172.21.15.70:3300/0 conn(0x7f36480b5560 0x7f36480ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f364559a640 1 -- 172.21.15.1:0/3084251248 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960700871 0 0) 0x7f364813ec80 con 0x7f364806d0d0 2024-09-15T21:56:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f364559a640 1 -- 172.21.15.1:0/3084251248 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3630005740 con 0x7f364806d0d0 2024-09-15T21:56:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f3646d9d640 1 -- 172.21.15.1:0/3084251248 >> v2:172.21.15.70:3300/0 conn(0x7f36480b5560 msgr2=0x7f36480ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:22.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f3646d9d640 1 --2- 172.21.15.1:0/3084251248 >> v2:172.21.15.70:3300/0 conn(0x7f36480b5560 0x7f36480ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f3646d9d640 1 -- 172.21.15.1:0/3084251248 >> v1:172.21.15.1:6789/0 conn(0x7f364806d0d0 legacy=0x7f364813e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f3646d9d640 1 -- 172.21.15.1:0/3084251248 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364806deb0 con 0x7f36480afdc0 2024-09-15T21:56:22.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.900+0000 7f364659c640 1 --2- 172.21.15.1:0/3084251248 >> v2:172.21.15.70:3300/0 conn(0x7f36480b5560 0x7f36480ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:56:22.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f3646d9d640 1 --2- 172.21.15.1:0/3084251248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36480afdc0 0x7f364814edc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f364806ea60 tx=0x7f364001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7b42ebcee07b16 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f364559a640 1 -- 172.21.15.1:0/3084251248 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36400b2070 con 0x7f36480afdc0 2024-09-15T21:56:22.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f364559a640 1 -- 172.21.15.1:0/3084251248 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36400a5710 con 0x7f36480afdc0 2024-09-15T21:56:22.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f364559a640 1 -- 172.21.15.1:0/3084251248 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36400a5ae0 con 0x7f36480afdc0 2024-09-15T21:56:22.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f364cc23640 1 -- 172.21.15.1:0/3084251248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36480afdc0 msgr2=0x7f364814edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f364cc23640 1 --2- 172.21.15.1:0/3084251248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36480afdc0 0x7f364814edc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f364806ea60 tx=0x7f364001c8a0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f364cc23640 1 -- 172.21.15.1:0/3084251248 shutdown_connections 2024-09-15T21:56:22.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f364cc23640 1 --2- 172.21.15.1:0/3084251248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36480afdc0 0x7f364814edc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f364cc23640 1 --2- 172.21.15.1:0/3084251248 >> v2:172.21.15.70:3300/0 conn(0x7f36480b5560 0x7f36480ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f364cc23640 1 -- 172.21.15.1:0/3084251248 >> 172.21.15.1:0/3084251248 conn(0x7f364806c730 msgr2=0x7f36480b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:22.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f364cc23640 1 -- 172.21.15.1:0/3084251248 shutdown_connections 2024-09-15T21:56:22.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f364cc23640 1 -- 172.21.15.1:0/3084251248 wait complete. 2024-09-15T21:56:22.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f364cc23640 1 Processor -- start 2024-09-15T21:56:22.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.904+0000 7f364cc23640 1 -- start start 2024-09-15T21:56:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f364cc23640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f364806d0d0 0x7f364813f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f364cc23640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36480afdc0 0x7f36481e08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f364cc23640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36480b5560 0x7f36481e0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f364cc23640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f36480b4e70 con 0x7f36480b5560 2024-09-15T21:56:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f364cc23640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f36480b4cf0 con 0x7f36480afdc0 2024-09-15T21:56:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f364cc23640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f364809b260 con 0x7f364806d0d0 2024-09-15T21:56:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3646d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36480b5560 0x7f36481e0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3646d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36480b5560 0x7f36481e0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39044/0 (socket says 172.21.15.1:39044) 2024-09-15T21:56:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3646d9d640 1 -- 172.21.15.1:0/1998514325 learned_addr learned my addr 172.21.15.1:0/1998514325 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f364659c640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f364806d0d0 0x7f364813f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3645d9b640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36480afdc0 0x7f36481e08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3646d9d640 1 -- 172.21.15.1:0/1998514325 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f364806d0d0 msgr2=0x7f364813f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3646d9d640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f364806d0d0 0x7f364813f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3646d9d640 1 -- 172.21.15.1:0/1998514325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36480afdc0 msgr2=0x7f36481e08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3646d9d640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f36480afdc0 0x7f36481e08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3646d9d640 1 -- 172.21.15.1:0/1998514325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3648140430 con 0x7f36480b5560 2024-09-15T21:56:22.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f364659c640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f364806d0d0 0x7f364813f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:22.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3646d9d640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36480b5560 0x7f36481e0e20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f36400194b0 tx=0x7f3640019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3636ffd640 1 -- 172.21.15.1:0/1998514325 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36400b2050 con 0x7f36480b5560 2024-09-15T21:56:22.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3636ffd640 1 -- 172.21.15.1:0/1998514325 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36400be070 con 0x7f36480b5560 2024-09-15T21:56:22.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f364cc23640 1 -- 172.21.15.1:0/1998514325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3648140710 con 0x7f36480b5560 2024-09-15T21:56:22.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3636ffd640 1 -- 172.21.15.1:0/1998514325 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36400ad890 con 0x7f36480b5560 2024-09-15T21:56:22.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f364cc23640 1 -- 172.21.15.1:0/1998514325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36480b26b0 con 0x7f36480b5560 2024-09-15T21:56:22.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f364cc23640 1 -- 172.21.15.1:0/1998514325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f364809b620 con 0x7f36480b5560 2024-09-15T21:56:22.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3636ffd640 1 -- 172.21.15.1:0/1998514325 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f36400ada30 con 0x7f36480b5560 2024-09-15T21:56:22.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3636ffd640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f36280678c0 0x7f3628069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3636ffd640 1 -- 172.21.15.1:0/1998514325 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f36401214e0 con 0x7f36480b5560 2024-09-15T21:56:22.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f364659c640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f36280678c0 0x7f3628069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3636ffd640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] conn(0x7f362806d780 0x7f362806fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:22.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3636ffd640 1 -- 172.21.15.1:0/1998514325 --> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3628070250 con 0x7f362806d780 2024-09-15T21:56:22.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3636ffd640 1 -- 172.21.15.1:0/1998514325 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3640121970 con 0x7f36480b5560 2024-09-15T21:56:22.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f3645d9b640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] conn(0x7f362806d780 0x7f362806fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:22.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.908+0000 7f364659c640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f36280678c0 0x7f3628069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f36380097a0 tx=0x7f3638008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.912+0000 7f3645d9b640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] conn(0x7f362806d780 0x7f362806fba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:22.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.912+0000 7f3636ffd640 1 -- 172.21.15.1:0/1998514325 <== osd.7 v2:172.21.15.70:6808/1018485464 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3628070250 con 0x7f362806d780 2024-09-15T21:56:22.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.924+0000 7f364cc23640 1 -- 172.21.15.1:0/1998514325 --> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f36480af350 con 0x7f362806d780 2024-09-15T21:56:22.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.928+0000 7f3636ffd640 1 -- 172.21.15.1:0/1998514325 <== osd.7 v2:172.21.15.70:6808/1018485464 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f36480af350 con 0x7f362806d780 2024-09-15T21:56:22.932 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-15T21:56:22.933 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T21:56:22.933 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-15T21:56:22.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.928+0000 7f364cc23640 1 -- 172.21.15.1:0/1998514325 >> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] conn(0x7f362806d780 msgr2=0x7f362806fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.928+0000 7f364cc23640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.70:6808/1018485464,v1:172.21.15.70:6809/1018485464] conn(0x7f362806d780 0x7f362806fba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:22.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.928+0000 7f364cc23640 1 -- 172.21.15.1:0/1998514325 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f36280678c0 msgr2=0x7f3628069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.928+0000 7f364cc23640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f36280678c0 0x7f3628069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f36380097a0 tx=0x7f3638008040 comp rx=0 tx=0).stop 2024-09-15T21:56:22.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.928+0000 7f364cc23640 1 -- 172.21.15.1:0/1998514325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36480b5560 msgr2=0x7f36481e0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:22.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.928+0000 7f364cc23640 1 --2- 172.21.15.1:0/1998514325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f36480b5560 0x7f36481e0e20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f36400194b0 tx=0x7f3640019640 comp rx=0 tx=0).stop 2024-09-15T21:56:22.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.928+0000 7f3646d9d640 1 -- 172.21.15.1:0/1998514325 reap_dead start 2024-09-15T21:56:22.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.928+0000 7f364cc23640 1 -- 172.21.15.1:0/1998514325 shutdown_connections 2024-09-15T21:56:22.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.928+0000 7f364cc23640 1 -- 172.21.15.1:0/1998514325 >> 172.21.15.1:0/1998514325 conn(0x7f364806c730 msgr2=0x7f3648074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:22.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.928+0000 7f364cc23640 1 -- 172.21.15.1:0/1998514325 shutdown_connections 2024-09-15T21:56:22.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:22.928+0000 7f364cc23640 1 -- 172.21.15.1:0/1998514325 wait complete. 2024-09-15T21:56:22.949 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-15T21:56:23.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf7b6d640 1 Processor -- start 2024-09-15T21:56:23.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf7b6d640 1 -- start start 2024-09-15T21:56:23.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf7b6d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5cf00b4560 0x7f5cf00b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:23.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf7b6d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5cf0149450 0x7f5cf009dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:23.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf7b6d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf006d5b0 con 0x7f5cf006d0d0 2024-09-15T21:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf7b6d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf006dc00 con 0x7f5cf00b4560 2024-09-15T21:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf7b6d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf006d890 con 0x7f5cf0149450 2024-09-15T21:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf5909640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f5cf00b4560 0x7f5cf00b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf5108640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5cf006d0d0 0x7f5cf0148d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:58382/0 (socket says 172.21.15.1:58382) 2024-09-15T21:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf5108640 1 -- 172.21.15.1:0/2713038827 learned_addr learned my addr 172.21.15.1:0/2713038827 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf610a640 1 --2- 172.21.15.1:0/2713038827 >> v2:172.21.15.70:3300/0 conn(0x7f5cf0149450 0x7f5cf009dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf4907640 1 -- 172.21.15.1:0/2713038827 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980660545 0 0) 0x7f5cf006d5b0 con 0x7f5cf006d0d0 2024-09-15T21:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf4907640 1 -- 172.21.15.1:0/2713038827 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cdc003530 con 0x7f5cf006d0d0 2024-09-15T21:56:23.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf5909640 1 -- 172.21.15.1:0/2713038827 >> v2:172.21.15.70:3300/0 conn(0x7f5cf0149450 msgr2=0x7f5cf009dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:23.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf5909640 1 --2- 172.21.15.1:0/2713038827 >> v2:172.21.15.70:3300/0 conn(0x7f5cf0149450 0x7f5cf009dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf5909640 1 -- 172.21.15.1:0/2713038827 >> v1:172.21.15.1:6789/0 conn(0x7f5cf006d0d0 legacy=0x7f5cf0148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:23.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.060+0000 7f5cf5909640 1 -- 172.21.15.1:0/2713038827 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf00b3ad0 con 0x7f5cf00b4560 2024-09-15T21:56:23.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf5909640 1 --2- 172.21.15.1:0/2713038827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5cf00b4560 0x7f5cf00b4940 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5cf01456d0 tx=0x7f5ce001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6033524691f186cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:23.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf4907640 1 -- 172.21.15.1:0/2713038827 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce00b0070 con 0x7f5cf00b4560 2024-09-15T21:56:23.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf4907640 1 -- 172.21.15.1:0/2713038827 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce00ab600 con 0x7f5cf00b4560 2024-09-15T21:56:23.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf4907640 1 -- 172.21.15.1:0/2713038827 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce00ab9d0 con 0x7f5cf00b4560 2024-09-15T21:56:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/2713038827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5cf00b4560 msgr2=0x7f5cf00b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf7b6d640 1 --2- 172.21.15.1:0/2713038827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5cf00b4560 0x7f5cf00b4940 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5cf01456d0 tx=0x7f5ce001c3f0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/2713038827 shutdown_connections 2024-09-15T21:56:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf7b6d640 1 --2- 172.21.15.1:0/2713038827 >> v2:172.21.15.70:3300/0 conn(0x7f5cf0149450 0x7f5cf009dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf7b6d640 1 --2- 172.21.15.1:0/2713038827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5cf00b4560 0x7f5cf00b4940 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/2713038827 >> 172.21.15.1:0/2713038827 conn(0x7f5cf006c730 msgr2=0x7f5cf00b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:23.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/2713038827 shutdown_connections 2024-09-15T21:56:23.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/2713038827 wait complete. 2024-09-15T21:56:23.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf7b6d640 1 Processor -- start 2024-09-15T21:56:23.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.064+0000 7f5cf7b6d640 1 -- start start 2024-09-15T21:56:23.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf7b6d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf006d0d0 0x7f5cf00ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:23.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf7b6d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5cf00b4560 0x7f5cf0147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:23.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf7b6d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5cf0149450 0x7f5cf01e40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:23.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf7b6d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf0152b20 con 0x7f5cf0149450 2024-09-15T21:56:23.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf7b6d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf01529a0 con 0x7f5cf006d0d0 2024-09-15T21:56:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf7b6d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf0152ca0 con 0x7f5cf00b4560 2024-09-15T21:56:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf610a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5cf0149450 0x7f5cf01e40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf610a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5cf0149450 0x7f5cf01e40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39074/0 (socket says 172.21.15.1:39074) 2024-09-15T21:56:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf610a640 1 -- 172.21.15.1:0/3728362429 learned_addr learned my addr 172.21.15.1:0/3728362429 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf5909640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf006d0d0 0x7f5cf00ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf5108640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5cf00b4560 0x7f5cf0147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf610a640 1 -- 172.21.15.1:0/3728362429 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5cf00b4560 msgr2=0x7f5cf0147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf610a640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5cf00b4560 0x7f5cf0147fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf610a640 1 -- 172.21.15.1:0/3728362429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf006d0d0 msgr2=0x7f5cf00ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf610a640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf006d0d0 0x7f5cf00ae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf610a640 1 -- 172.21.15.1:0/3728362429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf0070ae0 con 0x7f5cf0149450 2024-09-15T21:56:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf5909640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf006d0d0 0x7f5cf00ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf5108640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5cf00b4560 0x7f5cf0147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf610a640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5cf0149450 0x7f5cf01e40c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8007e60 tx=0x7f5ce800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5ce67fc640 1 -- 172.21.15.1:0/3728362429 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8014420 con 0x7f5cf0149450 2024-09-15T21:56:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5ce67fc640 1 -- 172.21.15.1:0/3728362429 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce8019070 con 0x7f5cf0149450 2024-09-15T21:56:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5ce67fc640 1 -- 172.21.15.1:0/3728362429 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8014820 con 0x7f5cf0149450 2024-09-15T21:56:23.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/3728362429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf01e3900 con 0x7f5cf0149450 2024-09-15T21:56:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/3728362429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf01e3ba0 con 0x7f5cf0149450 2024-09-15T21:56:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/3728362429 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf00b4940 con 0x7f5cf0149450 2024-09-15T21:56:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5ce67fc640 1 -- 172.21.15.1:0/3728362429 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ce80149c0 con 0x7f5cf0149450 2024-09-15T21:56:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5ce67fc640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5cd40678c0 0x7f5cd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5ce67fc640 1 -- 172.21.15.1:0/3728362429 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f5ce8086190 con 0x7f5cf0149450 2024-09-15T21:56:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf5909640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5cd40678c0 0x7f5cd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:23.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.068+0000 7f5cf5909640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5cd40678c0 0x7f5cd4069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00ad000 tx=0x7f5ce0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:23.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.072+0000 7f5ce67fc640 1 -- 172.21.15.1:0/3728362429 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5ce8057060 con 0x7f5cf0149450 2024-09-15T21:56:23.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/3728362429 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f5cf00aec70 con 0x7f5cd40678c0 2024-09-15T21:56:23.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5ce67fc640 1 -- 172.21.15.1:0/3728362429 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5cf00aec70 con 0x7f5cd40678c0 2024-09-15T21:56:23.240 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 7 to deep-scrub 2024-09-15T21:56:23.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/3728362429 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5cd40678c0 msgr2=0x7f5cd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:23.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5cf7b6d640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5cd40678c0 0x7f5cd4069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00ad000 tx=0x7f5ce0008040 comp rx=0 tx=0).stop 2024-09-15T21:56:23.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/3728362429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5cf0149450 msgr2=0x7f5cf01e40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:23.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5cf7b6d640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5cf0149450 0x7f5cf01e40c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8007e60 tx=0x7f5ce800e4b0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/3728362429 shutdown_connections 2024-09-15T21:56:23.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5cf7b6d640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5cf0149450 0x7f5cf01e40c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5cf7b6d640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5cf00b4560 0x7f5cf0147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5cf7b6d640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f5cd40678c0 0x7f5cd4069d80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5cf7b6d640 1 --2- 172.21.15.1:0/3728362429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cf006d0d0 0x7f5cf00ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/3728362429 >> 172.21.15.1:0/3728362429 conn(0x7f5cf006c730 msgr2=0x7f5cf009ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:23.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/3728362429 shutdown_connections 2024-09-15T21:56:23.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.232+0000 7f5cf7b6d640 1 -- 172.21.15.1:0/3728362429 wait complete. 2024-09-15T21:56:23.255 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:56:23.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe25d8c0640 1 Processor -- start 2024-09-15T21:56:23.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe25d8c0640 1 -- start start 2024-09-15T21:56:23.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe25d8c0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe2580b5220 0x7fe25809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:23.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe25d8c0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe2580b5600 0x7fe25809ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:23.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe25d8c0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe258148f20 0x7fe2581493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:23.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe25d8c0640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fe25809b800 con 0x7fe2580b5220 2024-09-15T21:56:23.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe25d8c0640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7fe2580b4dd0 con 0x7fe2580b5600 2024-09-15T21:56:23.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe25d8c0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe2581498f0 con 0x7fe258148f20 2024-09-15T21:56:23.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe256ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe2580b5220 0x7fe25809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:23.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe256ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe2580b5220 0x7fe25809aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39076/0 (socket says 172.21.15.1:39076) 2024-09-15T21:56:23.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe256ffd640 1 -- 172.21.15.1:0/3163269164 learned_addr learned my addr 172.21.15.1:0/3163269164 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:23.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe2567fc640 1 --2- 172.21.15.1:0/3163269164 >> v2:172.21.15.70:3300/0 conn(0x7fe2580b5600 0x7fe25809ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:23.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe2577fe640 1 --2- 172.21.15.1:0/3163269164 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe258148f20 0x7fe2581493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:23.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe256ffd640 1 -- 172.21.15.1:0/3163269164 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe258148f20 msgr2=0x7fe2581493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:23.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe256ffd640 1 --2- 172.21.15.1:0/3163269164 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe258148f20 0x7fe2581493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe256ffd640 1 -- 172.21.15.1:0/3163269164 >> v2:172.21.15.70:3300/0 conn(0x7fe2580b5600 msgr2=0x7fe25809ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:23.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe256ffd640 1 --2- 172.21.15.1:0/3163269164 >> v2:172.21.15.70:3300/0 conn(0x7fe2580b5600 0x7fe25809ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe256ffd640 1 -- 172.21.15.1:0/3163269164 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2580b6a50 con 0x7fe2580b5220 2024-09-15T21:56:23.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe2577fe640 1 --2- 172.21.15.1:0/3163269164 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe258148f20 0x7fe2581493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:23.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.364+0000 7fe2567fc640 1 --2- 172.21.15.1:0/3163269164 >> v2:172.21.15.70:3300/0 conn(0x7fe2580b5600 0x7fe25809ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe256ffd640 1 --2- 172.21.15.1:0/3163269164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2580b5220 0x7fe25809aa50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe25806e530 tx=0x7fe24801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1481f7f4ef746282 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe255ffb640 1 -- 172.21.15.1:0/3163269164 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2480b1070 con 0x7fe2580b5220 2024-09-15T21:56:23.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe255ffb640 1 -- 172.21.15.1:0/3163269164 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2480ac620 con 0x7fe2580b5220 2024-09-15T21:56:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe255ffb640 1 -- 172.21.15.1:0/3163269164 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2480ac9f0 con 0x7fe2580b5220 2024-09-15T21:56:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe25d8c0640 1 -- 172.21.15.1:0/3163269164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2580b5220 msgr2=0x7fe25809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe25d8c0640 1 --2- 172.21.15.1:0/3163269164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2580b5220 0x7fe25809aa50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe25806e530 tx=0x7fe24801c400 comp rx=0 tx=0).stop 2024-09-15T21:56:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe25d8c0640 1 -- 172.21.15.1:0/3163269164 shutdown_connections 2024-09-15T21:56:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe25d8c0640 1 --2- 172.21.15.1:0/3163269164 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe258148f20 0x7fe2581493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe25d8c0640 1 --2- 172.21.15.1:0/3163269164 >> v2:172.21.15.70:3300/0 conn(0x7fe2580b5600 0x7fe25809ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe25d8c0640 1 --2- 172.21.15.1:0/3163269164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2580b5220 0x7fe25809aa50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe25d8c0640 1 -- 172.21.15.1:0/3163269164 >> 172.21.15.1:0/3163269164 conn(0x7fe2580b5c40 msgr2=0x7fe2580b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:23.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe25d8c0640 1 -- 172.21.15.1:0/3163269164 shutdown_connections 2024-09-15T21:56:23.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe25d8c0640 1 -- 172.21.15.1:0/3163269164 wait complete. 2024-09-15T21:56:23.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe25d8c0640 1 Processor -- start 2024-09-15T21:56:23.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.368+0000 7fe25d8c0640 1 -- start start 2024-09-15T21:56:23.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe25d8c0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2580b5220 0x7fe258143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:23.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe25d8c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2580b5600 0x7fe258143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:23.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe25d8c0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe258148f20 0x7fe2580b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe25d8c0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe25809f4d0 con 0x7fe2580b5220 2024-09-15T21:56:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe25d8c0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe25809f350 con 0x7fe2580b5600 2024-09-15T21:56:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe25d8c0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fe2580b4350 con 0x7fe258148f20 2024-09-15T21:56:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe256ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2580b5220 0x7fe258143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe256ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2580b5220 0x7fe258143930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39088/0 (socket says 172.21.15.1:39088) 2024-09-15T21:56:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe256ffd640 1 -- 172.21.15.1:0/1212460998 learned_addr learned my addr 172.21.15.1:0/1212460998 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe2577fe640 1 --2- 172.21.15.1:0/1212460998 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe258148f20 0x7fe2580b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:23.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe256ffd640 1 -- 172.21.15.1:0/1212460998 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe258148f20 msgr2=0x7fe2580b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:23.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe256ffd640 1 --2- 172.21.15.1:0/1212460998 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe258148f20 0x7fe2580b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe256ffd640 1 -- 172.21.15.1:0/1212460998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2580b5600 msgr2=0x7fe258143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:23.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe256ffd640 1 --2- 172.21.15.1:0/1212460998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2580b5600 0x7fe258143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe256ffd640 1 -- 172.21.15.1:0/1212460998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2581452f0 con 0x7fe2580b5220 2024-09-15T21:56:23.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe256ffd640 1 --2- 172.21.15.1:0/1212460998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2580b5220 0x7fe258143930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe24801cca0 tx=0x7fe24801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:23.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe23ffff640 1 -- 172.21.15.1:0/1212460998 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2480bb020 con 0x7fe2580b5220 2024-09-15T21:56:23.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe23ffff640 1 -- 172.21.15.1:0/1212460998 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2480b7620 con 0x7fe2580b5220 2024-09-15T21:56:23.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe25d8c0640 1 -- 172.21.15.1:0/1212460998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2581e0820 con 0x7fe2580b5220 2024-09-15T21:56:23.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe23ffff640 1 -- 172.21.15.1:0/1212460998 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2480b1040 con 0x7fe2580b5220 2024-09-15T21:56:23.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe25d8c0640 1 -- 172.21.15.1:0/1212460998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2580af480 con 0x7fe2580b5220 2024-09-15T21:56:23.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe25d8c0640 1 -- 172.21.15.1:0/1212460998 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2580b46e0 con 0x7fe2580b5220 2024-09-15T21:56:23.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe23ffff640 1 -- 172.21.15.1:0/1212460998 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe2480be020 con 0x7fe2580b5220 2024-09-15T21:56:23.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe23ffff640 1 --2- 172.21.15.1:0/1212460998 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe2440678f0 0x7fe244069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:23.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe23ffff640 1 -- 172.21.15.1:0/1212460998 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7fe24811fcd0 con 0x7fe2580b5220 2024-09-15T21:56:23.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe2567fc640 1 --2- 172.21.15.1:0/1212460998 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe2440678f0 0x7fe244069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:23.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.372+0000 7fe2567fc640 1 --2- 172.21.15.1:0/1212460998 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe2440678f0 0x7fe244069db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe2580afb10 tx=0x7fe24c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:23.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.376+0000 7fe23ffff640 1 -- 172.21.15.1:0/1212460998 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe2480c5030 con 0x7fe2580b5220 2024-09-15T21:56:23.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.528+0000 7fe25d8c0640 1 -- 172.21.15.1:0/1212460998 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe258075af0 con 0x7fe2440678f0 2024-09-15T21:56:23.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.528+0000 7fe23ffff640 1 -- 172.21.15.1:0/1212460998 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13461 (secure 0 0 0) 0x7fe258075af0 con 0x7fe2440678f0 2024-09-15T21:56:23.536 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:23.536 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:56:23.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.532+0000 7fe25d8c0640 1 -- 172.21.15.1:0/1212460998 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe2440678f0 msgr2=0x7fe244069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:23.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.532+0000 7fe25d8c0640 1 --2- 172.21.15.1:0/1212460998 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe2440678f0 0x7fe244069db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe2580afb10 tx=0x7fe24c008040 comp rx=0 tx=0).stop 2024-09-15T21:56:23.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.532+0000 7fe25d8c0640 1 -- 172.21.15.1:0/1212460998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2580b5220 msgr2=0x7fe258143930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:23.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.532+0000 7fe25d8c0640 1 --2- 172.21.15.1:0/1212460998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2580b5220 0x7fe258143930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe24801cca0 tx=0x7fe24801ac40 comp rx=0 tx=0).stop 2024-09-15T21:56:23.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.532+0000 7fe25d8c0640 1 -- 172.21.15.1:0/1212460998 shutdown_connections 2024-09-15T21:56:23.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.532+0000 7fe25d8c0640 1 --2- 172.21.15.1:0/1212460998 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe258148f20 0x7fe2580b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.532+0000 7fe25d8c0640 1 --2- 172.21.15.1:0/1212460998 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fe2440678f0 0x7fe244069db0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.532+0000 7fe25d8c0640 1 --2- 172.21.15.1:0/1212460998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2580b5600 0x7fe258143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.532+0000 7fe25d8c0640 1 --2- 172.21.15.1:0/1212460998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2580b5220 0x7fe258143930 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:23.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.532+0000 7fe25d8c0640 1 -- 172.21.15.1:0/1212460998 >> 172.21.15.1:0/1212460998 conn(0x7fe2580b5c40 msgr2=0x7fe25806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:23.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.532+0000 7fe25d8c0640 1 -- 172.21.15.1:0/1212460998 shutdown_connections 2024-09-15T21:56:23.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:23.532+0000 7fe25d8c0640 1 -- 172.21.15.1:0/1212460998 wait complete. 2024-09-15T21:56:23.553 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-09-15T21:56:23.096320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":261916,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754712804,"statfs":{"total":773094113280,"available":772825911296,"internally_reserved":0,"allocated":4169728,"data_stored":2328528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.557102"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T21:56:16.297677+0000","last_change":"2024-09-15T21:55:10.853584+0000","last_active":"2024-09-15T21:56:16.297677+0000","last_peered":"2024-09-15T21:56:16.297677+0000","last_clean":"2024-09-15T21:56:16.297677+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:56:16.297677+0000","last_undegraded":"2024-09-15T21:56:16.297677+0000","last_fullsized":"2024-09-15T21:56:16.297677+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T21:55:09.634324+0000","last_clean_scrub_stamp":"2024-09-15T21:55:09.634324+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:33.604358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":372736,"data_stored":143474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":372736,"data_stored":143474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":372736,"data_stored":143474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":372736,"data_stored":143474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31552,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":372736,"data_stored":143474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":966656,"data_stored":733842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":966656,"data_stored":733842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35712,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336128,"statfs":{"total":96636764160,"available":96600195072,"internally_reserved":0,"allocated":372736,"data_stored":143474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:56:23.555 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-15T21:55:09.634324+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=21, tm_min=55, tm_sec=9, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=21, tm_min=56, tm_sec=18, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T21:56:23.556 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T21:56:43.557 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T21:56:43.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff485331640 1 Processor -- start 2024-09-15T21:56:43.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff485331640 1 -- start start 2024-09-15T21:56:43.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff485331640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4800ae3a0 0x7ff48009eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:43.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff485331640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff4800af160 0x7ff48014eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:43.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff485331640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4800b00f0 con 0x7ff4800b4c50 2024-09-15T21:56:43.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff485331640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7ff4800afe10 con 0x7ff4800af160 2024-09-15T21:56:43.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff485331640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 -- 0x7ff4800b50e0 con 0x7ff4800ae3a0 2024-09-15T21:56:43.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff47e7fc640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff4800b4c50 0x7ff480147ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:40038/0 (socket says 172.21.15.1:40038) 2024-09-15T21:56:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff47e7fc640 1 -- 172.21.15.1:0/3063864856 learned_addr learned my addr 172.21.15.1:0/3063864856 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff47f7fe640 1 --2- 172.21.15.1:0/3063864856 >> v2:172.21.15.1:3300/0 conn(0x7ff4800af160 0x7ff48014eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff47effd640 1 --2- 172.21.15.1:0/3063864856 >> v2:172.21.15.70:3300/0 conn(0x7ff4800ae3a0 0x7ff48009eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff47dffb640 1 -- 172.21.15.1:0/3063864856 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720643236 0 0) 0x7ff4800b00f0 con 0x7ff4800b4c50 2024-09-15T21:56:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff47dffb640 1 -- 172.21.15.1:0/3063864856 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff468005740 con 0x7ff4800b4c50 2024-09-15T21:56:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff47f7fe640 1 -- 172.21.15.1:0/3063864856 >> v2:172.21.15.70:3300/0 conn(0x7ff4800ae3a0 msgr2=0x7ff48009eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff47f7fe640 1 --2- 172.21.15.1:0/3063864856 >> v2:172.21.15.70:3300/0 conn(0x7ff4800ae3a0 0x7ff48009eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff47f7fe640 1 -- 172.21.15.1:0/3063864856 >> v1:172.21.15.1:6789/0 conn(0x7ff4800b4c50 legacy=0x7ff480147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff47f7fe640 1 -- 172.21.15.1:0/3063864856 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4800b53c0 con 0x7ff4800af160 2024-09-15T21:56:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.691+0000 7ff47effd640 1 --2- 172.21.15.1:0/3063864856 >> v2:172.21.15.70:3300/0 conn(0x7ff4800ae3a0 0x7ff48009eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T21:56:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47f7fe640 1 --2- 172.21.15.1:0/3063864856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4800af160 0x7ff48014eed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff48006cac0 tx=0x7ff47801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94b30af09aafb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47dffb640 1 -- 172.21.15.1:0/3063864856 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4780b2070 con 0x7ff4800af160 2024-09-15T21:56:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47dffb640 1 -- 172.21.15.1:0/3063864856 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4780a5850 con 0x7ff4800af160 2024-09-15T21:56:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47dffb640 1 -- 172.21.15.1:0/3063864856 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4780a5c20 con 0x7ff4800af160 2024-09-15T21:56:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 -- 172.21.15.1:0/3063864856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4800af160 msgr2=0x7ff48014eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 --2- 172.21.15.1:0/3063864856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4800af160 0x7ff48014eed0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff48006cac0 tx=0x7ff47801c870 comp rx=0 tx=0).stop 2024-09-15T21:56:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 -- 172.21.15.1:0/3063864856 shutdown_connections 2024-09-15T21:56:43.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 --2- 172.21.15.1:0/3063864856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4800af160 0x7ff48014eed0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 --2- 172.21.15.1:0/3063864856 >> v2:172.21.15.70:3300/0 conn(0x7ff4800ae3a0 0x7ff48009eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 -- 172.21.15.1:0/3063864856 >> 172.21.15.1:0/3063864856 conn(0x7ff4800b5c40 msgr2=0x7ff4800b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 -- 172.21.15.1:0/3063864856 shutdown_connections 2024-09-15T21:56:43.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 -- 172.21.15.1:0/3063864856 wait complete. 2024-09-15T21:56:43.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 Processor -- start 2024-09-15T21:56:43.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 -- start start 2024-09-15T21:56:43.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4800ae3a0 0x7ff4801e40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:43.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4800af160 0x7ff4801e47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:43.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4800b0660 0x7ff4801412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:43.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff4800b46e0 con 0x7ff4800b0660 2024-09-15T21:56:43.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff4800b4560 con 0x7ff4800af160 2024-09-15T21:56:43.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff485331640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7ff4800b4860 con 0x7ff4800ae3a0 2024-09-15T21:56:43.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4800b0660 0x7ff4801412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:43.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4800b0660 0x7ff4801412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43670/0 (socket says 172.21.15.1:43670) 2024-09-15T21:56:43.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47f7fe640 1 -- 172.21.15.1:0/887132200 learned_addr learned my addr 172.21.15.1:0/887132200 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:43.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47effd640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4800ae3a0 0x7ff4801e40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:43.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47e7fc640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4800af160 0x7ff4801e47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:43.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47f7fe640 1 -- 172.21.15.1:0/887132200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4800ae3a0 msgr2=0x7ff4801e40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:43.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47f7fe640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4800ae3a0 0x7ff4801e40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:43.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47f7fe640 1 -- 172.21.15.1:0/887132200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4800af160 msgr2=0x7ff4801e47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:43.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47f7fe640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4800af160 0x7ff4801e47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:43.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47f7fe640 1 -- 172.21.15.1:0/887132200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4801e4d30 con 0x7ff4800b0660 2024-09-15T21:56:43.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.695+0000 7ff47f7fe640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4800b0660 0x7ff4801412e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff4780b0040 tx=0x7ff478019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:43.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.699+0000 7ff4677fe640 1 -- 172.21.15.1:0/887132200 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4780b2050 con 0x7ff4800b0660 2024-09-15T21:56:43.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.699+0000 7ff4677fe640 1 -- 172.21.15.1:0/887132200 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4780be070 con 0x7ff4800b0660 2024-09-15T21:56:43.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.699+0000 7ff485331640 1 -- 172.21.15.1:0/887132200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4800732f0 con 0x7ff4800b0660 2024-09-15T21:56:43.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.699+0000 7ff4677fe640 1 -- 172.21.15.1:0/887132200 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4780ad870 con 0x7ff4800b0660 2024-09-15T21:56:43.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.699+0000 7ff485331640 1 -- 172.21.15.1:0/887132200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff480072000 con 0x7ff4800b0660 2024-09-15T21:56:43.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.699+0000 7ff485331640 1 -- 172.21.15.1:0/887132200 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48009eb50 con 0x7ff4800b0660 2024-09-15T21:56:43.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.699+0000 7ff4677fe640 1 -- 172.21.15.1:0/887132200 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff4780ada10 con 0x7ff4800b0660 2024-09-15T21:56:43.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.699+0000 7ff4677fe640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff46c0678c0 0x7ff46c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:43.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.699+0000 7ff4677fe640 1 -- 172.21.15.1:0/887132200 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7ff4781209a0 con 0x7ff4800b0660 2024-09-15T21:56:43.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.699+0000 7ff47effd640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff46c0678c0 0x7ff46c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:43.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.699+0000 7ff47effd640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff46c0678c0 0x7ff46c069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff47000b930 tx=0x7ff470008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:43.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.703+0000 7ff4677fe640 1 -- 172.21.15.1:0/887132200 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff478016520 con 0x7ff4800b0660 2024-09-15T21:56:43.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff485331640 1 -- 172.21.15.1:0/887132200 --> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4800b7ac0 con 0x7ff46c0678c0 2024-09-15T21:56:43.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff4677fe640 1 -- 172.21.15.1:0/887132200 <== mgr.4098 v2:172.21.15.1:6808/1604983224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13354 (secure 0 0 0) 0x7ff4800b7ac0 con 0x7ff46c0678c0 2024-09-15T21:56:43.866 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:43.866 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-15T21:56:43.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff485331640 1 -- 172.21.15.1:0/887132200 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff46c0678c0 msgr2=0x7ff46c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:43.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff485331640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff46c0678c0 0x7ff46c069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff47000b930 tx=0x7ff470008040 comp rx=0 tx=0).stop 2024-09-15T21:56:43.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff485331640 1 -- 172.21.15.1:0/887132200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4800b0660 msgr2=0x7ff4801412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:43.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff485331640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4800b0660 0x7ff4801412e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff4780b0040 tx=0x7ff478019610 comp rx=0 tx=0).stop 2024-09-15T21:56:43.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff485331640 1 -- 172.21.15.1:0/887132200 shutdown_connections 2024-09-15T21:56:43.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff485331640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4800b0660 0x7ff4801412e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:43.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff485331640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7ff46c0678c0 0x7ff46c069d80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:43.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff485331640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4800af160 0x7ff4801e47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:43.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff485331640 1 --2- 172.21.15.1:0/887132200 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4800ae3a0 0x7ff4801e40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:43.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff485331640 1 -- 172.21.15.1:0/887132200 >> 172.21.15.1:0/887132200 conn(0x7ff4800b5c40 msgr2=0x7ff48009dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:43.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff485331640 1 -- 172.21.15.1:0/887132200 shutdown_connections 2024-09-15T21:56:43.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:43.863+0000 7ff485331640 1 -- 172.21.15.1:0/887132200 wait complete. 2024-09-15T21:56:43.883 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-09-15T21:56:43.101326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":261904,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754712816,"statfs":{"total":773094113280,"available":772825923584,"internally_reserved":0,"allocated":4169728,"data_stored":2328528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003141"},"pg_stats":[{"pgid":"1.0","version":"33'119","reported_seq":204,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T21:56:23.775080+0000","last_change":"2024-09-15T21:56:23.775162+0000","last_active":"2024-09-15T21:56:23.775080+0000","last_peered":"2024-09-15T21:56:23.775080+0000","last_clean":"2024-09-15T21:56:23.775080+0000","last_became_active":"2024-09-15T21:55:10.851653+0000","last_became_peered":"2024-09-15T21:55:10.851653+0000","last_unstale":"2024-09-15T21:56:23.775080+0000","last_undegraded":"2024-09-15T21:56:23.775080+0000","last_fullsized":"2024-09-15T21:56:23.775080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-15T21:56:23.774892+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-15T21:56:23.774892+0000","last_clean_scrub_stamp":"2024-09-15T21:56:23.774892+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:39.979598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":372736,"data_stored":143474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":372736,"data_stored":143474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":372736,"data_stored":143474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31556,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":372736,"data_stored":143474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31552,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":372736,"data_stored":143474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335552,"statfs":{"total":96636764160,"available":96599605248,"internally_reserved":0,"allocated":966656,"data_stored":733842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":966656,"data_stored":733842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35712,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336128,"statfs":{"total":96636764160,"available":96600195072,"internally_reserved":0,"allocated":372736,"data_stored":143474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T21:56:43.884 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-15T21:56:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1291912640 1 Processor -- start 2024-09-15T21:56:44.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1291912640 1 -- start start 2024-09-15T21:56:44.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1291912640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c14faf0 0x7f128c14ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1291912640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128c0ae290 con 0x7f128c06d330 2024-09-15T21:56:44.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1291912640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128c06d710 con 0x7f128c150470 2024-09-15T21:56:44.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1291912640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f128c0b00b0 con 0x7f128c14faf0 2024-09-15T21:56:44.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f128affd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f128c06d330 0x7f128c0aee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:40052/0 (socket says 172.21.15.1:40052) 2024-09-15T21:56:44.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f128affd640 1 -- 172.21.15.1:0/4233673014 learned_addr learned my addr 172.21.15.1:0/4233673014 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-09-15T21:56:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f128a7fc640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c14faf0 0x7f128c14ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041800091 0 0) 0x7f127c001120 con 0x7f128c06d330 2024-09-15T21:56:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1274003530 con 0x7f128c06d330 2024-09-15T21:56:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149232713 0 0) 0x7f128c06d710 con 0x7f128c150470 2024-09-15T21:56:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f127c001120 con 0x7f128c150470 2024-09-15T21:56:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1546541340 0 0) 0x7f1274003530 con 0x7f128c06d330 2024-09-15T21:56:44.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c14faf0 msgr2=0x7f128c14ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:44.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c14faf0 0x7f128c14ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 >> v1:172.21.15.70:6789/0 conn(0x7f128c150470 legacy=0x7f128c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:44.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128c1508e0 con 0x7f128c06d330 2024-09-15T21:56:44.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1481823461 0 0) 0x7f127c001850 con 0x7f128c06d330 2024-09-15T21:56:44.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 >> v1:172.21.15.1:6789/0 conn(0x7f128c06d330 legacy=0x7f128c0aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:44.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1274003b80 0x7f1274003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c14faf0 0x7f1274004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1274004d50 0x7f12740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f128c0b00b0 con 0x7f1274003b80 2024-09-15T21:56:44.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f127400bbc0 con 0x7f1274004d50 2024-09-15T21:56:44.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f127400bdc0 con 0x7f128c14faf0 2024-09-15T21:56:44.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f128affd640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1274003b80 0x7f1274003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f128a7fc640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c14faf0 0x7f1274004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f128b7fe640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1274004d50 0x7f12740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f128affd640 1 -- 172.21.15.1:0/4233673014 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c14faf0 msgr2=0x7f1274004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:44.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f128affd640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c14faf0 0x7f1274004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f128affd640 1 -- 172.21.15.1:0/4233673014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1274004d50 msgr2=0x7f12740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f128affd640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1274004d50 0x7f12740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f128affd640 1 -- 172.21.15.1:0/4233673014 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1274003530 con 0x7f1274003b80 2024-09-15T21:56:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f128b7fe640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1274004d50 0x7f12740051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:44.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.007+0000 7f128a7fc640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c14faf0 0x7f1274004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:44.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f128affd640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1274003b80 0x7f1274003f80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c4c0 tx=0x7f127c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213b873491659810 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c00c0e0 con 0x7f1274003b80 2024-09-15T21:56:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127c0a9020 con 0x7f1274003b80 2024-09-15T21:56:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1289ffb640 1 -- 172.21.15.1:0/4233673014 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c0a5b20 con 0x7f1274003b80 2024-09-15T21:56:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 -- 172.21.15.1:0/4233673014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1274003b80 msgr2=0x7f1274003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 --2- 172.21.15.1:0/4233673014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1274003b80 0x7f1274003f80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f127c00c4c0 tx=0x7f127c01cc20 comp rx=0 tx=0).stop 2024-09-15T21:56:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f128b7fe640 1 -- 172.21.15.1:0/4233673014 reap_dead start 2024-09-15T21:56:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 -- 172.21.15.1:0/4233673014 shutdown_connections 2024-09-15T21:56:44.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 -- 172.21.15.1:0/4233673014 >> 172.21.15.1:0/4233673014 conn(0x7f128c06c730 msgr2=0x7f128c0b90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:44.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 -- 172.21.15.1:0/4233673014 shutdown_connections 2024-09-15T21:56:44.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 -- 172.21.15.1:0/4233673014 wait complete. 2024-09-15T21:56:44.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 Processor -- start 2024-09-15T21:56:44.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 -- start start 2024-09-15T21:56:44.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1274003b80 0x7f128c0b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c1e49f0 0x7f128c0729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f128c1e4e70 0x7f128c072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f128c0b5640 con 0x7f1274003b80 2024-09-15T21:56:44.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f128c0b57c0 con 0x7f128c1e4e70 2024-09-15T21:56:44.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.011+0000 7f1291912640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7f128c0b3ce0 con 0x7f128c1e49f0 2024-09-15T21:56:44.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1274003b80 0x7f128c0b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1274003b80 0x7f128c0b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43690/0 (socket says 172.21.15.1:43690) 2024-09-15T21:56:44.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128affd640 1 -- 172.21.15.1:0/3698401213 learned_addr learned my addr 172.21.15.1:0/3698401213 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:44.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128a7fc640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c1e49f0 0x7f128c0729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128b7fe640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f128c1e4e70 0x7f128c072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128affd640 1 -- 172.21.15.1:0/3698401213 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c1e49f0 msgr2=0x7f128c0729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:44.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128affd640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c1e49f0 0x7f128c0729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128affd640 1 -- 172.21.15.1:0/3698401213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f128c1e4e70 msgr2=0x7f128c072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:44.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128affd640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f128c1e4e70 0x7f128c072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128affd640 1 -- 172.21.15.1:0/3698401213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128c0b0890 con 0x7f1274003b80 2024-09-15T21:56:44.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128b7fe640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f128c1e4e70 0x7f128c072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:44.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128affd640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1274003b80 0x7f128c0b18a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f127c0ab040 tx=0x7f1274005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:44.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f1273fff640 1 -- 172.21.15.1:0/3698401213 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c0a6c70 con 0x7f1274003b80 2024-09-15T21:56:44.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f1273fff640 1 -- 172.21.15.1:0/3698401213 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127c0a6e10 con 0x7f1274003b80 2024-09-15T21:56:44.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f1291912640 1 -- 172.21.15.1:0/3698401213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128c0b0b70 con 0x7f1274003b80 2024-09-15T21:56:44.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f1273fff640 1 -- 172.21.15.1:0/3698401213 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c0049f0 con 0x7f1274003b80 2024-09-15T21:56:44.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f1291912640 1 -- 172.21.15.1:0/3698401213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f128c0704b0 con 0x7f1274003b80 2024-09-15T21:56:44.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f1291912640 1 -- 172.21.15.1:0/3698401213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f128c0aede0 con 0x7f1274003b80 2024-09-15T21:56:44.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f1273fff640 1 -- 172.21.15.1:0/3698401213 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f127c004b90 con 0x7f1274003b80 2024-09-15T21:56:44.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f1273fff640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f12780678f0 0x7f1278069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f1273fff640 1 -- 172.21.15.1:0/3698401213 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7f127c11ec30 con 0x7f1274003b80 2024-09-15T21:56:44.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128a7fc640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f12780678f0 0x7f1278069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.015+0000 7f128a7fc640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f12780678f0 0x7f1278069db0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f128c1e9020 tx=0x7f128000d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:44.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.019+0000 7f1273fff640 1 -- 172.21.15.1:0/3698401213 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f128c0ae290 con 0x7f1274003b80 2024-09-15T21:56:44.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.187+0000 7f1291912640 1 -- 172.21.15.1:0/3698401213 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f128c0b5120 con 0x7f1274003b80 2024-09-15T21:56:44.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.191+0000 7f1273fff640 1 -- 172.21.15.1:0/3698401213 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f127c0efb80 con 0x7f1274003b80 2024-09-15T21:56:44.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.191+0000 7f1273fff640 1 -- 172.21.15.1:0/3698401213 <== mon.0 v2:172.21.15.1:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f127c0a90c0 con 0x7f1274003b80 2024-09-15T21:56:44.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.195+0000 7f1291912640 1 -- 172.21.15.1:0/3698401213 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f12780678f0 msgr2=0x7f1278069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:44.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.195+0000 7f1291912640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f12780678f0 0x7f1278069db0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f128c1e9020 tx=0x7f128000d040 comp rx=0 tx=0).stop 2024-09-15T21:56:44.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.195+0000 7f1291912640 1 -- 172.21.15.1:0/3698401213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1274003b80 msgr2=0x7f128c0b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:44.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.195+0000 7f1291912640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1274003b80 0x7f128c0b18a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f127c0ab040 tx=0x7f1274005840 comp rx=0 tx=0).stop 2024-09-15T21:56:44.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.195+0000 7f1291912640 1 -- 172.21.15.1:0/3698401213 shutdown_connections 2024-09-15T21:56:44.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.195+0000 7f1291912640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7f12780678f0 0x7f1278069db0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.195+0000 7f1291912640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f128c1e4e70 0x7f128c072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.195+0000 7f1291912640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f128c1e49f0 0x7f128c0729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.195+0000 7f1291912640 1 --2- 172.21.15.1:0/3698401213 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1274003b80 0x7f128c0b18a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.195+0000 7f1291912640 1 -- 172.21.15.1:0/3698401213 >> 172.21.15.1:0/3698401213 conn(0x7f128c06c730 msgr2=0x7f128c09c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:44.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.195+0000 7f1291912640 1 -- 172.21.15.1:0/3698401213 shutdown_connections 2024-09-15T21:56:44.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.195+0000 7f1291912640 1 -- 172.21.15.1:0/3698401213 wait complete. 2024-09-15T21:56:44.214 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T21:56:44.215 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T21:56:44.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.339+0000 7fa3e39cd640 1 Processor -- start 2024-09-15T21:56:44.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.339+0000 7fa3e39cd640 1 -- start start 2024-09-15T21:56:44.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.339+0000 7fa3e39cd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3dc147bd0 0x7fa3dc148030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.339+0000 7fa3e39cd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa3dc150110 0x7fa3dc152500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.339+0000 7fa3e39cd640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3dc148570 con 0x7fa3dc06bf20 2024-09-15T21:56:44.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.339+0000 7fa3e39cd640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fa3dc0b6670 con 0x7fa3dc150110 2024-09-15T21:56:44.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.339+0000 7fa3e39cd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa3dc06c300 con 0x7fa3dc147bd0 2024-09-15T21:56:44.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.339+0000 7fa3e1f6a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa3dc150110 0x7fa3dc152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.339+0000 7fa3e1f6a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa3dc150110 0x7fa3dc152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43700/0 (socket says 172.21.15.1:43700) 2024-09-15T21:56:44.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.339+0000 7fa3e1f6a640 1 -- 172.21.15.1:0/4121597116 learned_addr learned my addr 172.21.15.1:0/4121597116 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:44.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e0f68640 1 --2- 172.21.15.1:0/4121597116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3dc147bd0 0x7fa3dc148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e1f6a640 1 -- 172.21.15.1:0/4121597116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3dc147bd0 msgr2=0x7fa3dc148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:44.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e1f6a640 1 --2- 172.21.15.1:0/4121597116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3dc147bd0 0x7fa3dc148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e1f6a640 1 -- 172.21.15.1:0/4121597116 >> v1:172.21.15.70:6789/0 conn(0x7fa3dc06bf20 legacy=0x7fa3dc141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T21:56:44.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e1f6a640 1 -- 172.21.15.1:0/4121597116 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3dc0afa00 con 0x7fa3dc150110 2024-09-15T21:56:44.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e1f6a640 1 --2- 172.21.15.1:0/4121597116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3dc150110 0x7fa3dc152500 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009870 tx=0x7fa3d401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5941838253765d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:44.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3d3fff640 1 -- 172.21.15.1:0/4121597116 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40b0070 con 0x7fa3dc150110 2024-09-15T21:56:44.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3d3fff640 1 -- 172.21.15.1:0/4121597116 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa3d40ab600 con 0x7fa3dc150110 2024-09-15T21:56:44.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3d3fff640 1 -- 172.21.15.1:0/4121597116 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40ab9f0 con 0x7fa3dc150110 2024-09-15T21:56:44.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e39cd640 1 -- 172.21.15.1:0/4121597116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3dc150110 msgr2=0x7fa3dc152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:44.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e39cd640 1 --2- 172.21.15.1:0/4121597116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3dc150110 0x7fa3dc152500 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009870 tx=0x7fa3d401c490 comp rx=0 tx=0).stop 2024-09-15T21:56:44.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e39cd640 1 -- 172.21.15.1:0/4121597116 shutdown_connections 2024-09-15T21:56:44.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e39cd640 1 --2- 172.21.15.1:0/4121597116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3dc150110 0x7fa3dc152500 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e39cd640 1 --2- 172.21.15.1:0/4121597116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3dc147bd0 0x7fa3dc148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e39cd640 1 -- 172.21.15.1:0/4121597116 >> 172.21.15.1:0/4121597116 conn(0x7fa3dc0b6e30 msgr2=0x7fa3dc0b7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:44.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e39cd640 1 -- 172.21.15.1:0/4121597116 shutdown_connections 2024-09-15T21:56:44.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.343+0000 7fa3e39cd640 1 -- 172.21.15.1:0/4121597116 wait complete. 2024-09-15T21:56:44.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e39cd640 1 Processor -- start 2024-09-15T21:56:44.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e39cd640 1 -- start start 2024-09-15T21:56:44.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e39cd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3dc06bf20 0x7fa3dc09fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e39cd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3dc147bd0 0x7fa3dc1e3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e39cd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3dc150110 0x7fa3dc09d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e39cd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc06cb80 con 0x7fa3dc147bd0 2024-09-15T21:56:44.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e39cd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc06ca00 con 0x7fa3dc150110 2024-09-15T21:56:44.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e39cd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 -- 0x7fa3dc155260 con 0x7fa3dc06bf20 2024-09-15T21:56:44.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e0f68640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3dc147bd0 0x7fa3dc1e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e0f68640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3dc147bd0 0x7fa3dc1e3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43714/0 (socket says 172.21.15.1:43714) 2024-09-15T21:56:44.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e0f68640 1 -- 172.21.15.1:0/2913801058 learned_addr learned my addr 172.21.15.1:0/2913801058 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-15T21:56:44.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e0f68640 1 -- 172.21.15.1:0/2913801058 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3dc06bf20 msgr2=0x7fa3dc09fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:44.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e1f6a640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3dc150110 0x7fa3dc09d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e1769640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3dc06bf20 0x7fa3dc09fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e0f68640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3dc06bf20 0x7fa3dc09fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e0f68640 1 -- 172.21.15.1:0/2913801058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3dc150110 msgr2=0x7fa3dc09d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:44.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e0f68640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3dc150110 0x7fa3dc09d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e0f68640 1 -- 172.21.15.1:0/2913801058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3dc143430 con 0x7fa3dc147bd0 2024-09-15T21:56:44.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e1f6a640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3dc150110 0x7fa3dc09d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:44.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e1769640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3dc06bf20 0x7fa3dc09fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T21:56:44.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e0f68640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3dc147bd0 0x7fa3dc1e3650 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00d830 tx=0x7fa3cc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:44.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3d1ffb640 1 -- 172.21.15.1:0/2913801058 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00b6c0 con 0x7fa3dc147bd0 2024-09-15T21:56:44.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3d1ffb640 1 -- 172.21.15.1:0/2913801058 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa3cc019070 con 0x7fa3dc147bd0 2024-09-15T21:56:44.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e39cd640 1 -- 172.21.15.1:0/2913801058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3dc143710 con 0x7fa3dc147bd0 2024-09-15T21:56:44.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3d1ffb640 1 -- 172.21.15.1:0/2913801058 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00ba80 con 0x7fa3dc147bd0 2024-09-15T21:56:44.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e39cd640 1 -- 172.21.15.1:0/2913801058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3dc073330 con 0x7fa3dc147bd0 2024-09-15T21:56:44.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3e39cd640 1 -- 172.21.15.1:0/2913801058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3dc148030 con 0x7fa3dc147bd0 2024-09-15T21:56:44.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3d1ffb640 1 -- 172.21.15.1:0/2913801058 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3cc01e460 con 0x7fa3dc147bd0 2024-09-15T21:56:44.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.347+0000 7fa3d1ffb640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa3c00678c0 0x7fa3c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T21:56:44.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.351+0000 7fa3d1ffb640 1 -- 172.21.15.1:0/2913801058 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4943+0+0 (secure 0 0 0) 0x7fa3cc086170 con 0x7fa3dc147bd0 2024-09-15T21:56:44.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.351+0000 7fa3e1769640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa3c00678c0 0x7fa3c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T21:56:44.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.351+0000 7fa3e1769640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa3c00678c0 0x7fa3c0069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8007fd0 tx=0x7fa3d8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T21:56:44.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.355+0000 7fa3d1ffb640 1 -- 172.21.15.1:0/2913801058 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa3cc056f20 con 0x7fa3dc147bd0 2024-09-15T21:56:44.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3e39cd640 1 -- 172.21.15.1:0/2913801058 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3dc1420f0 con 0x7fa3dc147bd0 2024-09-15T21:56:44.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3d1ffb640 1 -- 172.21.15.1:0/2913801058 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+2258 (secure 0 0 0) 0x7fa3cc056820 con 0x7fa3dc147bd0 2024-09-15T21:56:44.554 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-15T21:56:44.554 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-15T21:56:13:526240+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/3285517009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":3285517009},{"type":"v1","addr":"172.21.15.70:6833","nonce":3285517009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/2412883370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":2412883370},{"type":"v1","addr":"172.21.15.1:6835","nonce":2412883370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-09-15T21:56:44.554 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-15T21:56:44.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3e39cd640 1 -- 172.21.15.1:0/2913801058 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa3c00678c0 msgr2=0x7fa3c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:44.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3e39cd640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa3c00678c0 0x7fa3c0069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8007fd0 tx=0x7fa3d8009040 comp rx=0 tx=0).stop 2024-09-15T21:56:44.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3e39cd640 1 -- 172.21.15.1:0/2913801058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3dc147bd0 msgr2=0x7fa3dc1e3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T21:56:44.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3e39cd640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3dc147bd0 0x7fa3dc1e3650 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00d830 tx=0x7fa3cc00dcf0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3e39cd640 1 -- 172.21.15.1:0/2913801058 shutdown_connections 2024-09-15T21:56:44.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3e39cd640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.1:6808/1604983224,v1:172.21.15.1:6809/1604983224] conn(0x7fa3c00678c0 0x7fa3c0069d80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3e39cd640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3dc150110 0x7fa3dc09d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3e39cd640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa3dc147bd0 0x7fa3dc1e3650 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3e39cd640 1 --2- 172.21.15.1:0/2913801058 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa3dc06bf20 0x7fa3dc09fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T21:56:44.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3e39cd640 1 -- 172.21.15.1:0/2913801058 >> 172.21.15.1:0/2913801058 conn(0x7fa3dc0b6e30 msgr2=0x7fa3dc0b8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T21:56:44.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3e39cd640 1 -- 172.21.15.1:0/2913801058 shutdown_connections 2024-09-15T21:56:44.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-15T21:56:44.551+0000 7fa3e39cd640 1 -- 172.21.15.1:0/2913801058 wait complete. 2024-09-15T21:56:44.571 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-15T21:56:44.571 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-15T21:56:44.572 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T21:56:44.572 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:44.582 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T21:56:44.583 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T21:56:44.583 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:44.601 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T21:56:44.601 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-15T21:56:44.602 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-15T21:56:44.602 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:48.271 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T21:56:48.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T21:56:49.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-15T21:56:50.704 INFO:tasks.ceph.osd.0:Stopped 2024-09-15T21:56:50.705 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-15T21:56:50.705 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:50.775 INFO:tasks.ceph.osd.1:Stopped 2024-09-15T21:56:50.775 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-15T21:56:50.775 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:50.866 INFO:tasks.ceph.osd.2:Stopped 2024-09-15T21:56:50.866 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-15T21:56:50.867 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:50.943 INFO:tasks.ceph.osd.3:Stopped 2024-09-15T21:56:50.943 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-15T21:56:50.943 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:51.033 INFO:tasks.ceph.osd.4:Stopped 2024-09-15T21:56:51.034 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-15T21:56:51.034 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:51.117 INFO:tasks.ceph.osd.5:Stopped 2024-09-15T21:56:51.117 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-15T21:56:51.117 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:51.187 INFO:tasks.ceph.osd.6:Stopped 2024-09-15T21:56:51.188 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-15T21:56:51.188 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:51.254 INFO:tasks.ceph.osd.7:Stopped 2024-09-15T21:56:51.254 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-15T21:56:51.254 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-15T21:56:51.254 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:51.285 INFO:tasks.ceph.mgr.y:Stopped 2024-09-15T21:56:51.285 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-15T21:56:51.285 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:51.312 INFO:tasks.ceph.mgr.x:Stopped 2024-09-15T21:56:51.312 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-15T21:56:51.313 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-15T21:56:51.313 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:51.343 INFO:tasks.ceph.mon.a:Stopped 2024-09-15T21:56:51.343 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-15T21:56:51.343 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:51.372 INFO:tasks.ceph.mon.b:Stopped 2024-09-15T21:56:51.372 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-15T21:56:51.372 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T21:56:51.432 INFO:tasks.ceph.mon.c:Stopped 2024-09-15T21:56:51.433 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-15T21:56:51.433 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-15T21:56:51.452 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T21:56:51.452 DEBUG:teuthology.orchestra.run.smithi001:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-15T21:56:51.756 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T21:56:51.757 DEBUG:teuthology.orchestra.run.smithi001:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-15T21:56:52.005 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T21:56:52.005 DEBUG:teuthology.orchestra.run.smithi001:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-15T21:56:52.196 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T21:56:52.197 DEBUG:teuthology.orchestra.run.smithi001:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-15T21:56:52.371 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-15T21:56:52.372 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-15T21:56:52.649 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-15T21:56:52.649 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-15T21:56:52.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-15T21:56:52.835 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-15T21:56:52.986 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi070.front.sepia.ceph.com 2024-09-15T21:56:52.986 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-15T21:56:53.178 INFO:tasks.ceph:Archiving mon data... 2024-09-15T21:56:53.179 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906202/data/mon.a.tgz 2024-09-15T21:56:53.179 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-09-15T21:56:53.185 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.PTYEJNxgDs 2024-09-15T21:56:53.186 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.PTYEJNxgDs 2024-09-15T21:56:53.301 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.PTYEJNxgDs 2024-09-15T21:56:53.370 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.PTYEJNxgDs is 273KB 2024-09-15T21:56:53.430 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.PTYEJNxgDs 2024-09-15T21:56:53.436 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906202/data/mon.b.tgz 2024-09-15T21:56:53.436 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-15T21:56:53.442 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.bLHdVOOpP3 2024-09-15T21:56:53.442 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.bLHdVOOpP3 2024-09-15T21:56:53.570 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.bLHdVOOpP3 2024-09-15T21:56:53.632 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.bLHdVOOpP3 is 367KB 2024-09-15T21:56:53.690 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.bLHdVOOpP3 2024-09-15T21:56:53.695 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906202/data/mon.c.tgz 2024-09-15T21:56:53.695 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-15T21:56:53.744 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.IBhdyM20Mg 2024-09-15T21:56:53.744 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.IBhdyM20Mg 2024-09-15T21:56:53.870 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.IBhdyM20Mg 2024-09-15T21:56:53.937 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.IBhdyM20Mg is 367KB 2024-09-15T21:56:53.998 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.IBhdyM20Mg 2024-09-15T21:56:54.004 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-15T21:56:54.004 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T21:56:54.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T21:56:54.066 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T21:56:54.108 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T21:56:54.108 INFO:tasks.ceph:Archiving crash dumps... 2024-09-15T21:56:54.110 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906202/remote/smithi001/crash 2024-09-15T21:56:54.111 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T21:56:54.124 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906202/remote/smithi070/crash 2024-09-15T21:56:54.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T21:56:54.164 INFO:tasks.ceph:Shutting down logrotate 2024-09-15T21:56:54.165 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T21:56:54.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T21:56:54.241 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-15T21:56:54.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-15T21:56:54.296 INFO:tasks.ceph:Compressing logs... 2024-09-15T21:56:54.296 DEBUG:teuthology.orchestra.run.smithi001:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T21:56:54.298 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T21:56:54.316 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36392.log 2024-09-15T21:56:54.325 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35982.log 2024-09-15T21:56:54.325 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33514.log 2024-09-15T21:56:54.325 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36392.log.gz 2024-09-15T21:56:54.325 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35631.log 2024-09-15T21:56:54.326 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33514.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35982.log.gz 2024-09-15T21:56:54.326 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-15T21:56:54.326 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7%/var/log/ceph/ceph-client.admin.35631.log: -- replaced with /var/log/ceph/ceph-client.admin.33514.log.gz 2024-09-15T21:56:54.326 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36711.log 2024-09-15T21:56:54.326 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mgr.y.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35631.log.gz 2024-09-15T21:56:54.326 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36366.log 2024-09-15T21:56:54.326 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33801.log 2024-09-15T21:56:54.326 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36711.log.gz 2024-09-15T21:56:54.327 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35193.log 2024-09-15T21:56:54.327 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36366.log.gz 2024-09-15T21:56:54.327 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36867.log 2024-09-15T21:56:54.327 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33801.log: /var/log/ceph/ceph-client.admin.35193.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33801.log.gz 2024-09-15T21:56:54.327 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34206.log 2024-09-15T21:56:54.327 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35193.log.gz 2024-09-15T21:56:54.327 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36605.log 2024-09-15T21:56:54.327 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34206.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36867.log.gz 2024-09-15T21:56:54.327 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-15T21:56:54.328 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34206.log.gz 2024-09-15T21:56:54.328 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36841.log 2024-09-15T21:56:54.328 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36605.log.gz 2024-09-15T21:56:54.328 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33432.log 2024-09-15T21:56:54.328 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34763.log 2024-09-15T21:56:54.328 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36841.log.gz 2024-09-15T21:56:54.328 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36489.log 2024-09-15T21:56:54.329 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33432.log.gz 2024-09-15T21:56:54.329 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.34763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34450.log 2024-09-15T21:56:54.329 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36515.log 2024-09-15T21:56:54.329 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.0.34763.log.gz 2024-09-15T21:56:54.329 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36489.log.gz 2024-09-15T21:56:54.329 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36815.log 2024-09-15T21:56:54.329 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34450.log: /var/log/ceph/ceph-client.admin.36515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34476.log 2024-09-15T21:56:54.329 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36515.log.gz 2024-09-15T21:56:54.330 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36815.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34450.log.gz 2024-09-15T21:56:54.330 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36945.log 2024-09-15T21:56:54.340 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.34212.log 2024-09-15T21:56:54.340 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36815.log.gz 2024-09-15T21:56:54.340 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34476.log: /var/log/ceph/ceph-client.admin.36945.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34476.log.gz 2024-09-15T21:56:54.340 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35930.log 2024-09-15T21:56:54.340 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36945.log.gz 2024-09-15T21:56:54.341 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35575.log 2024-09-15T21:56:54.341 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34212.log: /var/log/ceph/ceph-client.admin.35930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33488.log 2024-09-15T21:56:54.341 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35575.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34212.log.gz 2024-09-15T21:56:54.341 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35930.log.gz 2024-09-15T21:56:54.341 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36084.log 2024-09-15T21:56:54.341 INFO:teuthology.orchestra.run.smithi001.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35575.log.gz 2024-09-15T21:56:54.341 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35523.log 2024-09-15T21:56:54.341 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33488.log.gz 2024-09-15T21:56:54.342 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34979.log 2024-09-15T21:56:54.342 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36084.log.gz 2024-09-15T21:56:54.342 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35219.log 2024-09-15T21:56:54.342 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35523.log.gz 2024-09-15T21:56:54.342 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36034.log 2024-09-15T21:56:54.342 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34979.log: /var/log/ceph/ceph-client.admin.35219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33287.log 2024-09-15T21:56:54.342 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35219.log.gz 2024-09-15T21:56:54.343 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34979.log.gz 2024-09-15T21:56:54.343 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33261.log 2024-09-15T21:56:54.343 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34868.log 2024-09-15T21:56:54.343 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33287.log.gz 2024-09-15T21:56:54.343 INFO:teuthology.orchestra.run.smithi001.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36034.log.gz 2024-09-15T21:56:54.343 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34946.log 2024-09-15T21:56:54.343 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34868.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33261.log.gz 2024-09-15T21:56:54.344 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35141.log 2024-09-15T21:56:54.344 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34868.log.gz 2024-09-15T21:56:54.344 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-15T21:56:54.344 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34946.log: /var/log/ceph/ceph-client.admin.35141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28750.log 2024-09-15T21:56:54.344 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-osd.2.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34946.log.gz 2024-09-15T21:56:54.344 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35141.log.gz 2024-09-15T21:56:54.344 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35321.log 2024-09-15T21:56:54.344 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.28750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35367.log 2024-09-15T21:56:54.345 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35321.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.28750.log.gz 2024-09-15T21:56:54.345 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36340.log 2024-09-15T21:56:54.345 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35367.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35321.log.gz 2024-09-15T21:56:54.345 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-15T21:56:54.345 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35367.log.gz 2024-09-15T21:56:54.345 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33802.log 2024-09-15T21:56:54.345 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mon.a.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36340.log.gz 2024-09-15T21:56:54.346 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34218.log 2024-09-15T21:56:54.346 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34001.log 2024-09-15T21:56:54.346 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33802.log: /var/log/ceph/ceph-client.admin.34218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35692.log 2024-09-15T21:56:54.346 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33802.log.gz 2024-09-15T21:56:54.346 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34001.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34218.log.gz 2024-09-15T21:56:54.346 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33235.log 2024-09-15T21:56:54.346 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34001.log.gz 2024-09-15T21:56:54.347 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35800.log 2024-09-15T21:56:54.347 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35692.log.gz 2024-09-15T21:56:54.347 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35037.log 2024-09-15T21:56:54.347 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35800.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33235.log.gz 2024-09-15T21:56:54.347 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34502.log 2024-09-15T21:56:54.347 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35800.log.gz 2024-09-15T21:56:54.347 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34213.log 2024-09-15T21:56:54.347 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35037.log.gz 2024-09-15T21:56:54.348 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28972.log 2024-09-15T21:56:54.348 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33540.log 2024-09-15T21:56:54.348 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34213.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34502.log.gz 2024-09-15T21:56:54.348 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.28972.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34213.log.gz 2024-09-15T21:56:54.348 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36567.log 2024-09-15T21:56:54.348 INFO:teuthology.orchestra.run.smithi001.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28972.log.gz 2024-09-15T21:56:54.348 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35264.log 2024-09-15T21:56:54.349 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33540.log: /var/log/ceph/ceph-client.admin.36567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35115.log 2024-09-15T21:56:54.349 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33540.log.gz 2024-09-15T21:56:54.349 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35264.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36567.log.gz 2024-09-15T21:56:54.382 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33797.log 2024-09-15T21:56:54.382 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35264.log.gz 2024-09-15T21:56:54.383 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32556.log 2024-09-15T21:56:54.383 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33797.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34894.log 2024-09-15T21:56:54.383 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35115.log.gz 2024-09-15T21:56:54.383 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33797.log.gz 2024-09-15T21:56:54.383 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.32556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33592.log 2024-09-15T21:56:54.383 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32556.log.gz 2024-09-15T21:56:54.383 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35666.log 2024-09-15T21:56:54.383 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34894.log: /var/log/ceph/ceph-client.admin.33592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35774.log 2024-09-15T21:56:54.384 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34894.log.gz 2024-09-15T21:56:54.384 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35666.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-15T21:56:54.384 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33592.log.gz 2024-09-15T21:56:54.384 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37075.log 2024-09-15T21:56:54.384 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35666.log.gz 2024-09-15T21:56:54.384 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35774.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34580.log 2024-09-15T21:56:54.384 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.37075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35167.log 2024-09-15T21:56:54.384 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35774.log.gz 2024-09-15T21:56:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36140.log 2024-09-15T21:56:54.385 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37075.log.gz 2024-09-15T21:56:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35167.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.34580.log.gz 2024-09-15T21:56:54.385 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35167.log.gz 2024-09-15T21:56:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36631.log 2024-09-15T21:56:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.36140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35063.log 2024-09-15T21:56:54.385 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35471.log 2024-09-15T21:56:54.386 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36631.log.gz 2024-09-15T21:56:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35063.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35063.log.gz 2024-09-15T21:56:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33798.log 2024-09-15T21:56:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33696.log 2024-09-15T21:56:54.386 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35471.log.gz 2024-09-15T21:56:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33798.log: 93.2% -- replaced with /var/log/ceph/ceph-client.0.36140.log.gz 2024-09-15T21:56:54.386 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33798.log.gz 2024-09-15T21:56:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34002.log 2024-09-15T21:56:54.386 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36201.log 2024-09-15T21:56:54.387 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34002.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33696.log.gz 2024-09-15T21:56:54.387 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35878.log 2024-09-15T21:56:54.387 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34211.log 2024-09-15T21:56:54.387 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34002.log.gz 2024-09-15T21:56:54.387 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36201.log: /var/log/ceph/ceph-client.admin.35878.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35878.log.gz 2024-09-15T21:56:54.387 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36201.log.gz 2024-09-15T21:56:54.387 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33159.log 2024-09-15T21:56:54.388 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33462.log 2024-09-15T21:56:54.388 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4%/var/log/ceph/ceph-client.admin.33159.log: -- replaced with /var/log/ceph/ceph-client.admin.34211.log.gz 2024-09-15T21:56:54.388 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36763.log 2024-09-15T21:56:54.388 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33159.log.gz 2024-09-15T21:56:54.388 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33462.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33462.log.gz 2024-09-15T21:56:54.388 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33748.log 2024-09-15T21:56:54.388 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-15T21:56:54.389 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36763.log: /var/log/ceph/ceph-client.admin.33748.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-15T21:56:54.389 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33406.log 2024-09-15T21:56:54.389 INFO:teuthology.orchestra.run.smithi001.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36763.log.gz 2024-09-15T21:56:54.389 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.33748.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37023.log 2024-09-15T21:56:54.389 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-15T21:56:54.389 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36314.log 2024-09-15T21:56:54.389 INFO:teuthology.orchestra.run.smithi001.stderr:gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33406.log.gz -5 2024-09-15T21:56:54.389 INFO:teuthology.orchestra.run.smithi001.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33793.log 2024-09-15T21:56:54.389 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.37023.log: /var/log/ceph/ceph-client.admin.36314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36231.log 2024-09-15T21:56:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33793.log: 89.3% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37023.log.gz 2024-09-15T21:56:54.390 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36314.log.gz 2024-09-15T21:56:54.390 INFO:teuthology.orchestra.run.smithi001.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33793.log.gz 2024-09-15T21:56:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36261.log 2024-09-15T21:56:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37127.log 2024-09-15T21:56:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36261.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36231.log.gz 2024-09-15T21:56:54.390 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35089.log 2024-09-15T21:56:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37049.log 2024-09-15T21:56:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.37127.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36261.log.gz 2024-09-15T21:56:54.391 INFO:teuthology.orchestra.run.smithi001.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37127.log.gz 2024-09-15T21:56:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35445.log 2024-09-15T21:56:54.391 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35089.log.gz 2024-09-15T21:56:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.37049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33994.log 2024-09-15T21:56:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35445.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37049.log.gz 2024-09-15T21:56:54.391 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35006.log 2024-09-15T21:56:54.391 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35445.log.gz/var/log/ceph/ceph-client.admin.33994.log: 2024-09-15T21:56:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34190.log 2024-09-15T21:56:54.392 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33994.log.gz 2024-09-15T21:56:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35006.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35006.log.gz 2024-09-15T21:56:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33644.log 2024-09-15T21:56:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35826.log 2024-09-15T21:56:54.392 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34190.log.gz/var/log/ceph/ceph-client.admin.33644.log: 2024-09-15T21:56:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33992.log 2024-09-15T21:56:54.392 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33644.log.gz 2024-09-15T21:56:54.392 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33566.log 2024-09-15T21:56:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35826.log: /var/log/ceph/ceph-client.admin.33992.log: 89.0% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35826.log.gz 2024-09-15T21:56:54.393 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33992.log.gz 2024-09-15T21:56:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37177.log 2024-09-15T21:56:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33566.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T21:56:54.393 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.37177.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35419.log 2024-09-15T21:56:54.394 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33566.log.gz 2024-09-15T21:56:54.394 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37177.log.gz 2024-09-15T21:56:54.394 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.log: 85.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T21:56:54.394 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34214.log 2024-09-15T21:56:54.394 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34010.log 2024-09-15T21:56:54.394 INFO:teuthology.orchestra.run.smithi001.stderr: 89.7%/var/log/ceph/ceph-client.admin.34214.log: -- replaced with /var/log/ceph/ceph-client.admin.35419.log.gz 2024-09-15T21:56:54.395 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34424.log 2024-09-15T21:56:54.395 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34214.log.gz 2024-09-15T21:56:54.395 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36893.log 2024-09-15T21:56:54.395 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34010.log: /var/log/ceph/ceph-client.admin.34424.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34010.log.gz 2024-09-15T21:56:54.395 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34424.log.gz 2024-09-15T21:56:54.395 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36657.log 2024-09-15T21:56:54.395 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36444.log 2024-09-15T21:56:54.396 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7%/var/log/ceph/ceph-client.admin.36657.log: -- replaced with /var/log/ceph/ceph-client.admin.36893.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33345.log 2024-09-15T21:56:54.396 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-15T21:56:54.396 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36657.log.gz 2024-09-15T21:56:54.396 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36444.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36444.log.gz 2024-09-15T21:56:54.396 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36997.log 2024-09-15T21:56:54.396 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35292.log 2024-09-15T21:56:54.396 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1%/var/log/ceph/ceph-client.admin.36997.log: -- replaced with /var/log/ceph/ceph-client.admin.33345.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28866.log 2024-09-15T21:56:54.396 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-15T21:56:54.397 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36997.log.gz 2024-09-15T21:56:54.397 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35292.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35292.log.gz 2024-09-15T21:56:54.397 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37203.log 2024-09-15T21:56:54.397 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.28866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35748.log 2024-09-15T21:56:54.397 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.37203.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28866.log.gz 2024-09-15T21:56:54.397 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34210.log 2024-09-15T21:56:54.397 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33722.log 2024-09-15T21:56:54.397 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37203.log.gz 2024-09-15T21:56:54.397 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35748.log: /var/log/ceph/ceph-client.admin.34210.log: 88.1% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35748.log.gz -- replaced with /var/log/ceph/ceph-client.admin.34210.log.gz 2024-09-15T21:56:54.398 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-15T21:56:54.398 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T21:56:54.398 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35956.log 2024-09-15T21:56:54.398 INFO:teuthology.orchestra.run.smithi001.stderr: 89.6%/var/log/ceph/ceph.audit.log: -- replaced with /var/log/ceph/ceph-client.admin.33722.log.gz 2024-09-15T21:56:54.398 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33795.log 2024-09-15T21:56:54.398 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35956.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35956.log.gz 2024-09-15T21:56:54.398 INFO:teuthology.orchestra.run.smithi001.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-15T21:56:54.398 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T21:56:54.399 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33380.log 2024-09-15T21:56:54.399 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37101.log 2024-09-15T21:56:54.399 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33795.log.gz 2024-09-15T21:56:54.399 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.33380.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33380.log.gz 2024-09-15T21:56:54.399 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33189.log 2024-09-15T21:56:54.399 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.37101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35852.log 2024-09-15T21:56:54.399 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37101.log.gz 2024-09-15T21:56:54.399 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33189.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33189.log.gz 2024-09-15T21:56:54.400 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36737.log 2024-09-15T21:56:54.400 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33996.log 2024-09-15T21:56:54.417 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36737.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35852.log.gz 2024-09-15T21:56:54.417 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36737.log.gz 2024-09-15T21:56:54.417 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33799.log 2024-09-15T21:56:54.417 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34816.log 2024-09-15T21:56:54.417 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33996.log: /var/log/ceph/ceph-client.admin.33799.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33996.log.gz 2024-09-15T21:56:54.417 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35497.log 2024-09-15T21:56:54.418 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33799.log.gz 2024-09-15T21:56:54.418 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34816.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34816.log.gz 2024-09-15T21:56:54.418 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34635.log 2024-09-15T21:56:54.418 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36008.log 2024-09-15T21:56:54.418 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35497.log: /var/log/ceph/ceph-client.admin.34635.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35497.log.gz 2024-09-15T21:56:54.418 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34635.log.gz 2024-09-15T21:56:54.418 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36418.log 2024-09-15T21:56:54.419 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36288.log 2024-09-15T21:56:54.419 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36008.log: /var/log/ceph/ceph-client.admin.36418.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36008.log.gz 2024-09-15T21:56:54.419 INFO:teuthology.orchestra.run.smithi001.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36418.log.gz 2024-09-15T21:56:54.419 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23909.log 2024-09-15T21:56:54.419 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36288.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36288.log.gz 2024-09-15T21:56:54.419 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34528.log 2024-09-15T21:56:54.419 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34398.log 2024-09-15T21:56:54.420 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.tmp-client.admin.23909.log: /var/log/ceph/ceph-client.admin.34528.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23909.log.gz 2024-09-15T21:56:54.420 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34009.log 2024-09-15T21:56:54.420 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34528.log.gz 2024-09-15T21:56:54.420 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34398.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34398.log.gz 2024-09-15T21:56:54.420 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35393.log 2024-09-15T21:56:54.420 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36919.log 2024-09-15T21:56:54.420 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34009.log: /var/log/ceph/ceph-client.admin.35393.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34009.log.gz 2024-09-15T21:56:54.420 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35393.log.gz 2024-09-15T21:56:54.421 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36789.log 2024-09-15T21:56:54.421 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33317.log 2024-09-15T21:56:54.421 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36919.log: /var/log/ceph/ceph-client.admin.36789.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36919.log.gz 2024-09-15T21:56:54.421 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36789.log.gz 2024-09-15T21:56:54.421 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36683.log 2024-09-15T21:56:54.421 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36541.log 2024-09-15T21:56:54.421 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33317.log: /var/log/ceph/ceph-client.admin.36683.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36683.log.gz 2024-09-15T21:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33317.log.gz 2024-09-15T21:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33997.log 2024-09-15T21:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35603.log 2024-09-15T21:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.36541.log: /var/log/ceph/ceph-client.admin.33997.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36541.log.gz 2024-09-15T21:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33997.log.gz 2024-09-15T21:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37153.log 2024-09-15T21:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34842.log 2024-09-15T21:56:54.422 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35603.log: /var/log/ceph/ceph-client.admin.37153.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35603.log.gz 2024-09-15T21:56:54.423 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37153.log.gz 2024-09-15T21:56:54.423 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33618.log 2024-09-15T21:56:54.423 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35549.log 2024-09-15T21:56:54.423 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34842.log: /var/log/ceph/ceph-client.admin.33618.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34842.log.gz 2024-09-15T21:56:54.423 INFO:teuthology.orchestra.run.smithi001.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33618.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33783.log 2024-09-15T21:56:54.423 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-15T21:56:54.423 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35549.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35549.log.gz 2024-09-15T21:56:54.423 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35904.log 2024-09-15T21:56:54.423 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34920.log 2024-09-15T21:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.33783.log: /var/log/ceph/ceph-client.admin.35904.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33783.log.gz 2024-09-15T21:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35904.log.gz 2024-09-15T21:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36971.log 2024-09-15T21:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35718.log 2024-09-15T21:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34920.log: /var/log/ceph/ceph-client.admin.36971.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34920.log.gz 2024-09-15T21:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34554.log 2024-09-15T21:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36971.log.gz 2024-09-15T21:56:54.424 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35718.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35718.log.gz 2024-09-15T21:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33670.log 2024-09-15T21:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.34554.log: /var/log/ceph/ceph-client.admin.33670.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34554.log.gz 2024-09-15T21:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33670.log.gz 2024-09-15T21:56:54.425 INFO:teuthology.orchestra.run.smithi001.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-15T21:56:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-15T21:56:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-15T21:56:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28977.log 2024-09-15T21:56:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29001.log 2024-09-15T21:56:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-15T21:56:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28977.log: /var/log/ceph/ceph-client.admin.29001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29049.log 2024-09-15T21:56:54.428 INFO:teuthology.orchestra.run.smithi070.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29001.log.gz 2024-09-15T21:56:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.5.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.28977.log.gz --verbose 2024-09-15T21:56:54.428 INFO:teuthology.orchestra.run.smithi070.stderr: -- /var/log/ceph/ceph-client.admin.29025.log 2024-09-15T21:56:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29049.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-15T21:56:54.428 INFO:teuthology.orchestra.run.smithi070.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29049.log.gz 2024-09-15T21:56:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T21:56:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29025.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29025.log.gz 2024-09-15T21:56:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-15T21:56:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29097.log 2024-09-15T21:56:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T21:56:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29073.log 2024-09-15T21:56:54.429 INFO:teuthology.orchestra.run.smithi070.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29097.log.gz 2024-09-15T21:56:54.429 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.audit.log: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T21:56:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29145.log 2024-09-15T21:56:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29121.log 2024-09-15T21:56:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29073.log: /var/log/ceph/ceph-client.admin.29145.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29073.log.gz 2024-09-15T21:56:54.430 INFO:teuthology.orchestra.run.smithi070.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T21:56:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-15T21:56:54.430 INFO:teuthology.orchestra.run.smithi070.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29145.log.gz 2024-09-15T21:56:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-15T21:56:54.430 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29121.log: /var/log/ceph/ceph-mds.b.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.29121.log.gz -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-15T21:56:54.431 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-15T21:56:54.431 INFO:teuthology.orchestra.run.smithi070.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-15T21:56:54.431 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.b.log: 91.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-15T21:56:54.431 INFO:teuthology.orchestra.run.smithi001.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-15T21:56:54.435 INFO:teuthology.orchestra.run.smithi001.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-15T21:56:54.465 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.4.log: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-15T21:56:54.471 INFO:teuthology.orchestra.run.smithi001.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-15T21:56:54.471 INFO:teuthology.orchestra.run.smithi001.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-15T21:56:54.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-15T21:56:54.491 INFO:teuthology.orchestra.run.smithi070.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-15T21:56:54.507 INFO:teuthology.orchestra.run.smithi001.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-15T21:56:54.508 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-15T21:56:54.508 INFO:teuthology.orchestra.run.smithi001.stderr:real 0m0.208s 2024-09-15T21:56:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:user 0m0.847s 2024-09-15T21:56:54.509 INFO:teuthology.orchestra.run.smithi001.stderr:sys 0m0.068s 2024-09-15T21:56:54.524 INFO:teuthology.orchestra.run.smithi070.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-15T21:56:54.527 INFO:teuthology.orchestra.run.smithi070.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-15T21:56:54.527 INFO:teuthology.orchestra.run.smithi070.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-15T21:56:54.538 INFO:teuthology.orchestra.run.smithi070.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-15T21:56:54.539 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-15T21:56:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m0.186s 2024-09-15T21:56:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m0.626s 2024-09-15T21:56:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m0.026s 2024-09-15T21:56:54.540 INFO:tasks.ceph:Archiving logs... 2024-09-15T21:56:54.541 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906202/remote/smithi001/log 2024-09-15T21:56:54.542 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T21:56:54.758 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906202/remote/smithi070/log 2024-09-15T21:56:54.759 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T21:56:54.841 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T21:56:54.850 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T21:56:54.850 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T21:56:54.853 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T21:56:54.930 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T21:56:54.939 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T21:56:54.939 DEBUG:teuthology.orchestra.run.smithi001:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T21:56:54.942 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T21:56:54.954 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T21:56:54.954 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-09-15T21:56:54.955 INFO:teuthology.orchestra.run.smithi070.stdout:+hv01.front.sepi 67.205.162.81 3 u 54 64 37 0.199 -3.205 1.921 2024-09-15T21:56:54.955 INFO:teuthology.orchestra.run.smithi070.stdout:*hv02.front.sepi 63.231.80.2 3 u 53 64 37 0.086 -1.345 2.018 2024-09-15T21:56:54.955 INFO:teuthology.orchestra.run.smithi070.stdout:+hv03.front.sepi 74.6.168.72 3 u 54 64 37 0.132 -0.688 1.971 2024-09-15T21:56:54.955 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T21:56:54.957 INFO:teuthology.orchestra.run.smithi001.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T21:56:54.957 INFO:teuthology.orchestra.run.smithi001.stdout:============================================================================== 2024-09-15T21:56:54.957 INFO:teuthology.orchestra.run.smithi001.stdout:+hv01.front.sepi 67.205.162.81 3 u 54 64 37 0.150 -2.219 0.684 2024-09-15T21:56:54.957 INFO:teuthology.orchestra.run.smithi001.stdout:*hv02.front.sepi 63.231.80.2 3 u 55 64 37 0.142 -0.427 0.828 2024-09-15T21:56:54.958 INFO:teuthology.orchestra.run.smithi001.stdout:+hv03.front.sepi 74.6.168.72 3 u 52 64 37 0.084 +0.268 0.824 2024-09-15T21:56:54.958 INFO:teuthology.orchestra.run.smithi001.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T21:56:54.958 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T21:56:54.968 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T21:56:54.968 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T21:56:54.977 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T21:56:54.985 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T21:56:54.994 INFO:teuthology.task.internal:Duration was 785.272157 seconds 2024-09-15T21:56:54.994 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T21:56:55.002 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T21:56:55.003 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T21:56:55.005 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T21:56:55.045 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T21:56:55.045 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi001.front.sepia.ceph.com 2024-09-15T21:56:55.045 DEBUG:teuthology.orchestra.run.smithi001:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T21:56:55.098 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-09-15T21:56:55.098 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T21:56:55.109 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T21:56:55.109 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T21:56:55.141 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T21:56:55.179 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T21:56:55.179 DEBUG:teuthology.orchestra.run.smithi001:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T21:56:55.214 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T21:56:55.277 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T21:56:55.287 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T21:56:55.287 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T21:56:55.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T21:56:55.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T21:56:55.324 DEBUG:teuthology.orchestra.run.smithi001:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T21:56:55.346 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T21:56:55.353 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = core 2024-09-15T21:56:55.366 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-09-15T21:56:55.408 DEBUG:teuthology.orchestra.run.smithi001:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T21:56:55.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:56:55.416 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T21:56:55.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:56:55.456 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T21:56:55.466 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T21:56:55.467 DEBUG:teuthology.misc:Transferring archived files from smithi001:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906202/remote/smithi001 2024-09-15T21:56:55.467 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T21:56:55.490 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906202/remote/smithi070 2024-09-15T21:56:55.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T21:56:55.520 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T21:56:55.520 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T21:56:55.529 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T21:56:55.564 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T21:56:55.575 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T21:56:55.575 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T21:56:55.586 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T21:56:55.586 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T21:56:55.588 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T21:56:55.592 INFO:teuthology.orchestra.run.smithi001.stdout: 658468 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 21:56 /home/ubuntu/cephtest 2024-09-15T21:56:55.612 INFO:teuthology.orchestra.run.smithi070.stdout: 658464 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 21:56 /home/ubuntu/cephtest 2024-09-15T21:56:55.614 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T21:56:55.623 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T21:56:55.645 INFO:teuthology.run:Summary data: description: fs/shell/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/ubuntu_latest mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/cephfs-shell} duration: 785.2721567153931 failure_reason: 'Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=55e007dd73b1492d862e48035300d27c status: fail success: false 2024-09-15T21:56:55.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T21:56:55.721 INFO:teuthology.run:FAIL